2024-08-17T02:33:08.115 INFO:root:teuthology version: 1.2.0 2024-08-17T02:33:08.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:33:08.215 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858291 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7858291' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: enable_coprs: - ceph/el9 flavor: default sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e targets: smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC1MnRoeqC0usnB9o3wA6Sg6bKE2Vzqcfax8+FGWlyWW381xYCKdK0YF5G7xSzgdcb7oduJZr8K26Q35OSbVAYM= smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIgTYYPTXso6hK66VhnHfRB+0LWgAL4sDhUZmncXVGWSswxWrLtUt65BajKtqZ5+znAItqUhL+za8b2ZvWBmIAc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_01:10:27 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-17T02:33:08.215 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa; will attempt to use it 2024-08-17T02:33:08.216 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks 2024-08-17T02:33:08.216 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-17T02:33:08.218 INFO:teuthology.task.internal:Checking packages... 2024-08-17T02:33:08.238 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2577e8139c6b8786f9d6d6ea21b8da9244b9260e' 2024-08-17T02:33:08.238 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-17T02:33:08.238 INFO:teuthology.packaging:ref: None 2024-08-17T02:33:08.238 INFO:teuthology.packaging:tag: None 2024-08-17T02:33:08.238 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:33:08.238 INFO:teuthology.packaging:sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:33:08.239 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:33:08.375 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375.g2577e813 2024-08-17T02:33:08.376 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-17T02:33:08.382 INFO:teuthology.task.internal:no buildpackages task found 2024-08-17T02:33:08.383 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-17T02:33:08.395 INFO:teuthology.task.internal:Saving configuration 2024-08-17T02:33:08.411 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-17T02:33:08.418 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-17T02:33:08.443 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858291', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:28:08.183426', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC1MnRoeqC0usnB9o3wA6Sg6bKE2Vzqcfax8+FGWlyWW381xYCKdK0YF5G7xSzgdcb7oduJZr8K26Q35OSbVAYM='} 2024-08-17T02:33:08.467 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858291', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:28:08.182229', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIgTYYPTXso6hK66VhnHfRB+0LWgAL4sDhUZmncXVGWSswxWrLtUt65BajKtqZ5+znAItqUhL+za8b2ZvWBmIAc='} 2024-08-17T02:33:08.467 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-17T02:33:08.473 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-17T02:33:08.474 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-17T02:33:08.474 INFO:teuthology.run_tasks:Running task console_log... 2024-08-17T02:33:08.541 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5863b7bac0>, signals=[15]) 2024-08-17T02:33:08.542 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-17T02:33:08.547 INFO:teuthology.task.internal:Opening connections... 2024-08-17T02:33:08.547 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2024-08-17T02:33:08.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:33:08.622 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2024-08-17T02:33:08.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:33:08.698 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-17T02:33:08.705 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-08-17T02:33:08.722 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-08-17T02:33:08.723 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-08-17T02:33:08.779 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-08-17T02:33:08.780 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-08-17T02:33:08.780 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-08-17T02:33:08.780 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:33:08.780 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-08-17T02:33:08.780 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:33:08.780 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:33:08.780 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-08-17T02:33:08.780 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:33:08.780 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:33:08.780 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:33:08.780 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:33:08.780 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:33:08.781 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:33:08.781 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-08-17T02:33:08.805 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2024-08-17T02:33:08.822 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2024-08-17T02:33:08.822 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2024-08-17T02:33:08.879 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2024-08-17T02:33:08.879 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9" 2024-08-17T02:33:08.879 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2024-08-17T02:33:08.879 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:33:08.879 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9" 2024-08-17T02:33:08.880 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:33:08.880 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:33:08.880 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2024-08-17T02:33:08.880 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:33:08.880 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:33:08.880 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:33:08.880 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:33:08.880 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:33:08.880 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:33:08.880 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2024-08-17T02:33:08.913 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-17T02:33:08.922 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-17T02:33:08.931 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-17T02:33:08.931 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:33:08.934 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:33:08.949 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-17T02:33:08.954 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-17T02:33:08.954 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:33:08.990 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:33:09.099 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-17T02:33:09.154 INFO:teuthology.run_tasks:Running task kernel... 2024-08-17T02:33:09.167 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-17T02:33:09.168 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-08-17T02:33:09.168 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-08-17T02:33:09.168 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:33:09.169 DEBUG:teuthology.orchestra.run.smithi123:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:33:09.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:33:09.185 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:33:09.188 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:33:09.188 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:33:09.356 DEBUG:teuthology.task.kernel:sha1 for client.1 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:33:09.356 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:33:09.356 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2024-08-17T02:33:09.358 DEBUG:teuthology.task.kernel:sha1 for client.0 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:33:09.358 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:33:09.358 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-08-17T02:33:09.374 INFO:teuthology.orchestra.run.smithi123.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:33:09.374 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:33:09.374 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:33:09.375 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum upgrade -y linux-firmware 2024-08-17T02:33:09.376 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:33:09.376 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:33:09.376 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:33:09.376 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum upgrade -y linux-firmware 2024-08-17T02:33:11.854 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - BaseOS 9.4 MB/s | 8.2 MB 00:00 2024-08-17T02:33:13.054 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.2 MB 00:01 2024-08-17T02:33:13.870 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-08-17T02:33:14.821 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-08-17T02:33:18.320 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - CRB 9.1 MB/s | 6.6 MB 00:00 2024-08-17T02:33:19.939 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 6.6 MB 00:01 2024-08-17T02:33:20.112 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 18 kB 00:00 2024-08-17T02:33:21.082 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 27 MB/s | 22 MB 00:00 2024-08-17T02:33:21.481 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 88 kB/s | 18 kB 00:00 2024-08-17T02:33:22.368 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 29 MB/s | 22 MB 00:00 2024-08-17T02:33:26.463 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-08-17T02:33:27.766 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-08-17T02:33:28.562 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-08-17T02:33:28.576 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-08-17T02:33:28.576 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2024-08-17T02:33:28.576 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-08-17T02:33:28.576 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrading: 2024-08-17T02:33:28.576 INFO:teuthology.orchestra.run.smithi123.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:33:28.576 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:33:28.576 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-08-17T02:33:28.576 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-08-17T02:33:28.577 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrade 1 Package 2024-08-17T02:33:28.577 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:33:28.577 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 383 M 2024-08-17T02:33:28.577 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-08-17T02:33:29.813 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-08-17T02:33:29.827 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-08-17T02:33:29.827 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2024-08-17T02:33:29.827 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-08-17T02:33:29.827 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-08-17T02:33:29.827 INFO:teuthology.orchestra.run.smithi100.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:33:29.828 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:33:29.828 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-08-17T02:33:29.828 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-08-17T02:33:29.828 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 1 Package 2024-08-17T02:33:29.828 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:33:29.828 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 383 M 2024-08-17T02:33:29.828 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-08-17T02:33:38.400 INFO:teuthology.orchestra.run.smithi100.stdout:linux-firmware-20240716-145.el9.noarch.rpm 46 MB/s | 383 MB 00:08 2024-08-17T02:33:38.400 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:33:38.400 INFO:teuthology.orchestra.run.smithi100.stdout:Total 45 MB/s | 383 MB 00:08 2024-08-17T02:33:41.475 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-08-17T02:33:41.560 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-08-17T02:33:41.560 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-08-17T02:33:44.862 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-08-17T02:33:44.863 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-08-17T02:33:53.961 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-08-17T02:33:54.703 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:33:54.786 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:33:55.692 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:33:55.692 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:33:56.434 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:33:56.434 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:33:56.434 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-08-17T02:33:56.434 INFO:teuthology.orchestra.run.smithi100.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:33:56.434 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:33:56.434 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-08-17T02:33:56.742 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:33:56.743 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:33:56.904 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:33:56.904 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:33:56.907 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi100.front.sepia.ceph.com to complete... 2024-08-17T02:34:05.660 INFO:teuthology.orchestra.run.smithi123.stdout:linux-firmware-20240716-145.el9.noarch.rpm 10 MB/s | 383 MB 00:36 2024-08-17T02:34:05.661 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:34:05.661 INFO:teuthology.orchestra.run.smithi123.stdout:Total 10 MB/s | 383 MB 00:37 2024-08-17T02:34:08.747 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-08-17T02:34:08.861 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-08-17T02:34:08.861 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-08-17T02:34:12.124 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-08-17T02:34:12.124 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-08-17T02:34:19.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17 02:34:19 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:34:19.036 INFO:teuthology.orchestra.run.smithi100.stderr:FINISHED --2024-08-17 02:34:19-- 2024-08-17T02:34:19.036 INFO:teuthology.orchestra.run.smithi100.stderr:Total wall clock time: 22s 2024-08-17T02:34:19.036 INFO:teuthology.orchestra.run.smithi100.stderr:Downloaded: 1 files, 344M in 22s (16.0 MB/s) 2024-08-17T02:34:19.040 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:34:19.040 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:34:21.141 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying... ######################################## 2024-08-17T02:34:21.180 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-08-17T02:34:21.180 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing... ######################################## 2024-08-17T02:34:21.230 INFO:teuthology.orchestra.run.smithi100.stdout:Updating / installing... 2024-08-17T02:34:21.752 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:34:21.835 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:34:22.372 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:34:22.372 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:34:23.118 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:34:23.118 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:34:23.118 INFO:teuthology.orchestra.run.smithi123.stdout:Upgraded: 2024-08-17T02:34:23.118 INFO:teuthology.orchestra.run.smithi123.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:34:23.118 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:34:23.118 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-08-17T02:34:23.429 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:34:23.430 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:34:23.578 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:34:23.578 DEBUG:teuthology.orchestra.run.smithi123:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:34:23.581 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi123.front.sepia.ceph.com to complete... 2024-08-17T02:34:29.179 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:34:41.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17 02:34:41 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:34:41.980 INFO:teuthology.orchestra.run.smithi123.stderr:FINISHED --2024-08-17 02:34:41-- 2024-08-17T02:34:41.980 INFO:teuthology.orchestra.run.smithi123.stderr:Total wall clock time: 18s 2024-08-17T02:34:41.980 INFO:teuthology.orchestra.run.smithi123.stderr:Downloaded: 1 files, 344M in 18s (19.1 MB/s) 2024-08-17T02:34:41.984 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:34:41.984 DEBUG:teuthology.orchestra.run.smithi123:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:34:44.047 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying... ######################################## 2024-08-17T02:34:44.090 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing... ######################################## 2024-08-17T02:34:44.139 INFO:teuthology.orchestra.run.smithi123.stdout:Updating / installing... 2024-08-17T02:34:52.113 INFO:teuthology.orchestra.run.smithi123.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:35:09.794 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi100.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:35:09.795 DEBUG:teuthology.orchestra.run.smithi100:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:35:09.874 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:09.874 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:09.874 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:09.874 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:09.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:35:09.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:35:09.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:35:09.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:35:09.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:35:09.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:35:09.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:35:09.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:35:09.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:35:09.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:35:09.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:35:09.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:35:09.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:35:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:35:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:35:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:35:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:35:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:35:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:35:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:35:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:35:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:35:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:35:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:35:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:35:09.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:35:09.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:35:09.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:35:09.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:35:09.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:35:09.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:35:09.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:35:09.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:35:09.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:35:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:35:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:35:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:35:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:35:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:35:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:35:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:35:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:35:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:35:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:35:09.878 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:35:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:35:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:35:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:35:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:35:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:35:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:35:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:35:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:35:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:35:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:35:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:35:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:35:09.879 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:35:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:35:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:35:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:35:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:35:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:35:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:35:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:35:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:35:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:35:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:35:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:35:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:35:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:35:09.880 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:35:09.881 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:35:09.881 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:35:09.881 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:35:09.881 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:35:09.881 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:35:09.881 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:35:09.881 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:35:09.881 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:35:09.881 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:35:09.881 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:35:09.881 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:35:09.881 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:35:09.881 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:35:09.882 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:35:09.882 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:35:09.882 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:35:09.882 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:35:09.882 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:35:09.882 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:35:09.882 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:35:09.882 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:35:09.882 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:35:09.882 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:35:09.882 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:35:09.882 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:35:09.882 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:35:09.883 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:35:09.883 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:35:09.883 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:35:09.883 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:35:09.883 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:35:09.883 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:35:09.883 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:35:09.883 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:35:09.883 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:35:09.883 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:35:09.883 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:35:09.883 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:35:09.884 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:35:09.884 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:35:09.884 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:35:09.884 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:35:09.884 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:35:09.884 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:35:09.884 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:35:09.884 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:35:09.884 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:35:09.884 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:35:09.884 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:35:09.884 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:35:09.885 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:35:09.885 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:35:09.885 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:35:09.885 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:35:09.885 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:35:09.885 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:35:09.885 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:35:09.885 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:35:09.885 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:35:09.885 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:35:09.885 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:35:09.885 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:35:09.885 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:35:09.885 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:35:09.885 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:35:09.886 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:35:09.886 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:35:09.886 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:35:09.886 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:35:09.886 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:35:09.886 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:35:09.886 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:35:09.886 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:35:09.886 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:35:09.886 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:35:09.886 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:35:09.886 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:35:09.887 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:35:09.887 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:35:09.887 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:35:09.887 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:35:09.887 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:35:09.887 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:35:09.887 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:35:09.887 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:35:09.887 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:35:09.887 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:35:09.887 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:35:09.887 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:35:09.887 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:35:09.888 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:35:09.888 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:35:09.888 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:35:09.888 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:35:09.888 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:35:09.888 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:35:09.888 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:35:09.888 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:35:09.888 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:35:09.888 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:35:09.888 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:35:09.888 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:35:09.888 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:35:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:35:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:35:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:35:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:35:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:35:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:35:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:35:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:35:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:35:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:35:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:35:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:35:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:35:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:35:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:35:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:35:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:35:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:35:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:35:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:35:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:35:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:35:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:35:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:35:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:35:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:35:09.891 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:35:09.891 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:35:09.891 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:35:09.891 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:35:09.891 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:35:09.891 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:35:09.891 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:35:09.891 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:35:09.891 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:35:09.891 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:35:09.891 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:35:09.891 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:35:09.891 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:35:09.891 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:35:09.892 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:35:09.892 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:35:09.892 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:35:09.892 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:35:09.892 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:35:09.892 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:35:09.892 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:35:09.892 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:35:09.892 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:35:09.892 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:35:09.892 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:35:09.892 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:35:09.892 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:35:09.892 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:35:09.893 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:35:09.893 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:35:09.893 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:35:09.893 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:35:09.893 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:35:09.893 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:35:09.893 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:35:09.893 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:35:09.893 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:35:09.893 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:35:09.893 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:35:09.893 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:35:09.893 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:35:09.894 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:35:09.894 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:35:09.894 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:35:09.894 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:35:09.894 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:35:09.894 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:35:09.894 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:35:09.894 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:35:09.894 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:35:09.894 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:35:09.894 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:35:09.894 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:35:09.895 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:35:09.895 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:35:09.895 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:35:09.895 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:35:09.895 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:35:09.895 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:35:09.895 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:35:09.895 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:35:09.895 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:35:09.895 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:35:09.895 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:35:09.895 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:35:09.895 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:35:09.896 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:35:09.896 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:35:09.896 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:35:09.896 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:35:09.896 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:35:09.896 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:35:09.896 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:35:09.896 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:35:09.896 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:35:09.896 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:35:09.896 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:35:09.896 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:35:09.896 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:35:09.896 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:35:09.897 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:35:09.897 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:35:09.897 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:35:09.897 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:35:09.897 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:35:09.897 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:35:09.897 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:35:09.897 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:35:09.897 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:35:09.897 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:35:09.897 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:35:09.897 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:35:09.897 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:35:09.897 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:35:09.897 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:35:09.898 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:35:09.898 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:35:09.898 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:35:09.898 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:35:09.898 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:35:09.898 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:35:09.898 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:35:09.898 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:35:09.898 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:35:09.898 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:35:09.898 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:35:09.898 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:35:09.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:35:09.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:35:09.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:35:09.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:35:09.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:35:09.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:35:09.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:35:09.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:35:09.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:35:09.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:35:09.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:35:09.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:35:09.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:35:09.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:35:09.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:35:09.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:35:09.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:35:09.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:35:09.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:35:09.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:35:09.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:35:09.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:35:09.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:35:09.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:35:09.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:35:09.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:35:09.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:35:09.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:35:09.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:35:09.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:35:09.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:35:09.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:35:09.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:35:09.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:35:09.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:35:09.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:35:09.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:35:09.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:35:09.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:35:09.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:35:09.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:35:09.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:35:09.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:35:09.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:35:09.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:35:09.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:35:09.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:35:09.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:35:09.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:35:09.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:35:09.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:35:09.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:35:09.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:35:09.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:35:09.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:35:09.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:35:09.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:35:09.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:35:09.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:35:09.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:35:09.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:35:09.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:35:09.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:35:09.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:35:09.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:35:09.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:35:09.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:35:09.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:35:09.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:35:09.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:35:09.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:35:09.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:35:09.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:35:09.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:35:09.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:35:09.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:35:09.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:35:09.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:35:09.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:35:09.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:35:09.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:35:09.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:35:09.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:35:09.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:35:09.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:35:09.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:35:09.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:35:09.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:35:09.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:35:09.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:35:09.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:35:09.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:35:09.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:35:09.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:35:09.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:35:09.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:35:09.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:35:09.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:35:09.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:35:09.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:35:09.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:35:09.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:35:09.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:35:09.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:35:09.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:35:09.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:35:09.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:35:09.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:35:09.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:35:09.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:35:09.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:35:09.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:35:09.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:35:09.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:35:09.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:35:09.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:35:09.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:35:09.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:35:09.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:35:09.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:35:09.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:35:09.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:35:09.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:35:09.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:35:09.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:35:09.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:35:09.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:35:09.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:35:09.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:35:09.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:35:09.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:35:09.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:35:09.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:35:09.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:35:09.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:35:09.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:35:09.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:35:09.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:35:09.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:35:09.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:35:09.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:35:09.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:35:09.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:35:09.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:35:09.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:35:09.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:35:09.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:35:09.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:35:09.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:35:09.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:35:09.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:35:09.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:35:09.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:35:09.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:35:09.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:35:09.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:35:09.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:35:09.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:35:09.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:35:09.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:35:09.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:35:09.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:35:09.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:35:09.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:35:09.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:35:09.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:35:09.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:35:09.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:35:09.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:35:09.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:35:09.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:35:09.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:35:09.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:35:09.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:35:09.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:35:09.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:35:09.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:35:09.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:35:09.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:35:09.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:35:09.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:35:09.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:35:09.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:35:09.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:35:09.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:35:09.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:35:09.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:35:09.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:35:09.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:35:09.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:35:09.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:35:09.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:35:09.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:35:09.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:35:09.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:35:09.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:35:09.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:35:09.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:35:09.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:35:09.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:35:09.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:35:09.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:35:09.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:35:09.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:35:09.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:35:09.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:35:09.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:35:09.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:35:09.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:35:09.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:35:09.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:35:09.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:35:09.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:35:09.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:35:09.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:35:09.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:35:09.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:35:09.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:35:09.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:35:09.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:35:09.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:35:09.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:35:09.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:35:09.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:35:09.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:35:09.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:35:09.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:35:09.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:35:09.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:35:09.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:35:09.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:35:09.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:35:09.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:35:09.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:35:09.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:35:09.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:35:09.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:35:09.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:35:09.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:35:09.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:35:09.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:35:09.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:35:09.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:35:09.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:35:09.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:35:09.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:35:09.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:35:09.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:35:09.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:35:09.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:35:09.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:35:09.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:35:09.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:35:09.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:35:09.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:35:09.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:35:09.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:35:09.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:35:09.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:35:09.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:35:09.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:35:09.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:35:09.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:35:09.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:35:09.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:35:09.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:35:09.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:35:09.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:35:09.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:35:09.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:35:09.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:35:09.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:35:09.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:35:09.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:35:09.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:35:09.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:35:09.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:35:09.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:35:09.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:35:09.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:35:09.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:35:09.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:35:09.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:35:09.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:35:09.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:35:09.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:35:09.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:35:09.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:35:09.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:35:09.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:35:09.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:35:09.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:35:09.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:35:09.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:35:09.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:35:09.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:35:09.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:35:09.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:35:09.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:35:09.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:35:09.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:35:09.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:35:09.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:35:09.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:35:09.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:35:09.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:35:09.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:35:09.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:35:09.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:35:09.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:35:09.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:35:09.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:35:09.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:35:09.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:35:09.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:35:09.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:35:09.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:35:09.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:35:09.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:35:09.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:35:09.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:35:09.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:35:09.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:35:09.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:35:09.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:35:09.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:35:09.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:35:09.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:35:09.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:35:09.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:35:09.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:35:09.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:35:09.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:35:09.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:35:09.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:35:09.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:35:09.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:35:09.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:35:09.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:35:09.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:35:09.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:35:09.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:35:09.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:35:09.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:35:09.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:35:09.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:35:09.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:35:09.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:35:09.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:35:09.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:35:09.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:35:09.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:35:09.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:35:09.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:35:09.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:35:09.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:35:09.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:35:09.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:35:09.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:35:09.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:35:09.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:35:09.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:35:09.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:35:09.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:35:09.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:35:09.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:35:09.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:35:09.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:35:09.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:35:09.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:35:09.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:35:09.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:35:09.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:35:09.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:35:09.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:35:09.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:35:09.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:35:09.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:35:09.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:35:09.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:35:09.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:35:09.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:35:09.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:35:09.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:35:09.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:35:09.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:35:09.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:35:09.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:35:09.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:35:09.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:35:09.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:35:09.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:35:09.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:35:09.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:35:09.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:35:09.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:35:09.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:35:09.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:35:09.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:35:09.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:35:09.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:35:09.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:35:09.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:35:09.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:35:09.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:35:09.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:35:09.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:35:09.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:35:09.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:35:09.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:35:09.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:35:09.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:35:09.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:35:09.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:35:09.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:35:09.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:35:09.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:35:09.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:35:09.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:35:09.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:35:09.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:35:09.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:35:09.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:35:09.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:35:09.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:35:09.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:35:09.932 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:35:09.932 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:35:09.932 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:35:09.932 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:35:09.932 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:35:09.932 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:35:09.932 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:35:09.932 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:35:09.932 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:35:09.932 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:35:09.932 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:35:09.932 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:35:09.932 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:35:09.932 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:35:09.933 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:35:09.933 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:35:09.933 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:35:09.933 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:35:09.933 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:35:09.933 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:35:09.933 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:35:09.933 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:35:09.933 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:35:09.933 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:35:09.933 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:35:09.933 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:35:09.934 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:35:09.934 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:35:09.934 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:35:09.934 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:35:09.934 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:35:09.934 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:35:09.934 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:35:09.934 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:35:09.934 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:35:09.934 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:35:09.934 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:35:09.934 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:35:09.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:35:09.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:35:09.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:35:09.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:35:09.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:35:09.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:35:09.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:35:09.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:35:09.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:35:09.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:35:09.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:35:09.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:35:09.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:35:09.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:35:09.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:35:09.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:35:09.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:35:09.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:35:09.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:35:09.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:35:09.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:35:09.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:35:09.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:35:09.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:35:09.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:35:09.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:35:09.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:35:09.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:35:09.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:35:09.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:35:09.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:35:09.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:35:09.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:35:09.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:35:09.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:35:09.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:35:09.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:35:09.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:35:09.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:35:09.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:35:09.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:35:09.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:35:09.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:35:09.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:35:09.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:35:09.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:35:09.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:35:09.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:35:09.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:35:09.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:35:09.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:35:09.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:35:09.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:35:09.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:35:09.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:35:09.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:35:09.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:35:09.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:35:09.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:35:09.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:35:09.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:35:09.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:35:09.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:35:09.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:35:09.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:35:09.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:35:09.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:35:09.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:35:09.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:35:09.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:35:09.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:35:09.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:35:09.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:35:09.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:35:09.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:35:09.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:35:09.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:35:09.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:35:09.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:35:09.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:35:09.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:35:09.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:35:09.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:35:09.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:35:09.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:35:09.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:35:09.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:35:09.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:35:09.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:35:09.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:35:09.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:35:09.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:35:09.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:35:09.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:35:09.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:35:09.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:35:09.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:35:09.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:35:09.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:35:09.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:35:09.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:35:09.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:35:09.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:35:09.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:35:09.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:35:09.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:35:09.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:35:09.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:35:09.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:35:09.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:35:09.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:35:09.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:35:09.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:35:09.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:35:09.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:35:09.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:35:09.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:35:09.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:35:09.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:35:09.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:35:09.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:35:09.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:35:09.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:35:09.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:35:09.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:35:09.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:35:09.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:35:09.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:35:09.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:35:09.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:35:09.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:35:09.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:35:09.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:35:09.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:35:09.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:35:09.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:35:09.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:35:09.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:35:09.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:35:09.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:35:09.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:35:09.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:35:09.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:35:09.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:35:09.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:35:09.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:35:09.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:35:09.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:35:09.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:35:09.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:35:09.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:35:09.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:35:09.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:35:09.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:35:09.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:35:09.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:35:09.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:35:09.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:35:09.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:35:09.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:35:09.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:35:09.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:35:09.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:35:09.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:35:09.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:35:09.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:35:09.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:35:09.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:35:09.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:35:09.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:35:09.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:35:09.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:35:09.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:35:09.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:35:09.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:35:09.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:35:09.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:35:09.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:35:09.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:35:09.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:35:09.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:35:09.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:35:09.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:35:09.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:35:09.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:35:09.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:35:09.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:35:09.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:35:09.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:35:09.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:35:09.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:35:09.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:35:09.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:35:09.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:35:09.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:35:09.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:35:09.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:35:09.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:35:09.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:35:09.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:35:09.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:35:09.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:35:09.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:35:09.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:35:09.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:35:09.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:35:09.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:35:09.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:35:09.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:35:09.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:35:09.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:35:09.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:35:09.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:35:09.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:35:09.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:35:09.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:35:09.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:35:09.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:35:09.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:35:09.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:35:09.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:35:09.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:35:09.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:35:09.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:35:09.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:35:09.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:35:09.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:35:09.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:35:09.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:35:09.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:35:09.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:35:09.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:35:09.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:35:09.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:35:09.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:35:09.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:35:09.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:35:09.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:35:09.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:35:09.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:35:09.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:35:09.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:35:09.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:35:09.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:35:09.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:35:09.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:35:09.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:35:09.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:35:09.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:35:09.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:35:09.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:35:09.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:35:09.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:35:09.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:35:09.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:35:09.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:35:09.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:35:09.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:35:09.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:35:09.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:35:09.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:35:09.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:35:09.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:35:09.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:35:09.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:35:09.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:35:09.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:35:09.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:35:09.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:35:09.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:35:09.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:35:09.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:35:09.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:35:09.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:35:09.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:35:09.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:35:09.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:35:09.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:35:09.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:35:09.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:35:09.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:35:09.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:35:09.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:35:09.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:35:09.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:35:09.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:35:09.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:35:09.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:35:09.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:35:09.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:35:09.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:35:09.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:35:09.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:35:09.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:35:09.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:35:09.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:35:09.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:35:09.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:35:09.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:35:09.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:35:09.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:35:09.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:35:09.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:35:09.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:35:09.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:35:09.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:35:09.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:35:09.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:35:09.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:35:09.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:35:09.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:35:09.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:35:09.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:35:09.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:35:09.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:35:09.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:35:09.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:35:09.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:35:09.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:35:09.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:35:09.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:35:09.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:35:09.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:35:09.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:35:09.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:35:09.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:35:09.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:35:09.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:35:09.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:35:09.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:35:09.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:35:09.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:35:09.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:35:09.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:35:09.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:35:09.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:35:09.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:35:09.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:35:09.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:35:09.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:35:09.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:35:09.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:35:09.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:35:09.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:35:09.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:35:09.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:35:09.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:35:09.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:35:09.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:35:09.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:35:09.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:35:09.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:35:09.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:35:09.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:35:09.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:35:09.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:35:09.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:35:09.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:35:09.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:35:09.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:35:09.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:35:09.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:35:09.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:35:09.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:35:09.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:35:09.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:35:09.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:35:09.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:35:09.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:35:09.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:35:09.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:35:09.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:35:09.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:35:09.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:35:09.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:35:09.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:35:09.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:35:09.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:35:09.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:35:09.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:35:09.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:35:09.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:35:09.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:35:09.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:35:09.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:35:09.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:35:09.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:35:09.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:35:09.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:35:09.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:35:09.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:35:09.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:35:09.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:35:09.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:35:09.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:35:09.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:35:09.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:35:09.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:35:09.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:35:09.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:35:09.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:35:09.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:35:09.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:35:09.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:35:09.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:35:09.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:35:09.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:35:09.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:35:09.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:35:09.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:35:09.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:35:09.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:35:09.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:35:09.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:35:09.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:35:09.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:35:09.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:35:09.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:35:09.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:35:09.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:35:09.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:35:09.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:35:09.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:35:09.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:35:09.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:35:09.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:35:09.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:35:09.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:35:09.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:35:09.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:35:09.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:35:09.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:35:09.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:35:09.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:35:09.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:35:09.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:35:09.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:35:09.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:35:09.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:35:09.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:35:09.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:35:09.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:35:09.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:35:09.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:35:09.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:35:09.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:35:09.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:35:09.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:35:09.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:35:09.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:35:09.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:35:09.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:35:09.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:35:09.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:35:09.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:35:09.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:35:09.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:35:09.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:35:09.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:35:09.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:35:09.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:35:09.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:35:09.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:35:09.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:35:09.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:35:09.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:35:09.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:35:09.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:35:09.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:35:09.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:35:09.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:35:09.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:35:09.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:35:09.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:35:09.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:35:09.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:35:09.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:35:09.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:35:09.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:35:09.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:35:09.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:35:09.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:35:09.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:35:09.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:35:09.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:35:09.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:35:09.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:35:09.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:35:09.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:35:09.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:35:09.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:35:09.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:35:09.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:35:09.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:35:09.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:35:09.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:35:09.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:35:09.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:35:09.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:35:09.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:35:09.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:35:09.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:35:09.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:35:09.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:35:09.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:35:09.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:35:09.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:35:09.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:35:09.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:35:09.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:35:09.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:35:09.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:35:09.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:35:09.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:35:09.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:35:09.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:35:09.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:35:09.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:35:09.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:35:09.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:35:09.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:35:09.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:35:09.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:35:09.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:35:09.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:35:09.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:35:09.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:35:09.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:35:09.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:35:09.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:35:09.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:35:09.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:35:09.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:35:09.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:35:09.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:35:09.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:35:09.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:35:09.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:35:09.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:35:09.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:35:09.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:35:09.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:35:09.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:35:09.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:35:09.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:35:09.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:35:09.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:35:09.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:35:09.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:35:09.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:35:09.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:35:09.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:35:09.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:35:09.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:35:09.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:35:09.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:35:09.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:35:09.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:35:09.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:35:09.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:35:09.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:35:09.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:35:09.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:35:09.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:35:09.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:35:09.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:35:09.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:35:09.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:35:09.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:35:09.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:35:09.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:35:09.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:35:09.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:35:09.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:35:09.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:35:09.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:35:09.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:35:09.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:35:09.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:35:09.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:35:09.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:35:09.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:35:09.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:35:09.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:35:09.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:35:09.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:35:09.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:35:09.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:35:09.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:35:09.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:35:09.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:35:09.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:35:09.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:35:09.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:35:09.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:35:09.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:35:09.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:35:09.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:35:09.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:35:09.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:35:09.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:35:09.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:35:09.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:35:09.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:35:09.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:35:09.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:35:09.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:35:09.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:35:09.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:35:09.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:35:09.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:35:09.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:35:09.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:35:09.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:35:09.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:35:09.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:35:09.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:35:09.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:35:09.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:35:09.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:35:09.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:35:09.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:35:09.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:35:09.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:35:09.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:35:09.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:35:09.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:35:09.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:35:09.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:35:09.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:35:09.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:35:09.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:35:09.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:35:09.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:35:09.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:35:09.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:35:09.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:35:09.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:35:09.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:35:09.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:35:09.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:35:09.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:35:09.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:35:09.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:35:09.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:35:09.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:35:09.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:35:09.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:35:09.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:35:09.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:35:09.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:35:09.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:35:09.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:35:09.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:35:09.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:35:09.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:35:09.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:35:09.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:35:09.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:35:09.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:35:09.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:35:09.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:35:09.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:35:09.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:35:09.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:35:09.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:35:09.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:35:09.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:35:09.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:35:09.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:35:09.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:35:09.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:35:09.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:35:09.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:35:09.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:35:09.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:35:09.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:35:09.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:35:09.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:35:09.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:35:09.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:35:09.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:35:09.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:35:09.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:35:09.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:35:09.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:35:09.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:35:09.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:35:09.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:35:09.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:35:09.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:35:09.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:35:09.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:35:09.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:35:09.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:35:09.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:35:09.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:35:09.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:35:09.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:35:09.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:35:09.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:35:09.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:35:09.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:35:09.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:35:09.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:35:09.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:35:09.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:35:09.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:35:09.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:35:09.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:35:09.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:35:09.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:35:09.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:35:09.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:35:09.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:35:09.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:35:09.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:35:09.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:35:09.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:35:09.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:35:09.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:35:09.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:35:09.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:35:09.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:35:09.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:35:09.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:35:09.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:35:09.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:35:09.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:35:09.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:35:09.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:35:09.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:35:09.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:35:09.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:35:09.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:35:09.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:35:09.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:35:09.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:35:09.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:35:09.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:35:09.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:35:09.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:35:09.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:35:09.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:35:09.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:35:09.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:35:09.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:35:09.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:35:09.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:35:09.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:35:09.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:35:09.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:35:09.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:35:09.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:35:09.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:35:09.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:35:09.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:35:09.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:35:09.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:35:09.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:35:09.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:35:09.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:35:09.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:35:09.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:35:09.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:35:09.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:35:09.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:35:09.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:35:09.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:35:09.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:35:09.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:35:09.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:35:09.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:35:09.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:35:09.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:35:09.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:35:09.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:35:09.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:35:09.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:35:09.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:35:09.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:35:09.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:35:09.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:35:09.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:35:09.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:35:09.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:35:09.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:35:09.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:35:09.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:35:09.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:35:09.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:35:09.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:35:09.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:35:09.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:35:09.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:35:09.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:35:09.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:35:09.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:35:09.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:35:09.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:35:09.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:35:09.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:35:09.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:35:09.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:35:09.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:35:09.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:35:09.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:35:09.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:35:09.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:35:09.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:35:09.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:35:09.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:35:09.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:35:09.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:35:09.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:35:09.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:35:09.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:35:09.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:35:09.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:35:09.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:35:09.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:35:09.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:35:09.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:35:09.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:35:09.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:35:09.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:35:09.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:35:09.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:35:09.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:35:09.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:35:09.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:35:09.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:35:09.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:35:09.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:35:09.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:35:09.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:35:09.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:35:09.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:35:09.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:35:09.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:35:09.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:35:09.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:35:09.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:35:09.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:35:09.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:35:09.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:35:09.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:35:09.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:35:09.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:35:09.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:35:09.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:35:09.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:35:09.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:35:09.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:35:09.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:35:09.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:35:09.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:35:09.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:35:09.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:35:09.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:35:09.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:35:10.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:35:10.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:35:10.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:35:10.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:35:10.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:35:10.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:35:10.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:35:10.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:35:10.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:35:10.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:35:10.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:35:10.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:35:10.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:35:10.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:35:10.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:35:10.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:35:10.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:35:10.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:35:10.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:35:10.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:35:10.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:35:10.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:35:10.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:35:10.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:35:10.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:35:10.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:35:10.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:35:10.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:35:10.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:35:10.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:35:10.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:35:10.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:35:10.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:35:10.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:35:10.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:35:10.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:35:10.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:35:10.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:35:10.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:35:10.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:35:10.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:35:10.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:35:10.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:35:10.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:35:10.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:35:10.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:35:10.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:35:10.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:35:10.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:35:10.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:35:10.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:35:10.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:35:10.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:35:10.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:35:10.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:35:10.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:35:10.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:35:10.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:35:10.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:35:10.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:35:10.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:35:10.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:35:10.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:35:10.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:35:10.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:35:10.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:35:10.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:35:10.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:35:10.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:35:10.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:35:10.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:35:10.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:35:10.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:35:10.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:35:10.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:35:10.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:35:10.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:35:10.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:35:10.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:35:10.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:35:10.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:35:10.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:35:10.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:35:10.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:35:10.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:35:10.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:35:10.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:35:10.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:35:10.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:35:10.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:35:10.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:35:10.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:35:10.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:35:10.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:35:10.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:35:10.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:35:10.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:35:10.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:35:10.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:35:10.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:35:10.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:35:10.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:35:10.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:35:10.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:35:10.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:35:10.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:35:10.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:35:10.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:35:10.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:35:10.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:35:10.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:35:10.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:35:10.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:35:10.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:35:10.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:35:10.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:35:10.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:35:10.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:35:10.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:35:10.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:35:10.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:35:10.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:35:10.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:35:10.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:35:10.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:35:10.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:35:10.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:35:10.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:35:10.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:35:10.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:35:10.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:35:10.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:35:10.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:35:10.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:35:10.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:35:10.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:35:10.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:35:10.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:35:10.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:35:10.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:35:10.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:35:10.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:35:10.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:35:10.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:35:10.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:35:10.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:35:10.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:35:10.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:35:10.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:35:10.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:35:10.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:35:10.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:35:10.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:35:10.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:35:10.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:35:10.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:35:10.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:35:10.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:35:10.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:35:10.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:35:10.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:35:10.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:35:10.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:35:10.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:35:10.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:35:10.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:35:10.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:35:10.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:35:10.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:35:10.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:35:10.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:35:10.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:35:10.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:35:10.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:35:10.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:35:10.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:35:10.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:35:10.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:35:10.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:35:10.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:35:10.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:35:10.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:35:10.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:35:10.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:35:10.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:35:10.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:35:10.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:35:10.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:35:10.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:35:10.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:35:10.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:35:10.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:35:10.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:35:10.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:35:10.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:35:10.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:35:10.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:35:10.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:35:10.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:35:10.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:35:10.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:35:10.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:35:10.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:35:10.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:35:10.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:35:10.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:35:10.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:35:10.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:35:10.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:35:10.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:35:10.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:35:10.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:35:10.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:35:10.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:35:10.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:35:10.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:35:10.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:35:10.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:35:10.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:35:10.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:35:10.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:35:10.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:35:10.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:35:10.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:35:10.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:35:10.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:35:10.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:35:10.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:35:10.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:35:10.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:35:10.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:35:10.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:35:10.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:35:10.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:35:10.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:35:10.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:35:10.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:35:10.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:35:10.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:35:10.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:35:10.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:35:10.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:35:10.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:35:10.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:35:10.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:35:10.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:35:10.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:35:10.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:35:10.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:35:10.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:35:10.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:35:10.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:35:10.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:35:10.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:35:10.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:35:10.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:35:10.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:35:10.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:35:10.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:35:10.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:35:10.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:35:10.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:35:10.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:35:10.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:35:10.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:35:10.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:35:10.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:35:10.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:35:10.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:35:10.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:35:10.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:35:10.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:35:10.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:35:10.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:35:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:35:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:35:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:35:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:35:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:35:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:35:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:35:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:35:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:35:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:35:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:35:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:35:10.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:35:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:35:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:35:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:35:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:35:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:35:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:35:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:35:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:35:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:35:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:35:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:35:10.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:35:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:35:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:35:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:35:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:35:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:35:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:35:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:35:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:35:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:35:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:35:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:35:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:35:10.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:35:10.024 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:35:10.024 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:35:10.024 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:35:10.024 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:35:10.024 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:35:10.024 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:35:10.028 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:10.028 DEBUG:teuthology.orchestra.run.smithi100:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:35:10.051 INFO:teuthology.orchestra.run.smithi100.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:35:10.052 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:35:10.052 INFO:teuthology.orchestra.run.smithi100.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:35:10.052 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-08-17T02:35:10.052 INFO:teuthology.orchestra.run.smithi100.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:35:10.052 INFO:teuthology.orchestra.run.smithi100.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:35:10.052 INFO:teuthology.orchestra.run.smithi100.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:35:10.052 INFO:teuthology.orchestra.run.smithi100.stdout: fi 2024-08-17T02:35:10.052 INFO:teuthology.orchestra.run.smithi100.stdout:done 2024-08-17T02:35:10.052 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:35:10.052 INFO:teuthology.orchestra.run.smithi100.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:35:10.052 INFO:teuthology.orchestra.run.smithi100.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:35:10.052 INFO:teuthology.orchestra.run.smithi100.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:35:10.053 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-08-17T02:35:10.053 INFO:teuthology.orchestra.run.smithi100.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:35:10.053 INFO:teuthology.orchestra.run.smithi100.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:10.053 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-08-17T02:35:10.053 INFO:teuthology.orchestra.run.smithi100.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:35:10.053 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:35:10.053 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:10.053 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-08-17T02:35:10.054 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -qi grub2-tools 2024-08-17T02:35:10.126 INFO:teuthology.orchestra.run.smithi100.stdout:Name : grub2-tools 2024-08-17T02:35:10.126 INFO:teuthology.orchestra.run.smithi100.stdout:Epoch : 1 2024-08-17T02:35:10.126 INFO:teuthology.orchestra.run.smithi100.stdout:Version : 2.06 2024-08-17T02:35:10.126 INFO:teuthology.orchestra.run.smithi100.stdout:Release : 68.el9 2024-08-17T02:35:10.126 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: x86_64 2024-08-17T02:35:10.126 INFO:teuthology.orchestra.run.smithi100.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:35:10.127 INFO:teuthology.orchestra.run.smithi100.stdout:Group : Unspecified 2024-08-17T02:35:10.127 INFO:teuthology.orchestra.run.smithi100.stdout:Size : 8264254 2024-08-17T02:35:10.127 INFO:teuthology.orchestra.run.smithi100.stdout:License : GPLv3+ 2024-08-17T02:35:10.127 INFO:teuthology.orchestra.run.smithi100.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:35:10.127 INFO:teuthology.orchestra.run.smithi100.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:35:10.127 INFO:teuthology.orchestra.run.smithi100.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:35:10.127 INFO:teuthology.orchestra.run.smithi100.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:35:10.127 INFO:teuthology.orchestra.run.smithi100.stdout:Packager : builder@centos.org 2024-08-17T02:35:10.127 INFO:teuthology.orchestra.run.smithi100.stdout:Vendor : CentOS 2024-08-17T02:35:10.127 INFO:teuthology.orchestra.run.smithi100.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:35:10.127 INFO:teuthology.orchestra.run.smithi100.stdout:Summary : Support tools for GRUB. 2024-08-17T02:35:10.127 INFO:teuthology.orchestra.run.smithi100.stdout:Description : 2024-08-17T02:35:10.127 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:35:10.128 INFO:teuthology.orchestra.run.smithi100.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:35:10.128 INFO:teuthology.orchestra.run.smithi100.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:35:10.128 INFO:teuthology.orchestra.run.smithi100.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:35:10.128 INFO:teuthology.orchestra.run.smithi100.stdout:hardware devices. 2024-08-17T02:35:10.128 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:35:10.128 INFO:teuthology.orchestra.run.smithi100.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:35:10.129 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:35:10.129 INFO:teuthology.task.kernel:Updating grub on smithi100 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:10.129 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:35:10.662 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2024-08-17T02:35:11.965 INFO:teuthology.orchestra.run.smithi100.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:35:11.993 INFO:teuthology.orchestra.run.smithi100.stderr:done 2024-08-17T02:35:11.996 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-08-17T02:35:12.017 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.dlpX93MNlu 2024-08-17T02:35:12.017 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dlpX93MNlu 2024-08-17T02:35:12.092 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.dlpX93MNlu 2024-08-17T02:35:12.223 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.dlpX93MNlu is 6KB 2024-08-17T02:35:12.272 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.dlpX93MNlu 2024-08-17T02:35:12.286 DEBUG:teuthology.orchestra.run.smithi100:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:35:12.347 INFO:teuthology.orchestra.run.smithi100.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:35:12.347 INFO:teuthology.orchestra.run.smithi100.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:35:12.348 INFO:teuthology.orchestra.run.smithi100.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:35:12.348 INFO:teuthology.orchestra.run.smithi100.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:35:12.349 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:12.496 DEBUG:teuthology.orchestra.run.smithi100:> sudo shutdown -r now 2024-08-17T02:35:31.784 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi123.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:35:31.784 DEBUG:teuthology.orchestra.run.smithi123:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:35:31.868 INFO:teuthology.orchestra.run.smithi123.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:31.868 INFO:teuthology.orchestra.run.smithi123.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:31.868 INFO:teuthology.orchestra.run.smithi123.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:31.868 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:31.868 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:35:31.868 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:35:31.868 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:35:31.868 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:35:31.868 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:35:31.869 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:35:31.869 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:35:31.869 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:35:31.869 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:35:31.869 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:35:31.869 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:35:31.869 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:35:31.869 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:35:31.869 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:35:31.869 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:35:31.870 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:35:31.870 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:35:31.870 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:35:31.870 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:35:31.870 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:35:31.870 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:35:31.870 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:35:31.870 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:35:31.870 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:35:31.870 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:35:31.870 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:35:31.871 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:35:31.871 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:35:31.871 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:35:31.871 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:35:31.871 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:35:31.871 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:35:31.871 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:35:31.871 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:35:31.871 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:35:31.871 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:35:31.871 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:35:31.872 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:35:31.872 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:35:31.872 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:35:31.872 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:35:31.872 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:35:31.872 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:35:31.872 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:35:31.872 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:35:31.872 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:35:31.872 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:35:31.872 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:35:31.873 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:35:31.873 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:35:31.873 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:35:31.873 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:35:31.873 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:35:31.873 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:35:31.873 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:35:31.873 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:35:31.873 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:35:31.873 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:35:31.873 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:35:31.873 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:35:31.874 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:35:31.874 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:35:31.874 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:35:31.874 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:35:31.874 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:35:31.874 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:35:31.874 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:35:31.874 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:35:31.874 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:35:31.874 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:35:31.874 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:35:31.875 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:35:31.875 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:35:31.875 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:35:31.875 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:35:31.875 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:35:31.875 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:35:31.875 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:35:31.875 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:35:31.875 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:35:31.875 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:35:31.875 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:35:31.875 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:35:31.875 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:35:31.876 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:35:31.876 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:35:31.876 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:35:31.876 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:35:31.876 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:35:31.876 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:35:31.876 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:35:31.876 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:35:31.876 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:35:31.876 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:35:31.876 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:35:31.877 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:35:31.877 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:35:31.877 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:35:31.877 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:35:31.877 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:35:31.877 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:35:31.877 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:35:31.877 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:35:31.877 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:35:31.877 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:35:31.877 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:35:31.878 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:35:31.878 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:35:31.878 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:35:31.878 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:35:31.878 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:35:31.878 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:35:31.878 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:35:31.878 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:35:31.878 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:35:31.878 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:35:31.878 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:35:31.879 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:35:31.879 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:35:31.879 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:35:31.879 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:35:31.879 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:35:31.879 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:35:31.879 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:35:31.880 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:35:31.880 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:35:31.880 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:35:31.880 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:35:31.880 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:35:31.880 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:35:31.880 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:35:31.880 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:35:31.880 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:35:31.880 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:35:31.880 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:35:31.880 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:35:31.881 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:35:31.881 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:35:31.881 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:35:31.881 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:35:31.881 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:35:31.881 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:35:31.881 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:35:31.881 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:35:31.881 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:35:31.881 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:35:31.881 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:35:31.882 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:35:31.882 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:35:31.882 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:35:31.882 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:35:31.882 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:35:31.882 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:35:31.882 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:35:31.882 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:35:31.882 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:35:31.882 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:35:31.882 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:35:31.882 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:35:31.883 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:35:31.883 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:35:31.883 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:35:31.883 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:35:31.883 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:35:31.883 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:35:31.883 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:35:31.883 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:35:31.883 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:35:31.883 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:35:31.883 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:35:31.883 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:35:31.884 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:35:31.884 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:35:31.884 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:35:31.884 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:35:31.884 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:35:31.884 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:35:31.884 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:35:31.884 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:35:31.884 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:35:31.884 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:35:31.884 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:35:31.884 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:35:31.884 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:35:31.885 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:35:31.885 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:35:31.885 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:35:31.885 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:35:31.885 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:35:31.885 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:35:31.885 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:35:31.885 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:35:31.885 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:35:31.885 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:35:31.885 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:35:31.886 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:35:31.886 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:35:31.886 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:35:31.886 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:35:31.886 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:35:31.886 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:35:31.886 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:35:31.886 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:35:31.886 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:35:31.886 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:35:31.886 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:35:31.886 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:35:31.887 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:35:31.887 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:35:31.887 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:35:31.887 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:35:31.887 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:35:31.887 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:35:31.887 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:35:31.887 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:35:31.887 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:35:31.887 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:35:31.887 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:35:31.888 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:35:31.888 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:35:31.888 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:35:31.888 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:35:31.888 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:35:31.888 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:35:31.888 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:35:31.888 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:35:31.888 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:35:31.888 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:35:31.888 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:35:31.888 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:35:31.889 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:35:31.889 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:35:31.889 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:35:31.889 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:35:31.889 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:35:31.889 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:35:31.889 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:35:31.889 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:35:31.889 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:35:31.889 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:35:31.889 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:35:31.890 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:35:31.890 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:35:31.890 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:35:31.890 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:35:31.890 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:35:31.890 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:35:31.890 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:35:31.890 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:35:31.890 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:35:31.890 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:35:31.890 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:35:31.891 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:35:31.891 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:35:31.891 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:35:31.891 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:35:31.891 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:35:31.891 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:35:31.891 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:35:31.891 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:35:31.891 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:35:31.891 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:35:31.891 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:35:31.891 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:35:31.892 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:35:31.892 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:35:31.892 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:35:31.892 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:35:31.892 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:35:31.892 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:35:31.892 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:35:31.892 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:35:31.892 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:35:31.892 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:35:31.893 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:35:31.893 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:35:31.893 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:35:31.893 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:35:31.893 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:35:31.893 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:35:31.893 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:35:31.893 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:35:31.893 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:35:31.893 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:35:31.893 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:35:31.893 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:35:31.893 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:35:31.894 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:35:31.894 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:35:31.894 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:35:31.894 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:35:31.894 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:35:31.894 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:35:31.894 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:35:31.894 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:35:31.894 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:35:31.894 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:35:31.894 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:35:31.894 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:35:31.895 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:35:31.895 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:35:31.895 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:35:31.895 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:35:31.895 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:35:31.895 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:35:31.895 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:35:31.895 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:35:31.895 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:35:31.895 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:35:31.895 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:35:31.895 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:35:31.895 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:35:31.896 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:35:31.896 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:35:31.896 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:35:31.896 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:35:31.896 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:35:31.896 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:35:31.896 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:35:31.896 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:35:31.896 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:35:31.896 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:35:31.896 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:35:31.896 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:35:31.896 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:35:31.897 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:35:31.897 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:35:31.897 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:35:31.897 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:35:31.897 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:35:31.897 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:35:31.897 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:35:31.897 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:35:31.897 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:35:31.897 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:35:31.897 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:35:31.897 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:35:31.897 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:35:31.898 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:35:31.898 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:35:31.898 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:35:31.898 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:35:31.898 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:35:31.898 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:35:31.898 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:35:31.898 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:35:31.898 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:35:31.898 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:35:31.898 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:35:31.899 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:35:31.899 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:35:31.899 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:35:31.899 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:35:31.899 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:35:31.899 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:35:31.899 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:35:31.899 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:35:31.899 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:35:31.899 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:35:31.899 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:35:31.899 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:35:31.900 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:35:31.900 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:35:31.900 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:35:31.900 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:35:31.900 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:35:31.900 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:35:31.900 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:35:31.900 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:35:31.900 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:35:31.900 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:35:31.900 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:35:31.900 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:35:31.900 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:35:31.901 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:35:31.901 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:35:31.901 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:35:31.901 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:35:31.901 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:35:31.901 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:35:31.901 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:35:31.901 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:35:31.901 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:35:31.901 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:35:31.901 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:35:31.901 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:35:31.902 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:35:31.902 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:35:31.902 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:35:31.902 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:35:31.902 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:35:31.902 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:35:31.902 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:35:31.902 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:35:31.902 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:35:31.902 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:35:31.902 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:35:31.902 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:35:31.902 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:35:31.903 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:35:31.903 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:35:31.903 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:35:31.903 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:35:31.903 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:35:31.903 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:35:31.903 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:35:31.903 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:35:31.903 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:35:31.903 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:35:31.903 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:35:31.903 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:35:31.904 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:35:31.904 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:35:31.904 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:35:31.904 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:35:31.904 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:35:31.904 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:35:31.904 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:35:31.904 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:35:31.904 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:35:31.904 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:35:31.904 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:35:31.904 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:35:31.905 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:35:31.905 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:35:31.905 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:35:31.905 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:35:31.905 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:35:31.905 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:35:31.905 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:35:31.905 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:35:31.905 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:35:31.905 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:35:31.905 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:35:31.905 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:35:31.906 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:35:31.906 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:35:31.906 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:35:31.906 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:35:31.906 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:35:31.906 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:35:31.906 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:35:31.906 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:35:31.906 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:35:31.906 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:35:31.906 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:35:31.907 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:35:31.907 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:35:31.907 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:35:31.907 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:35:31.907 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:35:31.907 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:35:31.907 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:35:31.907 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:35:31.907 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:35:31.907 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:35:31.907 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:35:31.907 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:35:31.908 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:35:31.908 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:35:31.908 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:35:31.908 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:35:31.908 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:35:31.908 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:35:31.908 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:35:31.908 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:35:31.908 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:35:31.908 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:35:31.908 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:35:31.908 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:35:31.909 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:35:31.909 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:35:31.909 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:35:31.909 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:35:31.909 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:35:31.909 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:35:31.909 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:35:31.909 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:35:31.909 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:35:31.909 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:35:31.909 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:35:31.909 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:35:31.910 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:35:31.910 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:35:31.910 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:35:31.910 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:35:31.910 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:35:31.910 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:35:31.910 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:35:31.910 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:35:31.910 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:35:31.910 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:35:31.910 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:35:31.910 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:35:31.911 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:35:31.911 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:35:31.911 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:35:31.911 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:35:31.911 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:35:31.911 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:35:31.911 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:35:31.911 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:35:31.911 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:35:31.911 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:35:31.911 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:35:31.911 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:35:31.912 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:35:31.912 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:35:31.912 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:35:31.912 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:35:31.912 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:35:31.912 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:35:31.912 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:35:31.912 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:35:31.912 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:35:31.912 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:35:31.912 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:35:31.912 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:35:31.912 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:35:31.913 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:35:31.913 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:35:31.913 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:35:31.913 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:35:31.913 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:35:31.913 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:35:31.913 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:35:31.913 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:35:31.913 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:35:31.913 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:35:31.913 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:35:31.913 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:35:31.914 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:35:31.914 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:35:31.914 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:35:31.914 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:35:31.914 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:35:31.914 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:35:31.914 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:35:31.914 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:35:31.914 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:35:31.914 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:35:31.914 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:35:31.914 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:35:31.915 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:35:31.915 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:35:31.915 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:35:31.915 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:35:31.915 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:35:31.915 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:35:31.915 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:35:31.915 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:35:31.915 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:35:31.915 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:35:31.915 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:35:31.915 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:35:31.915 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:35:31.916 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:35:31.916 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:35:31.916 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:35:31.916 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:35:31.916 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:35:31.916 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:35:31.916 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:35:31.916 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:35:31.916 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:35:31.916 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:35:31.917 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:35:31.918 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:35:31.918 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:35:31.918 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:35:31.918 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:35:31.918 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:35:31.918 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:35:31.918 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:35:31.918 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:35:31.918 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:35:31.919 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:35:31.919 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:35:31.919 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:35:31.919 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:35:31.919 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:35:31.919 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:35:31.919 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:35:31.919 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:35:31.919 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:35:31.920 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:35:31.920 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:35:31.920 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:35:31.920 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:35:31.920 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:35:31.920 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:35:31.920 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:35:31.920 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:35:31.920 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:35:31.920 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:35:31.920 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:35:31.920 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:35:31.921 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:35:31.921 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:35:31.921 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:35:31.921 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:35:31.921 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:35:31.921 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:35:31.921 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:35:31.921 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:35:31.921 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:35:31.921 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:35:31.921 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:35:31.921 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:35:31.921 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:35:31.921 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:35:31.922 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:35:31.922 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:35:31.922 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:35:31.922 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:35:31.922 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:35:31.922 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:35:31.922 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:35:31.922 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:35:31.922 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:35:31.922 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:35:31.923 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:35:31.923 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:35:31.923 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:35:31.923 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:35:31.923 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:35:31.923 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:35:31.923 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:35:31.923 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:35:31.923 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:35:31.923 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:35:31.923 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:35:31.923 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:35:31.923 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:35:31.923 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:35:31.924 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:35:31.924 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:35:31.924 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:35:31.924 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:35:31.924 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:35:31.924 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:35:31.924 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:35:31.924 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:35:31.924 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:35:31.924 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:35:31.924 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:35:31.925 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:35:31.925 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:35:31.925 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:35:31.925 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:35:31.925 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:35:31.925 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:35:31.925 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:35:31.925 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:35:31.925 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:35:31.925 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:35:31.925 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:35:31.925 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:35:31.925 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:35:31.925 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:35:31.926 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:35:31.926 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:35:31.926 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:35:31.926 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:35:31.926 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:35:31.926 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:35:31.926 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:35:31.926 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:35:31.926 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:35:31.926 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:35:31.926 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:35:31.926 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:35:31.927 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:35:31.927 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:35:31.927 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:35:31.927 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:35:31.927 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:35:31.927 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:35:31.927 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:35:31.927 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:35:31.927 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:35:31.927 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:35:31.927 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:35:31.927 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:35:31.927 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:35:31.927 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:35:31.928 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:35:31.928 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:35:31.928 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:35:31.928 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:35:31.928 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:35:31.928 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:35:31.928 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:35:31.928 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:35:31.928 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:35:31.928 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:35:31.928 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:35:31.928 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:35:31.929 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:35:31.929 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:35:31.929 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:35:31.929 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:35:31.929 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:35:31.929 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:35:31.929 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:35:31.929 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:35:31.929 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:35:31.929 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:35:31.929 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:35:31.929 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:35:31.929 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:35:31.930 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:35:31.930 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:35:31.930 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:35:31.930 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:35:31.930 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:35:31.930 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:35:31.930 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:35:31.930 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:35:31.930 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:35:31.930 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:35:31.930 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:35:31.930 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:35:31.930 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:35:31.931 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:35:31.931 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:35:31.931 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:35:31.931 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:35:31.931 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:35:31.931 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:35:31.931 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:35:31.931 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:35:31.931 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:35:31.931 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:35:31.931 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:35:31.931 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:35:31.931 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:35:31.932 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:35:31.932 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:35:31.932 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:35:31.932 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:35:31.932 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:35:31.932 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:35:31.932 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:35:31.932 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:35:31.932 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:35:31.932 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:35:31.932 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:35:31.932 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:35:31.932 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:35:31.933 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:35:31.933 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:35:31.933 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:35:31.933 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:35:31.933 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:35:31.933 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:35:31.933 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:35:31.933 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:35:31.933 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:35:31.933 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:35:31.933 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:35:31.933 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:35:31.934 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:35:31.934 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:35:31.934 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:35:31.934 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:35:31.934 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:35:31.934 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:35:31.934 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:35:31.934 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:35:31.934 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:35:31.935 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:35:31.935 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:35:31.935 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:35:31.935 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:35:31.935 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:35:31.935 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:35:31.935 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:35:31.935 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:35:31.935 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:35:31.936 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:35:31.936 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:35:31.936 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:35:31.936 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:35:31.936 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:35:31.936 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:35:31.936 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:35:31.936 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:35:31.936 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:35:31.936 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:35:31.936 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:35:31.936 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:35:31.936 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:35:31.937 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:35:31.937 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:35:31.937 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:35:31.937 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:35:31.937 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:35:31.937 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:35:31.937 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:35:31.937 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:35:31.937 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:35:31.937 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:35:31.937 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:35:31.937 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:35:31.937 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:35:31.937 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:35:31.938 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:35:31.938 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:35:31.938 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:35:31.938 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:35:31.938 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:35:31.938 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:35:31.938 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:35:31.938 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:35:31.938 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:35:31.938 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:35:31.938 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:35:31.938 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:35:31.939 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:35:31.939 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:35:31.939 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:35:31.939 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:35:31.939 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:35:31.939 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:35:31.939 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:35:31.939 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:35:31.939 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:35:31.939 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:35:31.939 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:35:31.939 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:35:31.940 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:35:31.940 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:35:31.940 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:35:31.940 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:35:31.940 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:35:31.940 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:35:31.940 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:35:31.940 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:35:31.940 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:35:31.940 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:35:31.940 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:35:31.940 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:35:31.940 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:35:31.941 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:35:31.941 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:35:31.941 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:35:31.941 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:35:31.941 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:35:31.941 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:35:31.941 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:35:31.941 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:35:31.941 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:35:31.941 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:35:31.941 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:35:31.941 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:35:31.941 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:35:31.941 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:35:31.942 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:35:31.942 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:35:31.942 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:35:31.942 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:35:31.942 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:35:31.942 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:35:31.942 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:35:31.942 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:35:31.942 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:35:31.942 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:35:31.942 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:35:31.942 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:35:31.943 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:35:31.943 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:35:31.943 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:35:31.943 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:35:31.943 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:35:31.943 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:35:31.943 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:35:31.943 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:35:31.943 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:35:31.943 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:35:31.943 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:35:31.943 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:35:31.943 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:35:31.943 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:35:31.944 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:35:31.944 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:35:31.944 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:35:31.944 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:35:31.944 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:35:31.944 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:35:31.944 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:35:31.945 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:35:31.945 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:35:31.945 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:35:31.945 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:35:31.945 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:35:31.945 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:35:31.945 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:35:31.945 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:35:31.945 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:35:31.945 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:35:31.945 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:35:31.945 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:35:31.945 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:35:31.945 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:35:31.946 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:35:31.946 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:35:31.946 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:35:31.946 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:35:31.946 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:35:31.946 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:35:31.946 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:35:31.946 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:35:31.946 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:35:31.946 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:35:31.946 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:35:31.946 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:35:31.947 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:35:31.947 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:35:31.947 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:35:31.947 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:35:31.947 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:35:31.947 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:35:31.947 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:35:31.947 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:35:31.947 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:35:31.947 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:35:31.947 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:35:31.947 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:35:31.947 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:35:31.948 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:35:31.948 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:35:31.948 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:35:31.948 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:35:31.948 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:35:31.948 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:35:31.948 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:35:31.948 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:35:31.948 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:35:31.948 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:35:31.948 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:35:31.948 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:35:31.948 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:35:31.948 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:35:31.949 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:35:31.949 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:35:31.949 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:35:31.949 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:35:31.949 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:35:31.949 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:35:31.949 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:35:31.949 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:35:31.949 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:35:31.949 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:35:31.949 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:35:31.950 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:35:31.950 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:35:31.950 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:35:31.950 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:35:31.950 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:35:31.950 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:35:31.950 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:35:31.950 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:35:31.950 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:35:31.950 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:35:31.950 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:35:31.950 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:35:31.950 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:35:31.951 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:35:31.951 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:35:31.951 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:35:31.951 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:35:31.951 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:35:31.951 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:35:31.951 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:35:31.951 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:35:31.951 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:35:31.951 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:35:31.951 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:35:31.952 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:35:31.952 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:35:31.952 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:35:31.952 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:35:31.952 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:35:31.952 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:35:31.952 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:35:31.952 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:35:31.952 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:35:31.952 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:35:31.952 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:35:31.952 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:35:31.952 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:35:31.952 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:35:31.953 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:35:31.953 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:35:31.953 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:35:31.953 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:35:31.953 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:35:31.953 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:35:31.953 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:35:31.953 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:35:31.953 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:35:31.953 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:35:31.953 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:35:31.953 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:35:31.953 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:35:31.953 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:35:31.954 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:35:31.954 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:35:31.954 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:35:31.954 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:35:31.954 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:35:31.954 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:35:31.954 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:35:31.955 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:35:31.955 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:35:31.955 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:35:31.955 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:35:31.955 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:35:31.955 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:35:31.955 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:35:31.955 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:35:31.956 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:35:31.956 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:35:31.956 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:35:31.956 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:35:31.956 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:35:31.956 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:35:31.956 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:35:31.956 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:35:31.956 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:35:31.957 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:35:31.957 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:35:31.957 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:35:31.957 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:35:31.957 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:35:31.957 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:35:31.957 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:35:31.957 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:35:31.957 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:35:31.957 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:35:31.957 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:35:31.957 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:35:31.958 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:35:31.958 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:35:31.958 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:35:31.958 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:35:31.958 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:35:31.958 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:35:31.958 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:35:31.958 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:35:31.958 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:35:31.958 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:35:31.959 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:35:31.959 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:35:31.959 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:35:31.959 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:35:31.959 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:35:31.959 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:35:31.959 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:35:31.959 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:35:31.959 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:35:31.959 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:35:31.959 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:35:31.960 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:35:31.960 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:35:31.960 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:35:31.960 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:35:31.960 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:35:31.960 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:35:31.960 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:35:31.960 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:35:31.960 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:35:31.960 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:35:31.961 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:35:31.961 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:35:31.961 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:35:31.961 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:35:31.961 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:35:31.961 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:35:31.961 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:35:31.961 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:35:31.961 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:35:31.961 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:35:31.961 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:35:31.961 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:35:31.962 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:35:31.962 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:35:31.962 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:35:31.962 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:35:31.962 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:35:31.962 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:35:31.962 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:35:31.962 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:35:31.962 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:35:31.962 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:35:31.962 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:35:31.962 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:35:31.963 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:35:31.963 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:35:31.963 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:35:31.963 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:35:31.963 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:35:31.963 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:35:31.963 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:35:31.963 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:35:31.963 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:35:31.963 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:35:31.963 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:35:31.964 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:35:31.964 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:35:31.964 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:35:31.964 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:35:31.964 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:35:31.964 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:35:31.964 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:35:31.964 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:35:31.964 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:35:31.964 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:35:31.964 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:35:31.965 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:35:31.965 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:35:31.965 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:35:31.965 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:35:31.965 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:35:31.965 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:35:31.965 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:35:31.965 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:35:31.965 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:35:31.965 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:35:31.965 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:35:31.966 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:35:31.966 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:35:31.966 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:35:31.966 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:35:31.966 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:35:31.966 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:35:31.966 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:35:31.966 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:35:31.966 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:35:31.966 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:35:31.966 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:35:31.966 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:35:31.966 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:35:31.967 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:35:31.967 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:35:31.967 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:35:31.967 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:35:31.967 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:35:31.967 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:35:31.967 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:35:31.967 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:35:31.967 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:35:31.967 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:35:31.967 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:35:31.967 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:35:31.967 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:35:31.968 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:35:31.968 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:35:31.968 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:35:31.968 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:35:31.968 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:35:31.968 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:35:31.968 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:35:31.968 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:35:31.968 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:35:31.968 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:35:31.968 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:35:31.968 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:35:31.968 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:35:31.969 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:35:31.969 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:35:31.969 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:35:31.969 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:35:31.969 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:35:31.969 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:35:31.969 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:35:31.969 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:35:31.969 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:35:31.969 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:35:31.969 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:35:31.970 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:35:31.970 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:35:31.970 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:35:31.970 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:35:31.970 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:35:31.970 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:35:31.970 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:35:31.970 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:35:31.970 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:35:31.970 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:35:31.970 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:35:31.970 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:35:31.970 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:35:31.971 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:35:31.971 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:35:31.971 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:35:31.971 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:35:31.971 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:35:31.971 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:35:31.971 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:35:31.971 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:35:31.971 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:35:31.971 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:35:31.972 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:35:31.972 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:35:31.972 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:35:31.972 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:35:31.972 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:35:31.972 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:35:31.972 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:35:31.972 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:35:31.972 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:35:31.972 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:35:31.972 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:35:31.972 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:35:31.972 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:35:31.972 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:35:31.973 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:35:31.973 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:35:31.973 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:35:31.973 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:35:31.973 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:35:31.973 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:35:31.973 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:35:31.973 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:35:31.973 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:35:31.973 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:35:31.973 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:35:31.974 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:35:31.974 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:35:31.974 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:35:31.974 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:35:31.974 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:35:31.974 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:35:31.974 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:35:31.974 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:35:31.974 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:35:31.974 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:35:31.974 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:35:31.974 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:35:31.974 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:35:31.975 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:35:31.975 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:35:31.975 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:35:31.975 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:35:31.975 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:35:31.975 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:35:31.975 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:35:31.976 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:35:31.976 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:35:31.976 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:35:31.976 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:35:31.976 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:35:31.977 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:35:31.977 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:35:31.977 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:35:31.977 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:35:31.977 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:35:31.977 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:35:31.978 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:35:31.978 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:35:31.978 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:35:31.978 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:35:31.978 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:35:31.979 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:35:31.979 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:35:31.979 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:35:31.979 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:35:31.980 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:35:31.980 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:35:31.980 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:35:31.980 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:35:31.980 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:35:31.980 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:35:31.981 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:35:31.981 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:35:31.981 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:35:31.981 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:35:31.981 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:35:31.981 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:35:31.982 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:35:31.982 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:35:31.982 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:35:31.982 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:35:31.982 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:35:31.982 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:35:31.982 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:35:31.982 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:35:31.983 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:35:31.983 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:35:31.983 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:35:31.983 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:35:31.983 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:35:31.983 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:35:31.983 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:35:31.983 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:35:31.983 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:35:31.983 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:35:31.983 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:35:31.983 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:35:31.984 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:35:31.984 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:35:31.984 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:35:31.984 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:35:31.984 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:35:31.984 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:35:31.984 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:35:31.984 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:35:31.984 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:35:31.984 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:35:31.984 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:35:31.985 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:35:31.985 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:35:31.985 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:35:31.985 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:35:31.985 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:35:31.985 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:35:31.985 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:35:31.985 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:35:31.985 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:35:31.985 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:35:31.985 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:35:31.985 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:35:31.986 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:35:31.986 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:35:31.986 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:35:31.986 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:35:31.986 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:35:31.986 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:35:31.986 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:35:31.986 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:35:31.986 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:35:31.986 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:35:31.986 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:35:31.986 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:35:31.986 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:35:31.987 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:35:31.987 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:35:31.987 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:35:31.987 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:35:31.987 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:35:31.987 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:35:31.987 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:35:31.987 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:35:31.987 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:35:31.987 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:35:31.987 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:35:31.987 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:35:31.987 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:35:31.988 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:35:31.988 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:35:31.988 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:35:31.988 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:35:31.988 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:35:31.988 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:35:31.988 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:35:31.988 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:35:31.988 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:35:31.988 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:35:31.988 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:35:31.988 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:35:31.988 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:35:31.988 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:35:31.989 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:35:31.989 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:35:31.989 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:35:31.989 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:35:31.989 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:35:31.989 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:35:31.989 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:35:31.989 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:35:31.989 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:35:31.989 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:35:31.989 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:35:31.989 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:35:31.989 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:35:31.990 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:35:31.990 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:35:31.990 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:35:31.990 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:35:31.990 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:35:31.990 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:35:31.990 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:35:31.990 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:35:31.990 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:35:31.990 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:35:31.990 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:35:31.990 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:35:31.990 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:35:31.991 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:35:31.991 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:35:31.991 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:35:31.991 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:35:31.991 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:35:31.991 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:35:31.991 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:35:31.991 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:35:31.991 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:35:31.991 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:35:31.991 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:35:31.991 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:35:31.991 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:35:31.991 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:35:31.991 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:35:31.992 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:35:31.992 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:35:31.992 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:35:31.992 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:35:31.992 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:35:31.992 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:35:31.992 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:35:31.992 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:35:31.992 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:35:31.992 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:35:31.992 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:35:31.992 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:35:31.992 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:35:31.992 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:35:31.993 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:35:31.993 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:35:31.993 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:35:31.993 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:35:31.993 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:35:31.993 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:35:31.993 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:35:31.993 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:35:31.993 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:35:31.993 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:35:31.993 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:35:31.993 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:35:31.993 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:35:31.993 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:35:31.994 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:35:31.994 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:35:31.994 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:35:31.994 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:35:31.994 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:35:31.994 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:35:31.994 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:35:31.994 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:35:31.994 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:35:31.994 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:35:31.995 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:35:31.995 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:35:31.995 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:35:31.995 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:35:31.995 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:35:31.995 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:35:31.995 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:35:31.995 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:35:31.995 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:35:31.995 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:35:31.995 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:35:31.995 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:35:31.995 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:35:31.995 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:35:31.996 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:35:31.996 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:35:31.996 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:35:31.996 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:35:31.996 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:35:31.996 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:35:31.996 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:35:31.996 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:35:31.996 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:35:31.996 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:35:31.996 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:35:31.996 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:35:31.996 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:35:31.996 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:35:31.997 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:35:31.997 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:35:31.997 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:35:31.997 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:35:31.997 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:35:31.997 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:35:31.997 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:35:31.997 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:35:31.997 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:35:31.997 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:35:31.997 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:35:31.997 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:35:31.997 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:35:31.997 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:35:31.998 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:35:31.998 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:35:31.998 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:35:31.998 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:35:31.998 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:35:31.998 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:35:31.998 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:35:31.998 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:35:31.998 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:35:31.998 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:35:31.998 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:35:31.998 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:35:31.998 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:35:31.998 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:35:31.999 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:35:31.999 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:35:31.999 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:35:31.999 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:35:31.999 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:35:31.999 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:35:31.999 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:35:31.999 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:35:31.999 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:35:31.999 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:35:31.999 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:35:31.999 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:35:31.999 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:35:32.000 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:35:32.000 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:35:32.000 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:35:32.000 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:35:32.000 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:35:32.000 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:35:32.000 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:35:32.000 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:35:32.000 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:35:32.000 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:35:32.001 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:35:32.001 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:35:32.001 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:35:32.001 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:35:32.001 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:35:32.001 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:35:32.001 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:35:32.001 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:35:32.001 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:35:32.001 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:35:32.001 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:35:32.001 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:35:32.001 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:35:32.001 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:35:32.002 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:35:32.002 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:35:32.002 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:35:32.002 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:35:32.002 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:35:32.002 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:35:32.002 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:35:32.002 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:35:32.002 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:35:32.002 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:35:32.002 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:35:32.002 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:35:32.002 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:35:32.003 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:35:32.003 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:35:32.003 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:35:32.003 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:35:32.003 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:35:32.003 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:35:32.003 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:35:32.003 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:35:32.003 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:35:32.003 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:35:32.003 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:35:32.003 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:35:32.003 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:35:32.003 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:35:32.004 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:35:32.004 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:35:32.004 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:35:32.004 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:35:32.004 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:35:32.004 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:35:32.004 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:35:32.004 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:35:32.004 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:35:32.004 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:35:32.004 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:35:32.004 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:35:32.004 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:35:32.004 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:35:32.004 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:35:32.005 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:35:32.005 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:35:32.005 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:35:32.005 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:35:32.005 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:35:32.005 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:35:32.005 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:35:32.005 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:35:32.005 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:35:32.005 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:35:32.005 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:35:32.005 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:35:32.005 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:35:32.005 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:35:32.006 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:35:32.006 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:35:32.006 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:35:32.006 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:35:32.006 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:35:32.006 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:35:32.006 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:35:32.006 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:35:32.006 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:35:32.006 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:35:32.006 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:35:32.006 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:35:32.006 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:35:32.006 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:35:32.007 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:35:32.007 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:35:32.007 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:35:32.007 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:35:32.007 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:35:32.007 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:35:32.007 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:35:32.007 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:35:32.008 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:35:32.008 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:35:32.008 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:35:32.008 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:35:32.008 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:35:32.009 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:35:32.009 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:35:32.009 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:35:32.009 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:35:32.009 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:35:32.009 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:35:32.009 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:35:32.009 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:35:32.009 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:35:32.009 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:35:32.009 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:35:32.010 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:35:32.010 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:35:32.010 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:35:32.010 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:35:32.010 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:35:32.010 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:35:32.010 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:35:32.011 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:35:32.011 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:35:32.011 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:35:32.011 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:35:32.011 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:35:32.011 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:35:32.011 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:35:32.011 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:35:32.011 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:35:32.011 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:35:32.011 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:35:32.011 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:35:32.011 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:35:32.011 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:35:32.012 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:35:32.012 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:35:32.012 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:35:32.012 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:35:32.012 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:35:32.012 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:35:32.012 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:35:32.012 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:35:32.012 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:35:32.012 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:35:32.012 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:35:32.012 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:35:32.012 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:35:32.013 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:35:32.013 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:35:32.013 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:35:32.013 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:35:32.013 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:35:32.013 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:35:32.013 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:35:32.013 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:35:32.013 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:35:32.013 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:35:32.014 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:35:32.014 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:35:32.014 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:35:32.014 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:35:32.014 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:35:32.014 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:35:32.014 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:35:32.014 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:35:32.014 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:35:32.014 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:35:32.015 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:35:32.015 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:35:32.015 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:35:32.015 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:35:32.015 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:35:32.015 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:35:32.015 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:35:32.015 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:35:32.015 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:35:32.015 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:35:32.015 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:35:32.016 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:35:32.016 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:35:32.016 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:35:32.016 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:35:32.016 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:35:32.016 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:35:32.016 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:35:32.016 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:35:32.016 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:35:32.016 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:35:32.016 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:35:32.017 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:35:32.017 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:35:32.017 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:35:32.017 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:35:32.017 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:35:32.017 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:35:32.017 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:35:32.017 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:35:32.017 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:35:32.017 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:35:32.017 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:35:32.017 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:35:32.017 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:35:32.017 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:35:32.018 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:35:32.018 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:35:32.018 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:35:32.018 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:35:32.018 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:35:32.018 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:35:32.018 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:35:32.018 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:35:32.018 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:35:32.019 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:35:32.019 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:35:32.019 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:35:32.019 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:35:32.019 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:35:32.019 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:35:32.019 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:35:32.019 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:35:32.019 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:35:32.019 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:35:32.019 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:35:32.019 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:35:32.020 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:35:32.020 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:35:32.020 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:35:32.020 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:35:32.020 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:35:32.020 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:35:32.020 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:35:32.020 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:35:32.020 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:35:32.020 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:35:32.020 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:35:32.020 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:35:32.020 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:35:32.021 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:35:32.021 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:35:32.021 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:35:32.021 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:35:32.021 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:35:32.021 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:35:32.021 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:35:32.021 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:35:32.021 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:35:32.021 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:35:32.021 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:35:32.021 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:35:32.021 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:35:32.021 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:35:32.022 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:35:32.022 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:35:32.022 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:35:32.022 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:35:32.022 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:35:32.022 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:35:32.022 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:35:32.022 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:35:32.022 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:35:32.022 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:35:32.022 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:35:32.022 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:35:32.022 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:35:32.023 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:35:32.023 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:35:32.023 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:35:32.023 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:35:32.023 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:35:32.023 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:35:32.023 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:35:32.023 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:35:32.023 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:35:32.023 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:35:32.023 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:35:32.023 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:35:32.023 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:35:32.024 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:35:32.024 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:35:32.024 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:35:32.024 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:35:32.024 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:35:32.024 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:35:32.024 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:35:32.024 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:35:32.024 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:35:32.024 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:35:32.024 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:35:32.024 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:35:32.024 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:35:32.024 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:35:32.024 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:35:32.025 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:35:32.025 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:35:32.025 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:35:32.025 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:35:32.025 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:35:32.025 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:35:32.025 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:35:32.025 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:35:32.025 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:35:32.025 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:35:32.025 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:35:32.025 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:35:32.025 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:35:32.025 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:35:32.026 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:35:32.026 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:35:32.026 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:35:32.026 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:35:32.026 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:35:32.026 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:35:32.026 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:35:32.026 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:35:32.026 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:35:32.026 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:35:32.026 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:35:32.026 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:35:32.026 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:35:32.026 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:35:32.027 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:35:32.027 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:35:32.027 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:35:32.027 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:35:32.027 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:35:32.027 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:35:32.027 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:35:32.027 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:35:32.027 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:35:32.027 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:35:32.027 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:35:32.027 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:35:32.027 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:35:32.027 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:35:32.028 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:35:32.028 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:35:32.028 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:35:32.028 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:35:32.028 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:35:32.028 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:35:32.028 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:35:32.028 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:35:32.028 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:35:32.028 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:35:32.028 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:35:32.028 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:35:32.028 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:35:32.028 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:35:32.028 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:35:32.029 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:35:32.029 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:35:32.029 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:35:32.029 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:35:32.029 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:35:32.029 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:35:32.029 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:35:32.029 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:35:32.029 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:35:32.029 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:35:32.029 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:35:32.029 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:35:32.030 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:35:32.030 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:35:32.030 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:35:32.030 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:35:32.030 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:35:32.030 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:35:32.030 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:35:32.030 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:35:32.030 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:35:32.030 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:35:32.030 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:35:32.030 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:35:32.030 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:35:32.031 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:35:32.031 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:35:32.031 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:35:32.031 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:35:32.031 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:35:32.031 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:35:32.031 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:35:32.031 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:35:32.031 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:35:32.031 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:35:32.031 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:35:32.031 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:35:32.031 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:35:32.032 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:35:32.032 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:35:32.032 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:35:32.032 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:35:32.032 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:35:32.032 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:35:32.032 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:35:32.032 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:35:32.032 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:35:32.032 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:35:32.032 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:35:32.032 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:35:32.032 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:35:32.032 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:35:32.033 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:35:32.033 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:35:32.033 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:35:32.033 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:35:32.033 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:35:32.033 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:35:32.033 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:35:32.033 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:35:32.033 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:35:32.033 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:35:32.033 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:35:32.033 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:35:32.034 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:35:32.034 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:35:32.034 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:35:32.034 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:35:32.034 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:35:32.034 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:35:32.035 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:35:32.035 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:35:32.035 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:35:32.035 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:35:32.035 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:35:32.035 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:35:32.035 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:35:32.035 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:35:32.035 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:35:32.035 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:35:32.036 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:35:32.036 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:35:32.036 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:35:32.036 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:35:32.036 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:35:32.040 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:32.040 DEBUG:teuthology.orchestra.run.smithi123:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:35:32.063 INFO:teuthology.orchestra.run.smithi123.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:35:32.063 INFO:teuthology.orchestra.run.smithi123.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:35:32.063 INFO:teuthology.orchestra.run.smithi123.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:35:32.063 INFO:teuthology.orchestra.run.smithi123.stdout:fi 2024-08-17T02:35:32.063 INFO:teuthology.orchestra.run.smithi123.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:35:32.063 INFO:teuthology.orchestra.run.smithi123.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:35:32.063 INFO:teuthology.orchestra.run.smithi123.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:35:32.063 INFO:teuthology.orchestra.run.smithi123.stdout: fi 2024-08-17T02:35:32.063 INFO:teuthology.orchestra.run.smithi123.stdout:done 2024-08-17T02:35:32.063 INFO:teuthology.orchestra.run.smithi123.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:35:32.064 INFO:teuthology.orchestra.run.smithi123.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:35:32.064 INFO:teuthology.orchestra.run.smithi123.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:35:32.064 INFO:teuthology.orchestra.run.smithi123.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:35:32.064 INFO:teuthology.orchestra.run.smithi123.stdout:fi 2024-08-17T02:35:32.064 INFO:teuthology.orchestra.run.smithi123.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:35:32.064 INFO:teuthology.orchestra.run.smithi123.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:32.064 INFO:teuthology.orchestra.run.smithi123.stdout:fi 2024-08-17T02:35:32.064 INFO:teuthology.orchestra.run.smithi123.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:35:32.064 INFO:teuthology.orchestra.run.smithi123.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:35:32.064 INFO:teuthology.orchestra.run.smithi123.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:32.064 INFO:teuthology.orchestra.run.smithi123.stdout:fi 2024-08-17T02:35:32.065 DEBUG:teuthology.orchestra.run.smithi123:> sudo rpm -qi grub2-tools 2024-08-17T02:35:32.136 INFO:teuthology.orchestra.run.smithi123.stdout:Name : grub2-tools 2024-08-17T02:35:32.137 INFO:teuthology.orchestra.run.smithi123.stdout:Epoch : 1 2024-08-17T02:35:32.137 INFO:teuthology.orchestra.run.smithi123.stdout:Version : 2.06 2024-08-17T02:35:32.137 INFO:teuthology.orchestra.run.smithi123.stdout:Release : 68.el9 2024-08-17T02:35:32.137 INFO:teuthology.orchestra.run.smithi123.stdout:Architecture: x86_64 2024-08-17T02:35:32.137 INFO:teuthology.orchestra.run.smithi123.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:35:32.137 INFO:teuthology.orchestra.run.smithi123.stdout:Group : Unspecified 2024-08-17T02:35:32.137 INFO:teuthology.orchestra.run.smithi123.stdout:Size : 8264254 2024-08-17T02:35:32.137 INFO:teuthology.orchestra.run.smithi123.stdout:License : GPLv3+ 2024-08-17T02:35:32.137 INFO:teuthology.orchestra.run.smithi123.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:35:32.137 INFO:teuthology.orchestra.run.smithi123.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:35:32.137 INFO:teuthology.orchestra.run.smithi123.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:35:32.137 INFO:teuthology.orchestra.run.smithi123.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:35:32.137 INFO:teuthology.orchestra.run.smithi123.stdout:Packager : builder@centos.org 2024-08-17T02:35:32.138 INFO:teuthology.orchestra.run.smithi123.stdout:Vendor : CentOS 2024-08-17T02:35:32.138 INFO:teuthology.orchestra.run.smithi123.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:35:32.138 INFO:teuthology.orchestra.run.smithi123.stdout:Summary : Support tools for GRUB. 2024-08-17T02:35:32.138 INFO:teuthology.orchestra.run.smithi123.stdout:Description : 2024-08-17T02:35:32.138 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:35:32.138 INFO:teuthology.orchestra.run.smithi123.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:35:32.138 INFO:teuthology.orchestra.run.smithi123.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:35:32.138 INFO:teuthology.orchestra.run.smithi123.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:35:32.138 INFO:teuthology.orchestra.run.smithi123.stdout:hardware devices. 2024-08-17T02:35:32.138 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:35:32.139 INFO:teuthology.orchestra.run.smithi123.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:35:32.140 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:35:32.140 INFO:teuthology.task.kernel:Updating grub on smithi123 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:32.140 DEBUG:teuthology.orchestra.run.smithi123:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:35:32.683 INFO:teuthology.orchestra.run.smithi123.stderr:Generating grub configuration file ... 2024-08-17T02:35:34.195 INFO:teuthology.orchestra.run.smithi123.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:35:34.225 INFO:teuthology.orchestra.run.smithi123.stderr:done 2024-08-17T02:35:34.227 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2024-08-17T02:35:34.283 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.Nlumm38Xgf 2024-08-17T02:35:34.283 DEBUG:teuthology.orchestra.run.smithi123:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Nlumm38Xgf 2024-08-17T02:35:34.348 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.Nlumm38Xgf 2024-08-17T02:35:34.483 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.Nlumm38Xgf is 6KB 2024-08-17T02:35:34.531 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.Nlumm38Xgf 2024-08-17T02:35:34.545 DEBUG:teuthology.orchestra.run.smithi123:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:35:34.607 INFO:teuthology.orchestra.run.smithi123.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:35:34.608 INFO:teuthology.orchestra.run.smithi123.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:35:34.608 INFO:teuthology.orchestra.run.smithi123.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:35:34.608 INFO:teuthology.orchestra.run.smithi123.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:35:34.609 DEBUG:teuthology.orchestra.run.smithi123:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:34.775 DEBUG:teuthology.orchestra.run.smithi123:> sudo shutdown -r now 2024-08-17T02:35:42.506 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-17T02:35:42.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-08-17T02:35:42.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:36:00.863 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-08-17T02:36:04.781 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-08-17T02:36:04.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-08-17T02:36:04.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:36:09.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-08-17T02:36:09.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:36:12.930 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-08-17T02:36:23.135 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-08-17T02:36:24.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-08-17T02:36:24.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:36:32.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-08-17T02:36:32.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:36:35.198 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-08-17T02:36:47.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-08-17T02:36:47.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:36:56.769 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-08-17T02:36:57.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-08-17T02:36:57.374 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:36:57.374 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-08-17T02:36:57.408 INFO:teuthology.orchestra.run.smithi100.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:57.408 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:57.408 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:36:57.408 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:36:58.410 DEBUG:teuthology.parallel:result is None 2024-08-17T02:37:19.006 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-08-17T02:37:19.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-08-17T02:37:19.513 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:37:19.513 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2024-08-17T02:37:19.547 INFO:teuthology.orchestra.run.smithi123.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:37:19.548 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:37:19.548 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:37:19.548 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:37:20.551 DEBUG:teuthology.parallel:result is None 2024-08-17T02:37:20.551 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-17T02:37:20.562 INFO:teuthology.task.internal:Creating test directory... 2024-08-17T02:37:20.563 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:37:20.568 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:37:20.604 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-17T02:37:20.616 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-17T02:37:20.630 INFO:teuthology.task.internal:Creating archive directory... 2024-08-17T02:37:20.630 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:37:20.650 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:37:20.696 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-17T02:37:20.706 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-17T02:37:20.707 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:37:20.734 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:37:20.836 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:37:20.850 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:37:20.872 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:37:20.894 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:37:20.897 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-17T02:37:20.914 INFO:teuthology.task.internal:Configuring sudo... 2024-08-17T02:37:20.915 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:37:20.918 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:37:20.974 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-17T02:37:20.989 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-17T02:37:20.989 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:37:20.993 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:37:21.027 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:37:21.121 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:37:21.200 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:37:21.263 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:37:21.333 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:37:21.333 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:37:21.388 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:37:21.453 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:37:21.531 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:37:21.592 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:37:21.663 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:37:21.663 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:37:21.787 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2024-08-17T02:37:21.792 DEBUG:teuthology.orchestra.run.smithi123:> sudo service rsyslog restart 2024-08-17T02:37:21.874 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:37:21.875 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:37:22.399 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-17T02:37:22.408 INFO:teuthology.task.internal:Starting timer... 2024-08-17T02:37:22.408 INFO:teuthology.run_tasks:Running task pcp... 2024-08-17T02:37:22.425 INFO:teuthology.run_tasks:Running task selinux... 2024-08-17T02:37:22.438 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2024-08-17T02:37:22.540 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2024-08-17T02:37:22.544 DEBUG:teuthology.orchestra.run.smithi123:> sudo service auditd rotate 2024-08-17T02:37:22.663 INFO:teuthology.orchestra.run.smithi123.stdout:Rotating logs: 2024-08-17T02:37:22.667 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-17T02:37:22.667 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2024-08-17T02:37:22.719 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2024-08-17T02:37:22.720 DEBUG:teuthology.orchestra.run.smithi123:> /usr/sbin/getenforce 2024-08-17T02:37:22.769 INFO:teuthology.orchestra.run.smithi123.stdout:Permissive 2024-08-17T02:37:22.770 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi100.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi123.front.sepia.ceph.com': 'permissive'} 2024-08-17T02:37:22.770 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:37:22.827 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:37:22.827 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:37:22.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:37:22.889 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-17T02:37:22.889 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:37:22.944 DEBUG:teuthology.orchestra.run.smithi123:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:37:23.001 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-17T02:37:23.011 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-17T02:37:23.023 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-17T02:37:23.024 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi100.front.sepia.ceph.com,smithi123.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-17T02:42:53.681 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi123.front.sepia.ceph.com')] 2024-08-17T02:42:53.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-08-17T02:42:53.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:42:53.819 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-08-17T02:42:53.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-08-17T02:42:53.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-08-17T02:42:53.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:42:54.023 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-08-17T02:42:54.094 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-08-17T02:42:54.095 INFO:teuthology.run_tasks:Running task clock... 2024-08-17T02:42:54.107 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-17T02:42:54.108 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:42:54.108 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:42:54.112 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:42:54.112 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:42:54.172 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:42:54.200 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:42:54.201 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:42:54.232 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:42:54.251 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2024-08-17T02:42:54.274 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2024-08-17T02:42:54.283 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: ntpd: command not found 2024-08-17T02:42:54.304 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:42:54.307 INFO:teuthology.orchestra.run.smithi123.stdout:506 Cannot talk to daemon 2024-08-17T02:42:54.332 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:42:54.336 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:42:54.365 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:42:54.433 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:42:54.440 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:42:54.440 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-08-17T02:42:54.440 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:42:54.440 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:42:54.440 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:42:54.440 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:42:54.474 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:42:54.481 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:42:54.481 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-08-17T02:42:54.481 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:42:54.481 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:42:54.481 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:42:54.481 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:42:54.482 INFO:teuthology.run_tasks:Running task install... 2024-08-17T02:42:54.491 DEBUG:teuthology.task.install:project ceph 2024-08-17T02:42:54.491 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}} 2024-08-17T02:42:54.491 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'} 2024-08-17T02:42:54.491 INFO:teuthology.task.install:Using flavor: default 2024-08-17T02:42:54.497 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-17T02:42:54.497 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-17T02:42:54.497 DEBUG:teuthology.orchestra.run.smithi100:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:42:54.498 DEBUG:teuthology.orchestra.run.smithi123:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:42:55.193 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:17 ago on Sat 17 Aug 2024 02:41:37 AM UTC. 2024-08-17T02:42:55.193 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:16 ago on Sat 17 Aug 2024 02:41:38 AM UTC. 2024-08-17T02:42:55.281 INFO:teuthology.orchestra.run.smithi100.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:42:55.286 INFO:teuthology.orchestra.run.smithi123.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:42:55.323 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-08-17T02:42:55.325 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-08-17T02:42:55.325 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-08-17T02:42:55.329 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-08-17T02:42:55.330 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-08-17T02:42:55.330 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-08-17T02:42:55.394 DEBUG:teuthology.orchestra.run.smithi100:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:42:55.415 DEBUG:teuthology.orchestra.run.smithi123:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:42:55.647 INFO:teuthology.orchestra.run.smithi100.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:42:55.647 INFO:teuthology.orchestra.run.smithi100.stderr:of the main distribution, and quality may vary. 2024-08-17T02:42:55.647 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-08-17T02:42:55.647 INFO:teuthology.orchestra.run.smithi100.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:42:55.648 INFO:teuthology.orchestra.run.smithi100.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:42:55.648 INFO:teuthology.orchestra.run.smithi100.stderr:, 2024-08-17T02:42:55.648 INFO:teuthology.orchestra.run.smithi100.stderr:and packages are not held to any quality or security level. 2024-08-17T02:42:55.648 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-08-17T02:42:55.648 INFO:teuthology.orchestra.run.smithi100.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:42:55.648 INFO:teuthology.orchestra.run.smithi100.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:42:55.673 INFO:teuthology.orchestra.run.smithi123.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:42:55.673 INFO:teuthology.orchestra.run.smithi123.stderr:of the main distribution, and quality may vary. 2024-08-17T02:42:55.673 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-08-17T02:42:55.674 INFO:teuthology.orchestra.run.smithi123.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:42:55.674 INFO:teuthology.orchestra.run.smithi123.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:42:55.674 INFO:teuthology.orchestra.run.smithi123.stderr:, 2024-08-17T02:42:55.674 INFO:teuthology.orchestra.run.smithi123.stderr:and packages are not held to any quality or security level. 2024-08-17T02:42:55.674 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-08-17T02:42:55.674 INFO:teuthology.orchestra.run.smithi123.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:42:55.674 INFO:teuthology.orchestra.run.smithi123.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:42:55.729 INFO:teuthology.orchestra.run.smithi100.stdout:Repository successfully enabled. 2024-08-17T02:42:55.751 INFO:teuthology.orchestra.run.smithi123.stdout:Repository successfully enabled. 2024-08-17T02:42:55.773 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:42:55.773 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:42:55.795 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:42:55.795 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:42:55.917 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:42:55.917 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:42:55.939 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:42:55.939 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:42:56.152 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:42:56.152 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:42:56.152 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:42:56.184 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:42:56.184 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:42:56.184 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:42:56.209 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:42:56.209 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:42:56.242 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:42:56.242 DEBUG:teuthology.orchestra.run.smithi123:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:42:56.307 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:42:56.340 DEBUG:teuthology.orchestra.run.smithi123:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:42:56.386 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:42:56.417 DEBUG:teuthology.orchestra.run.smithi123:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:42:56.441 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2024-08-17T02:42:56.444 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2024-08-17T02:42:56.472 INFO:teuthology.orchestra.run.smithi123.stdout:check_obsoletes = 1 2024-08-17T02:42:56.476 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum clean all 2024-08-17T02:42:56.718 INFO:teuthology.orchestra.run.smithi100.stdout:45 files removed 2024-08-17T02:42:56.742 INFO:teuthology.orchestra.run.smithi123.stdout:45 files removed 2024-08-17T02:42:56.752 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:42:56.779 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:42:57.719 INFO:teuthology.orchestra.run.smithi123.stdout:ceph packages for x86_64 133 kB/s | 77 kB 00:00 2024-08-17T02:42:57.720 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 128 kB/s | 77 kB 00:00 2024-08-17T02:42:58.245 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 22 kB/s | 11 kB 00:00 2024-08-17T02:42:58.253 INFO:teuthology.orchestra.run.smithi123.stdout:ceph noarch packages 22 kB/s | 11 kB 00:00 2024-08-17T02:42:58.762 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 3.7 kB/s | 1.8 kB 00:00 2024-08-17T02:42:58.770 INFO:teuthology.orchestra.run.smithi123.stdout:ceph source packages 3.7 kB/s | 1.8 kB 00:00 2024-08-17T02:42:58.988 INFO:teuthology.orchestra.run.smithi100.stdout:Copr repo for el9 owned by ceph 40 kB/s | 7.6 kB 00:00 2024-08-17T02:42:58.996 INFO:teuthology.orchestra.run.smithi123.stdout:Copr repo for el9 owned by ceph 40 kB/s | 7.6 kB 00:00 2024-08-17T02:42:59.815 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-08-17T02:42:59.962 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - BaseOS 8.8 MB/s | 8.2 MB 00:00 2024-08-17T02:43:02.048 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-08-17T02:43:03.058 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 20 MB 00:02 2024-08-17T02:43:07.591 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.6 MB 00:00 2024-08-17T02:43:07.989 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.6 MB 00:01 2024-08-17T02:43:09.383 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 18 kB 00:00 2024-08-17T02:43:09.707 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 18 kB 00:00 2024-08-17T02:43:10.759 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 18 MB/s | 22 MB 00:01 2024-08-17T02:43:10.786 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 24 MB/s | 22 MB 00:00 2024-08-17T02:43:17.026 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-08-17T02:43:17.042 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-08-17T02:43:19.563 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:43:19.564 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:43:19.575 INFO:teuthology.orchestra.run.smithi100.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:43:19.575 INFO:teuthology.orchestra.run.smithi100.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:43:19.576 INFO:teuthology.orchestra.run.smithi100.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:43:19.577 INFO:teuthology.orchestra.run.smithi100.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:43:19.579 INFO:teuthology.orchestra.run.smithi100.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:43:19.581 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:43:19.582 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:43:19.620 INFO:teuthology.orchestra.run.smithi123.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:43:19.621 INFO:teuthology.orchestra.run.smithi123.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:43:19.632 INFO:teuthology.orchestra.run.smithi123.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:43:19.632 INFO:teuthology.orchestra.run.smithi123.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:43:19.633 INFO:teuthology.orchestra.run.smithi123.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:43:19.634 INFO:teuthology.orchestra.run.smithi123.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:43:19.636 INFO:teuthology.orchestra.run.smithi123.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:43:19.638 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:43:19.639 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:43:19.641 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-08-17T02:43:19.658 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-08-17T02:43:19.658 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-08-17T02:43:19.658 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-08-17T02:43:19.659 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-08-17T02:43:19.659 INFO:teuthology.orchestra.run.smithi100.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:43:19.659 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:43:19.659 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:43:19.659 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:43:19.659 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:43:19.659 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:43:19.659 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:43:19.659 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:43:19.659 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:43:19.659 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:43:19.659 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:43:19.660 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:43:19.660 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:43:19.660 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:43:19.660 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:43:19.660 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:43:19.660 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:43:19.660 INFO:teuthology.orchestra.run.smithi100.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:43:19.660 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:43:19.660 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:43:19.660 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:43:19.660 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:43:19.660 INFO:teuthology.orchestra.run.smithi100.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:43:19.661 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:43:19.661 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:43:19.661 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:43:19.661 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:43:19.661 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:43:19.661 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:43:19.661 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:43:19.661 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:43:19.661 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:43:19.661 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:43:19.661 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-08-17T02:43:19.661 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:43:19.662 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:43:19.662 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:43:19.662 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:43:19.662 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:43:19.662 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:43:19.662 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:43:19.662 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:43:19.662 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:43:19.662 INFO:teuthology.orchestra.run.smithi100.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:43:19.662 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:43:19.662 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:43:19.662 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-08-17T02:43:19.663 INFO:teuthology.orchestra.run.smithi100.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:43:19.663 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:43:19.663 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:43:19.663 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:43:19.663 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:43:19.663 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:43:19.663 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:43:19.663 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:43:19.663 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:43:19.663 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:43:19.663 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:43:19.663 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:43:19.664 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:43:19.664 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:43:19.664 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:43:19.664 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:43:19.664 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:43:19.664 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:43:19.664 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:43:19.664 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:43:19.664 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:43:19.664 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:43:19.664 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:43:19.664 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:43:19.665 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:43:19.665 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:43:19.665 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:43:19.665 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:43:19.665 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:43:19.665 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:43:19.665 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:43:19.665 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:43:19.665 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:43:19.665 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:43:19.665 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:43:19.665 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:43:19.666 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:43:19.666 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:43:19.666 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:43:19.666 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:43:19.666 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:43:19.666 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:43:19.666 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:43:19.666 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:43:19.667 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:43:19.667 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:43:19.667 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:43:19.667 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:43:19.667 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:43:19.667 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:43:19.667 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:43:19.667 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:43:19.667 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:43:19.667 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:43:19.667 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:43:19.667 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:43:19.667 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:43:19.668 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:43:19.668 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:43:19.668 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:43:19.668 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:43:19.668 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:43:19.668 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:43:19.668 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:43:19.668 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:43:19.668 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:43:19.668 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:43:19.668 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:43:19.668 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:43:19.668 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:43:19.669 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:43:19.669 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:43:19.669 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:43:19.669 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:43:19.669 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:43:19.669 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:43:19.669 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:43:19.669 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:43:19.669 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:43:19.669 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:43:19.669 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:43:19.669 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:43:19.669 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:43:19.670 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:43:19.670 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:43:19.670 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:43:19.670 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:43:19.670 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2024-08-17T02:43:19.670 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:43:19.670 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:43:19.670 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-08-17T02:43:19.670 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-08-17T02:43:19.670 INFO:teuthology.orchestra.run.smithi100.stdout:Install 121 Packages 2024-08-17T02:43:19.670 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 12 Packages 2024-08-17T02:43:19.670 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:43:19.671 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 206 M 2024-08-17T02:43:19.671 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-08-17T02:43:19.699 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-08-17T02:43:19.717 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================= 2024-08-17T02:43:19.717 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-08-17T02:43:19.717 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================= 2024-08-17T02:43:19.717 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-08-17T02:43:19.717 INFO:teuthology.orchestra.run.smithi123.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:43:19.717 INFO:teuthology.orchestra.run.smithi123.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:43:19.717 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:43:19.718 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:43:19.718 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:43:19.718 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:43:19.718 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:43:19.718 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:43:19.718 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:43:19.718 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:43:19.718 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:43:19.719 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:43:19.719 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:43:19.719 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:43:19.719 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:43:19.719 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:43:19.719 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:43:19.719 INFO:teuthology.orchestra.run.smithi123.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:43:19.719 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:43:19.719 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:43:19.720 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:43:19.720 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:43:19.720 INFO:teuthology.orchestra.run.smithi123.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:43:19.720 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:43:19.720 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:43:19.720 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:43:19.720 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:43:19.720 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:43:19.720 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:43:19.720 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:43:19.720 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:43:19.720 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:43:19.721 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:43:19.721 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrading: 2024-08-17T02:43:19.721 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:43:19.721 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:43:19.721 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:43:19.722 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:43:19.723 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:43:19.723 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:43:19.723 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:43:19.723 INFO:teuthology.orchestra.run.smithi123.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:43:19.723 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:43:19.724 INFO:teuthology.orchestra.run.smithi123.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:43:19.724 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:43:19.724 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:43:19.724 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-08-17T02:43:19.724 INFO:teuthology.orchestra.run.smithi123.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:43:19.724 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:43:19.724 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:43:19.724 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:43:19.724 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:43:19.724 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:43:19.724 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:43:19.724 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:43:19.724 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:43:19.725 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:43:19.725 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:43:19.725 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:43:19.725 INFO:teuthology.orchestra.run.smithi123.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:43:19.725 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:43:19.725 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:43:19.725 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:43:19.725 INFO:teuthology.orchestra.run.smithi123.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:43:19.725 INFO:teuthology.orchestra.run.smithi123.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:43:19.725 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:43:19.725 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:43:19.725 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:43:19.725 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:43:19.726 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:43:19.726 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:43:19.726 INFO:teuthology.orchestra.run.smithi123.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:43:19.726 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:43:19.726 INFO:teuthology.orchestra.run.smithi123.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:43:19.726 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:43:19.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:43:19.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:43:19.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:43:19.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:43:19.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:43:19.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:43:19.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:43:19.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:43:19.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:43:19.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:43:19.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:43:19.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:43:19.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:43:19.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:43:19.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:43:19.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:43:19.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:43:19.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:43:19.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:43:19.728 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:43:19.728 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:43:19.728 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:43:19.728 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:43:19.728 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:43:19.728 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:43:19.728 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:43:19.728 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:43:19.728 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:43:19.728 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:43:19.728 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:43:19.728 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:43:19.729 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:43:19.729 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:43:19.729 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:43:19.729 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:43:19.729 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:43:19.729 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:43:19.729 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:43:19.729 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:43:19.729 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:43:19.729 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:43:19.729 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:43:19.729 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:43:19.729 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:43:19.730 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:43:19.730 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:43:19.730 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:43:19.730 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:43:19.730 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:43:19.730 INFO:teuthology.orchestra.run.smithi123.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:43:19.730 INFO:teuthology.orchestra.run.smithi123.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:43:19.730 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:43:19.731 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:43:19.731 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:43:19.731 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:43:19.731 INFO:teuthology.orchestra.run.smithi123.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:43:19.731 INFO:teuthology.orchestra.run.smithi123.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:43:19.731 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:43:19.731 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:43:19.731 INFO:teuthology.orchestra.run.smithi123.stdout:Installing weak dependencies: 2024-08-17T02:43:19.731 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:43:19.731 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:43:19.731 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-08-17T02:43:19.731 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================= 2024-08-17T02:43:19.731 INFO:teuthology.orchestra.run.smithi123.stdout:Install 121 Packages 2024-08-17T02:43:19.732 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrade 12 Packages 2024-08-17T02:43:19.732 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:43:19.732 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 206 M 2024-08-17T02:43:19.732 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-08-17T02:43:20.211 INFO:teuthology.orchestra.run.smithi100.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 35 kB/s | 6.5 kB 00:00 2024-08-17T02:43:20.377 INFO:teuthology.orchestra.run.smithi100.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 4.8 MB/s | 813 kB 00:00 2024-08-17T02:43:20.436 INFO:teuthology.orchestra.run.smithi100.stdout:(3/133): ceph-immutable-object-cache-17.2.7-137 2.3 MB/s | 137 kB 00:00 2024-08-17T02:43:20.637 INFO:teuthology.orchestra.run.smithi100.stdout:(4/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 10 MB/s | 2.1 MB 00:00 2024-08-17T02:43:20.643 INFO:teuthology.orchestra.run.smithi123.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 33 kB/s | 6.5 kB 00:00 2024-08-17T02:43:20.720 INFO:teuthology.orchestra.run.smithi100.stdout:(5/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 7.1 MB/s | 5.0 MB 00:00 2024-08-17T02:43:20.788 INFO:teuthology.orchestra.run.smithi100.stdout:(6/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 9.4 MB/s | 1.4 MB 00:00 2024-08-17T02:43:20.860 INFO:teuthology.orchestra.run.smithi123.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 3.7 MB/s | 813 kB 00:00 2024-08-17T02:43:20.965 INFO:teuthology.orchestra.run.smithi123.stdout:(3/133): ceph-immutable-object-cache-17.2.7-137 1.3 MB/s | 137 kB 00:00 2024-08-17T02:43:21.138 INFO:teuthology.orchestra.run.smithi100.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 9.4 MB/s | 3.9 MB 00:00 2024-08-17T02:43:21.286 INFO:teuthology.orchestra.run.smithi123.stdout:(4/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 6.5 MB/s | 2.1 MB 00:00 2024-08-17T02:43:21.428 INFO:teuthology.orchestra.run.smithi123.stdout:(5/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 5.1 MB/s | 5.0 MB 00:00 2024-08-17T02:43:21.528 INFO:teuthology.orchestra.run.smithi123.stdout:(6/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 5.8 MB/s | 1.4 MB 00:00 2024-08-17T02:43:21.638 INFO:teuthology.orchestra.run.smithi100.stdout:(8/133): ceph-common-17.2.7-1375.g2577e813.el9. 14 MB/s | 22 MB 00:01 2024-08-17T02:43:21.713 INFO:teuthology.orchestra.run.smithi100.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 336 kB/s | 25 kB 00:00 2024-08-17T02:43:21.804 INFO:teuthology.orchestra.run.smithi123.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 10 MB/s | 3.9 MB 00:00 2024-08-17T02:43:22.097 INFO:teuthology.orchestra.run.smithi100.stdout:(10/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 12 MB/s | 15 MB 00:01 2024-08-17T02:43:22.172 INFO:teuthology.orchestra.run.smithi100.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 2.8 MB/s | 215 kB 00:00 2024-08-17T02:43:22.322 INFO:teuthology.orchestra.run.smithi100.stdout:(12/133): ceph-radosgw-17.2.7-1375.g2577e813.el 12 MB/s | 14 MB 00:01 2024-08-17T02:43:22.339 INFO:teuthology.orchestra.run.smithi100.stdout:(13/133): libcephfs-devel-17.2.7-1375.g2577e813 150 kB/s | 25 kB 00:00 2024-08-17T02:43:22.414 INFO:teuthology.orchestra.run.smithi100.stdout:(14/133): libcephfs2-17.2.7-1375.g2577e813.el9. 6.8 MB/s | 636 kB 00:00 2024-08-17T02:43:22.448 INFO:teuthology.orchestra.run.smithi100.stdout:(15/133): libcephsqlite-17.2.7-1375.g2577e813.e 1.5 MB/s | 163 kB 00:00 2024-08-17T02:43:22.482 INFO:teuthology.orchestra.run.smithi100.stdout:(16/133): librados-devel-17.2.7-1375.g2577e813. 1.9 MB/s | 126 kB 00:00 2024-08-17T02:43:22.532 INFO:teuthology.orchestra.run.smithi100.stdout:(17/133): libradosstriper1-17.2.7-1375.g2577e81 5.3 MB/s | 458 kB 00:00 2024-08-17T02:43:22.616 INFO:teuthology.orchestra.run.smithi100.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 543 kB/s | 45 kB 00:00 2024-08-17T02:43:22.708 INFO:teuthology.orchestra.run.smithi100.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 1.3 MB/s | 120 kB 00:00 2024-08-17T02:43:22.800 INFO:teuthology.orchestra.run.smithi100.stdout:(20/133): python3-cephfs-17.2.7-1375.g2577e813. 1.9 MB/s | 182 kB 00:00 2024-08-17T02:43:22.917 INFO:teuthology.orchestra.run.smithi100.stdout:(21/133): librgw2-17.2.7-1375.g2577e813.el9.x86 11 MB/s | 4.9 MB 00:00 2024-08-17T02:43:22.950 INFO:teuthology.orchestra.run.smithi100.stdout:(22/133): python3-rados-17.2.7-1375.g2577e813.e 2.4 MB/s | 369 kB 00:00 2024-08-17T02:43:22.984 INFO:teuthology.orchestra.run.smithi100.stdout:(23/133): python3-rbd-17.2.7-1375.g2577e813.el9 5.0 MB/s | 344 kB 00:00 2024-08-17T02:43:23.034 INFO:teuthology.orchestra.run.smithi100.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.4 MB/s | 116 kB 00:00 2024-08-17T02:43:23.059 INFO:teuthology.orchestra.run.smithi100.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 1.1 MB/s | 82 kB 00:00 2024-08-17T02:43:23.087 INFO:teuthology.orchestra.run.smithi123.stdout:(8/133): ceph-osd-17.2.7-1375.g2577e813.el9.x86 9.8 MB/s | 15 MB 00:01 2024-08-17T02:43:23.118 INFO:teuthology.orchestra.run.smithi100.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 2.8 MB/s | 165 kB 00:00 2024-08-17T02:43:23.171 INFO:teuthology.orchestra.run.smithi123.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 304 kB/s | 25 kB 00:00 2024-08-17T02:43:23.193 INFO:teuthology.orchestra.run.smithi100.stdout:(27/133): ceph-grafana-dashboards-17.2.7-1375.g 326 kB/s | 24 kB 00:00 2024-08-17T02:43:23.252 INFO:teuthology.orchestra.run.smithi100.stdout:(28/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 14 MB/s | 2.9 MB 00:00 2024-08-17T02:43:23.277 INFO:teuthology.orchestra.run.smithi100.stdout:(29/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 1.4 MB/s | 124 kB 00:00 2024-08-17T02:43:23.387 INFO:teuthology.orchestra.run.smithi123.stdout:(10/133): ceph-radosgw-17.2.7-1375.g2577e813.el 9.0 MB/s | 14 MB 00:01 2024-08-17T02:43:23.533 INFO:teuthology.orchestra.run.smithi123.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 1.4 MB/s | 215 kB 00:00 2024-08-17T02:43:23.544 INFO:teuthology.orchestra.run.smithi100.stdout:(30/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 11 MB/s | 3.4 MB 00:00 2024-08-17T02:43:23.628 INFO:teuthology.orchestra.run.smithi100.stdout:(31/133): ceph-mgr-modules-core-17.2.7-1375.g25 2.8 MB/s | 240 kB 00:00 2024-08-17T02:43:23.704 INFO:teuthology.orchestra.run.smithi100.stdout:(32/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 636 kB/s | 47 kB 00:00 2024-08-17T02:43:23.789 INFO:teuthology.orchestra.run.smithi123.stdout:(12/133): ceph-common-17.2.7-1375.g2577e813.el9 6.7 MB/s | 22 MB 00:03 2024-08-17T02:43:23.795 INFO:teuthology.orchestra.run.smithi100.stdout:(33/133): ceph-mgr-diskprediction-local-17.2.7- 14 MB/s | 7.4 MB 00:00 2024-08-17T02:43:23.814 INFO:teuthology.orchestra.run.smithi123.stdout:(13/133): libcephfs-devel-17.2.7-1375.g2577e813 89 kB/s | 25 kB 00:00 2024-08-17T02:43:23.820 INFO:teuthology.orchestra.run.smithi100.stdout:(34/133): ceph-prometheus-alerts-17.2.7-1375.g2 125 kB/s | 15 kB 00:00 2024-08-17T02:43:23.863 INFO:teuthology.orchestra.run.smithi100.stdout:(35/133): ceph-volume-17.2.7-1375.g2577e813.el9 3.9 MB/s | 269 kB 00:00 2024-08-17T02:43:23.888 INFO:teuthology.orchestra.run.smithi100.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.2 MB/s | 83 kB 00:00 2024-08-17T02:43:23.905 INFO:teuthology.orchestra.run.smithi100.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 434 kB/s | 18 kB 00:00 2024-08-17T02:43:23.905 INFO:teuthology.orchestra.run.smithi123.stdout:(14/133): libcephfs2-17.2.7-1375.g2577e813.el9. 5.3 MB/s | 636 kB 00:00 2024-08-17T02:43:23.930 INFO:teuthology.orchestra.run.smithi123.stdout:(15/133): libcephsqlite-17.2.7-1375.g2577e813.e 1.4 MB/s | 163 kB 00:00 2024-08-17T02:43:23.956 INFO:teuthology.orchestra.run.smithi123.stdout:(16/133): librados-devel-17.2.7-1375.g2577e813. 2.5 MB/s | 126 kB 00:00 2024-08-17T02:43:23.980 INFO:teuthology.orchestra.run.smithi100.stdout:(38/133): fuse-2.9.9-16.el9.x86_64.rpm 866 kB/s | 80 kB 00:00 2024-08-17T02:43:24.023 INFO:teuthology.orchestra.run.smithi123.stdout:(17/133): libradosstriper1-17.2.7-1375.g2577e81 4.9 MB/s | 458 kB 00:00 2024-08-17T02:43:24.039 INFO:teuthology.orchestra.run.smithi100.stdout:(39/133): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-08-17T02:43:24.081 INFO:teuthology.orchestra.run.smithi123.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 775 kB/s | 45 kB 00:00 2024-08-17T02:43:24.089 INFO:teuthology.orchestra.run.smithi100.stdout:(40/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-08-17T02:43:24.132 INFO:teuthology.orchestra.run.smithi123.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 2.4 MB/s | 120 kB 00:00 2024-08-17T02:43:24.165 INFO:teuthology.orchestra.run.smithi100.stdout:(41/133): libgfortran-11.4.1-3.el9.x86_64.rpm 3.0 MB/s | 803 kB 00:00 2024-08-17T02:43:24.199 INFO:teuthology.orchestra.run.smithi123.stdout:(20/133): python3-cephfs-17.2.7-1375.g2577e813. 2.7 MB/s | 182 kB 00:00 2024-08-17T02:43:24.206 INFO:teuthology.orchestra.run.smithi100.stdout:(42/133): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-08-17T02:43:24.232 INFO:teuthology.orchestra.run.smithi100.stdout:(43/133): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-08-17T02:43:24.258 INFO:teuthology.orchestra.run.smithi100.stdout:(44/133): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-08-17T02:43:24.282 INFO:teuthology.orchestra.run.smithi123.stdout:(21/133): python3-rados-17.2.7-1375.g2577e813.e 4.3 MB/s | 369 kB 00:00 2024-08-17T02:43:24.324 INFO:teuthology.orchestra.run.smithi100.stdout:(45/133): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-08-17T02:43:24.341 INFO:teuthology.orchestra.run.smithi123.stdout:(22/133): python3-rbd-17.2.7-1375.g2577e813.el9 5.8 MB/s | 344 kB 00:00 2024-08-17T02:43:24.349 INFO:teuthology.orchestra.run.smithi100.stdout:(46/133): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-08-17T02:43:24.416 INFO:teuthology.orchestra.run.smithi123.stdout:(23/133): librgw2-17.2.7-1375.g2577e813.el9.x86 11 MB/s | 4.9 MB 00:00 2024-08-17T02:43:24.442 INFO:teuthology.orchestra.run.smithi123.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.1 MB/s | 116 kB 00:00 2024-08-17T02:43:24.467 INFO:teuthology.orchestra.run.smithi123.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 1.6 MB/s | 82 kB 00:00 2024-08-17T02:43:24.525 INFO:teuthology.orchestra.run.smithi123.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 2.8 MB/s | 165 kB 00:00 2024-08-17T02:43:24.607 INFO:teuthology.orchestra.run.smithi123.stdout:(27/133): ceph-grafana-dashboards-17.2.7-1375.g 300 kB/s | 24 kB 00:00 2024-08-17T02:43:24.693 INFO:teuthology.orchestra.run.smithi123.stdout:(28/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 12 MB/s | 2.9 MB 00:00 2024-08-17T02:43:24.718 INFO:teuthology.orchestra.run.smithi123.stdout:(29/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 1.1 MB/s | 124 kB 00:00 2024-08-17T02:43:24.827 INFO:teuthology.orchestra.run.smithi100.stdout:(47/133): ceph-test-17.2.7-1375.g2577e813.el9.x 15 MB/s | 48 MB 00:03 2024-08-17T02:43:24.927 INFO:teuthology.orchestra.run.smithi123.stdout:(30/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 14 MB/s | 3.4 MB 00:00 2024-08-17T02:43:24.943 INFO:teuthology.orchestra.run.smithi100.stdout:(48/133): elfutils-libelf-devel-0.191-4.el9.x86 189 kB/s | 22 kB 00:00 2024-08-17T02:43:24.975 INFO:teuthology.orchestra.run.smithi100.stdout:(49/133): automake-1.16.2-8.el9.noarch.rpm 1.0 MB/s | 689 kB 00:00 2024-08-17T02:43:24.986 INFO:teuthology.orchestra.run.smithi123.stdout:(31/133): ceph-mgr-modules-core-17.2.7-1375.g25 4.0 MB/s | 240 kB 00:00 2024-08-17T02:43:25.044 INFO:teuthology.orchestra.run.smithi123.stdout:(32/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 818 kB/s | 47 kB 00:00 2024-08-17T02:43:25.059 INFO:teuthology.orchestra.run.smithi100.stdout:(50/133): bison-3.7.4-5.el9.x86_64.rpm 1.3 MB/s | 943 kB 00:00 2024-08-17T02:43:25.084 INFO:teuthology.orchestra.run.smithi100.stdout:(51/133): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-08-17T02:43:25.102 INFO:teuthology.orchestra.run.smithi123.stdout:(33/133): ceph-prometheus-alerts-17.2.7-1375.g2 251 kB/s | 15 kB 00:00 2024-08-17T02:43:25.134 INFO:teuthology.orchestra.run.smithi100.stdout:(52/133): flex-2.6.4-9.el9.x86_64.rpm 1.6 MB/s | 313 kB 00:00 2024-08-17T02:43:25.161 INFO:teuthology.orchestra.run.smithi123.stdout:(34/133): ceph-volume-17.2.7-1375.g2577e813.el9 4.5 MB/s | 269 kB 00:00 2024-08-17T02:43:25.185 INFO:teuthology.orchestra.run.smithi100.stdout:(53/133): flexiblas-openblas-openmp-3.0.4-8.el9 182 kB/s | 18 kB 00:00 2024-08-17T02:43:25.235 INFO:teuthology.orchestra.run.smithi100.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-08-17T02:43:25.270 INFO:teuthology.orchestra.run.smithi123.stdout:(35/133): ceph-mgr-diskprediction-local-17.2.7- 13 MB/s | 7.4 MB 00:00 2024-08-17T02:43:25.295 INFO:teuthology.orchestra.run.smithi123.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 620 kB/s | 83 kB 00:00 2024-08-17T02:43:25.344 INFO:teuthology.orchestra.run.smithi100.stdout:(55/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-08-17T02:43:25.345 INFO:teuthology.orchestra.run.smithi123.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 242 kB/s | 18 kB 00:00 2024-08-17T02:43:25.369 INFO:teuthology.orchestra.run.smithi100.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 339 kB/s | 45 kB 00:00 2024-08-17T02:43:25.427 INFO:teuthology.orchestra.run.smithi100.stdout:(57/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.1 MB/s | 3.0 MB 00:00 2024-08-17T02:43:25.437 INFO:teuthology.orchestra.run.smithi123.stdout:(38/133): fuse-2.9.9-16.el9.x86_64.rpm 563 kB/s | 80 kB 00:00 2024-08-17T02:43:25.479 INFO:teuthology.orchestra.run.smithi123.stdout:(39/133): libgfortran-11.4.1-3.el9.x86_64.rpm 5.9 MB/s | 803 kB 00:00 2024-08-17T02:43:25.504 INFO:teuthology.orchestra.run.smithi123.stdout:(40/133): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2024-08-17T02:43:25.530 INFO:teuthology.orchestra.run.smithi123.stdout:(41/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-08-17T02:43:25.553 INFO:teuthology.orchestra.run.smithi100.stdout:(58/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 204 kB/s | 25 kB 00:00 2024-08-17T02:43:25.572 INFO:teuthology.orchestra.run.smithi123.stdout:(42/133): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-08-17T02:43:25.605 INFO:teuthology.orchestra.run.smithi123.stdout:(43/133): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-08-17T02:43:25.631 INFO:teuthology.orchestra.run.smithi123.stdout:(44/133): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-08-17T02:43:25.637 INFO:teuthology.orchestra.run.smithi100.stdout:(59/133): libtool-2.4.6-46.el9.x86_64.rpm 2.1 MB/s | 581 kB 00:00 2024-08-17T02:43:25.656 INFO:teuthology.orchestra.run.smithi123.stdout:(45/133): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-08-17T02:43:25.662 INFO:teuthology.orchestra.run.smithi100.stdout:(60/133): librdkafka-1.6.1-102.el9.x86_64.rpm 2.0 MB/s | 662 kB 00:00 2024-08-17T02:43:25.687 INFO:teuthology.orchestra.run.smithi100.stdout:(61/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 354 kB/s | 47 kB 00:00 2024-08-17T02:43:25.706 INFO:teuthology.orchestra.run.smithi123.stdout:(46/133): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-08-17T02:43:25.762 INFO:teuthology.orchestra.run.smithi100.stdout:(62/133): openblas-0.3.21-2.el9.x86_64.rpm 352 kB/s | 35 kB 00:00 2024-08-17T02:43:25.839 INFO:teuthology.orchestra.run.smithi100.stdout:(63/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 292 kB 00:00 2024-08-17T02:43:25.973 INFO:teuthology.orchestra.run.smithi123.stdout:(47/133): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-08-17T02:43:26.055 INFO:teuthology.orchestra.run.smithi100.stdout:(64/133): openblas-openmp-0.3.21-2.el9.x86_64.r 13 MB/s | 4.7 MB 00:00 2024-08-17T02:43:26.147 INFO:teuthology.orchestra.run.smithi100.stdout:(65/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-08-17T02:43:26.247 INFO:teuthology.orchestra.run.smithi100.stdout:(66/133): python3-devel-3.9.18-3.el9.x86_64.rpm 1.2 MB/s | 244 kB 00:00 2024-08-17T02:43:26.331 INFO:teuthology.orchestra.run.smithi100.stdout:(67/133): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-08-17T02:43:26.356 INFO:teuthology.orchestra.run.smithi100.stdout:(68/133): python3-jinja2-2.11.3-6.el9.noarch.rp 1.2 MB/s | 248 kB 00:00 2024-08-17T02:43:26.398 INFO:teuthology.orchestra.run.smithi100.stdout:(69/133): python3-jsonpatch-1.21-16.el9.noarch. 170 kB/s | 26 kB 00:00 2024-08-17T02:43:26.423 INFO:teuthology.orchestra.run.smithi100.stdout:(70/133): python3-jsonpointer-2.0-4.el9.noarch. 208 kB/s | 19 kB 00:00 2024-08-17T02:43:26.474 INFO:teuthology.orchestra.run.smithi123.stdout:(48/133): ceph-test-17.2.7-1375.g2577e813.el9.x 15 MB/s | 48 MB 00:03 2024-08-17T02:43:26.491 INFO:teuthology.orchestra.run.smithi123.stdout:(49/133): elfutils-libelf-devel-0.191-4.el9.x86 42 kB/s | 22 kB 00:00 2024-08-17T02:43:26.492 INFO:teuthology.orchestra.run.smithi100.stdout:(71/133): python3-markupsafe-1.1.1-12.el9.x86_6 379 kB/s | 35 kB 00:00 2024-08-17T02:43:26.524 INFO:teuthology.orchestra.run.smithi100.stdout:(72/133): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-08-17T02:43:26.532 INFO:teuthology.orchestra.run.smithi123.stdout:(50/133): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-08-17T02:43:26.558 INFO:teuthology.orchestra.run.smithi123.stdout:(51/133): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-08-17T02:43:26.608 INFO:teuthology.orchestra.run.smithi123.stdout:(52/133): flexiblas-openblas-openmp-3.0.4-8.el9 366 kB/s | 18 kB 00:00 2024-08-17T02:43:26.650 INFO:teuthology.orchestra.run.smithi123.stdout:(53/133): libaio-devel-0.3.111-13.el9.x86_64.rp 267 kB/s | 11 kB 00:00 2024-08-17T02:43:26.674 INFO:teuthology.orchestra.run.smithi100.stdout:(73/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 250 kB 00:00 2024-08-17T02:43:26.699 INFO:teuthology.orchestra.run.smithi100.stdout:(74/133): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 222 kB 00:00 2024-08-17T02:43:26.742 INFO:teuthology.orchestra.run.smithi123.stdout:(54/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-08-17T02:43:26.767 INFO:teuthology.orchestra.run.smithi123.stdout:(55/133): flex-2.6.4-9.el9.x86_64.rpm 1.0 MB/s | 313 kB 00:00 2024-08-17T02:43:26.808 INFO:teuthology.orchestra.run.smithi100.stdout:(75/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-08-17T02:43:26.825 INFO:teuthology.orchestra.run.smithi100.stdout:(76/133): python3-prettytable-0.7.2-27.el9.noar 338 kB/s | 42 kB 00:00 2024-08-17T02:43:26.825 INFO:teuthology.orchestra.run.smithi123.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 542 kB/s | 45 kB 00:00 2024-08-17T02:43:26.875 INFO:teuthology.orchestra.run.smithi100.stdout:(77/133): python3-packaging-20.9-5.el9.noarch.r 384 kB/s | 77 kB 00:00 2024-08-17T02:43:26.893 INFO:teuthology.orchestra.run.smithi123.stdout:(57/133): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-08-17T02:43:26.952 INFO:teuthology.orchestra.run.smithi123.stdout:(58/133): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-08-17T02:43:26.977 INFO:teuthology.orchestra.run.smithi123.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 304 kB/s | 25 kB 00:00 2024-08-17T02:43:27.000 INFO:teuthology.orchestra.run.smithi100.stdout:(78/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 828 kB/s | 159 kB 00:00 2024-08-17T02:43:27.002 INFO:teuthology.orchestra.run.smithi123.stdout:(60/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 951 kB/s | 47 kB 00:00 2024-08-17T02:43:27.017 INFO:teuthology.orchestra.run.smithi100.stdout:(79/133): python3-pytz-2021.1-5.el9.noarch.rpm 360 kB/s | 51 kB 00:00 2024-08-17T02:43:27.043 INFO:teuthology.orchestra.run.smithi100.stdout:(80/133): python3-pyasn1-modules-0.4.8-6.el9.no 1.3 MB/s | 279 kB 00:00 2024-08-17T02:43:27.044 INFO:teuthology.orchestra.run.smithi123.stdout:(61/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-08-17T02:43:27.069 INFO:teuthology.orchestra.run.smithi123.stdout:(62/133): openblas-0.3.21-2.el9.x86_64.rpm 527 kB/s | 35 kB 00:00 2024-08-17T02:43:27.135 INFO:teuthology.orchestra.run.smithi100.stdout:(81/133): python3-requests-oauthlib-1.3.0-12.el 401 kB/s | 54 kB 00:00 2024-08-17T02:43:27.160 INFO:teuthology.orchestra.run.smithi100.stdout:(82/133): python3-toml-0.10.2-6.el9.noarch.rpm 357 kB/s | 42 kB 00:00 2024-08-17T02:43:27.312 INFO:teuthology.orchestra.run.smithi100.stdout:(83/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 638 kB/s | 96 kB 00:00 2024-08-17T02:43:27.335 INFO:teuthology.orchestra.run.smithi100.stdout:(84/133): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-08-17T02:43:27.436 INFO:teuthology.orchestra.run.smithi100.stdout:(85/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 509 kB/s | 64 kB 00:00 2024-08-17T02:43:27.445 INFO:teuthology.orchestra.run.smithi123.stdout:(63/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-08-17T02:43:27.453 INFO:teuthology.orchestra.run.smithi100.stdout:(86/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 383 kB/s | 45 kB 00:00 2024-08-17T02:43:27.536 INFO:teuthology.orchestra.run.smithi100.stdout:(87/133): liboath-2.6.7-2.el9.x86_64.rpm 583 kB/s | 49 kB 00:00 2024-08-17T02:43:27.553 INFO:teuthology.orchestra.run.smithi100.stdout:(88/133): libunwind-1.6.2-1.el9.x86_64.rpm 4.6 MB/s | 67 kB 00:00 2024-08-17T02:43:27.587 INFO:teuthology.orchestra.run.smithi100.stdout:(89/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.0 MB/s | 309 kB 00:00 2024-08-17T02:43:27.612 INFO:teuthology.orchestra.run.smithi100.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-17T02:43:27.629 INFO:teuthology.orchestra.run.smithi100.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.9 MB/s | 32 kB 00:00 2024-08-17T02:43:27.647 INFO:teuthology.orchestra.run.smithi100.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 850 kB/s | 14 kB 00:00 2024-08-17T02:43:27.680 INFO:teuthology.orchestra.run.smithi100.stdout:(93/133): python3-asyncssh-2.13.2-5.el9.noarch. 4.2 MB/s | 548 kB 00:00 2024-08-17T02:43:27.705 INFO:teuthology.orchestra.run.smithi100.stdout:(94/133): python3-cheroot-8.6.0-4.el9.noarch.rp 2.9 MB/s | 172 kB 00:00 2024-08-17T02:43:27.739 INFO:teuthology.orchestra.run.smithi100.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 6.4 MB/s | 220 kB 00:00 2024-08-17T02:43:27.781 INFO:teuthology.orchestra.run.smithi100.stdout:(96/133): python3-cherrypy-18.6.1-2.el9.noarch. 3.5 MB/s | 358 kB 00:00 2024-08-17T02:43:27.806 INFO:teuthology.orchestra.run.smithi100.stdout:(97/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 160 kB/s | 11 kB 00:00 2024-08-17T02:43:27.831 INFO:teuthology.orchestra.run.smithi100.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 352 kB/s | 18 kB 00:00 2024-08-17T02:43:27.857 INFO:teuthology.orchestra.run.smithi100.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 461 kB/s | 23 kB 00:00 2024-08-17T02:43:27.882 INFO:teuthology.orchestra.run.smithi100.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-08-17T02:43:27.908 INFO:teuthology.orchestra.run.smithi100.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-08-17T02:43:27.933 INFO:teuthology.orchestra.run.smithi100.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 180 kB/s | 9.0 kB 00:00 2024-08-17T02:43:27.958 INFO:teuthology.orchestra.run.smithi100.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 817 kB/s | 41 kB 00:00 2024-08-17T02:43:27.983 INFO:teuthology.orchestra.run.smithi100.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:43:28.009 INFO:teuthology.orchestra.run.smithi100.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:43:28.034 INFO:teuthology.orchestra.run.smithi100.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-17T02:43:28.068 INFO:teuthology.orchestra.run.smithi100.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-17T02:43:28.084 INFO:teuthology.orchestra.run.smithi100.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 1.0 MB/s | 16 kB 00:00 2024-08-17T02:43:28.110 INFO:teuthology.orchestra.run.smithi100.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-17T02:43:28.169 INFO:teuthology.orchestra.run.smithi100.stdout:(110/133): python3-kubernetes-26.1.0-2.el9.noar 4.3 MB/s | 1.0 MB 00:00 2024-08-17T02:43:28.186 INFO:teuthology.orchestra.run.smithi100.stdout:(111/133): python3-repoze-lru-0.7-16.el9.noarch 409 kB/s | 31 kB 00:00 2024-08-17T02:43:28.202 INFO:teuthology.orchestra.run.smithi100.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 3.6 MB/s | 59 kB 00:00 2024-08-17T02:43:28.219 INFO:teuthology.orchestra.run.smithi100.stdout:(113/133): python3-tempora-5.0.0-2.el9.noarch.r 2.1 MB/s | 36 kB 00:00 2024-08-17T02:43:28.379 INFO:teuthology.orchestra.run.smithi100.stdout:(114/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-08-17T02:43:28.404 INFO:teuthology.orchestra.run.smithi100.stdout:(115/133): python3-routes-2.5.1-5.el9.noarch.rp 803 kB/s | 188 kB 00:00 2024-08-17T02:43:28.455 INFO:teuthology.orchestra.run.smithi100.stdout:(116/133): python3-typing-extensions-4.12.2-2.e 318 kB/s | 74 kB 00:00 2024-08-17T02:43:28.488 INFO:teuthology.orchestra.run.smithi100.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-08-17T02:43:28.515 INFO:teuthology.orchestra.run.smithi100.stdout:(118/133): python3-websocket-client-1.2.3-2.el9 825 kB/s | 90 kB 00:00 2024-08-17T02:43:28.531 INFO:teuthology.orchestra.run.smithi100.stdout:(119/133): python3-zc-lockfile-2.0-10.el9.noarc 476 kB/s | 20 kB 00:00 2024-08-17T02:43:28.567 INFO:teuthology.orchestra.run.smithi100.stdout:(120/133): python3-werkzeug-2.0.3-3.el9.1.noarc 3.9 MB/s | 427 kB 00:00 2024-08-17T02:43:28.614 INFO:teuthology.orchestra.run.smithi100.stdout:(121/133): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-17T02:43:28.697 INFO:teuthology.orchestra.run.smithi100.stdout:(122/133): NetworkManager-1.48.2-2.el9.x86_64.r 28 MB/s | 2.3 MB 00:00 2024-08-17T02:43:28.792 INFO:teuthology.orchestra.run.smithi100.stdout:(123/133): NetworkManager-libnm-1.48.2-2.el9.x8 19 MB/s | 1.8 MB 00:00 2024-08-17T02:43:28.840 INFO:teuthology.orchestra.run.smithi100.stdout:(124/133): NetworkManager-team-1.48.2-2.el9.x86 869 kB/s | 41 kB 00:00 2024-08-17T02:43:28.881 INFO:teuthology.orchestra.run.smithi100.stdout:(125/133): NetworkManager-tui-1.48.2-2.el9.x86_ 5.8 MB/s | 247 kB 00:00 2024-08-17T02:43:28.924 INFO:teuthology.orchestra.run.smithi100.stdout:(126/133): elfutils-debuginfod-client-0.191-4.e 876 kB/s | 37 kB 00:00 2024-08-17T02:43:28.974 INFO:teuthology.orchestra.run.smithi100.stdout:(127/133): elfutils-libelf-0.191-4.el9.x86_64.r 4.1 MB/s | 207 kB 00:00 2024-08-17T02:43:29.024 INFO:teuthology.orchestra.run.smithi100.stdout:(128/133): elfutils-libs-0.191-4.el9.x86_64.rpm 5.1 MB/s | 260 kB 00:00 2024-08-17T02:43:29.028 INFO:teuthology.orchestra.run.smithi123.stdout:(64/133): openblas-openmp-0.3.21-2.el9.x86_64.r 2.4 MB/s | 4.7 MB 00:01 2024-08-17T02:43:29.095 INFO:teuthology.orchestra.run.smithi123.stdout:(65/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 2.2 MB/s | 4.4 MB 00:02 2024-08-17T02:43:29.099 INFO:teuthology.orchestra.run.smithi100.stdout:(129/133): openssl-3.2.2-2.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-08-17T02:43:29.150 INFO:teuthology.orchestra.run.smithi100.stdout:(130/133): librados2-17.2.7-1375.g2577e813.el9. 5.0 MB/s | 3.1 MB 00:00 2024-08-17T02:43:29.208 INFO:teuthology.orchestra.run.smithi100.stdout:(131/133): librbd1-17.2.7-1375.g2577e813.el9.x8 4.6 MB/s | 2.9 MB 00:00 2024-08-17T02:43:29.212 INFO:teuthology.orchestra.run.smithi123.stdout:(66/133): python3-devel-3.9.18-3.el9.x86_64.rpm 1.3 MB/s | 244 kB 00:00 2024-08-17T02:43:29.259 INFO:teuthology.orchestra.run.smithi100.stdout:(132/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2024-08-17T02:43:29.279 INFO:teuthology.orchestra.run.smithi123.stdout:(67/133): python3-jinja2-2.11.3-6.el9.noarch.rp 1.3 MB/s | 248 kB 00:00 2024-08-17T02:43:29.304 INFO:teuthology.orchestra.run.smithi123.stdout:(68/133): python3-jsonpatch-1.21-16.el9.noarch. 279 kB/s | 26 kB 00:00 2024-08-17T02:43:29.308 INFO:teuthology.orchestra.run.smithi100.stdout:(133/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 6.8 MB/s | 1.1 MB 00:00 2024-08-17T02:43:29.313 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:43:29.314 INFO:teuthology.orchestra.run.smithi100.stdout:Total 21 MB/s | 206 MB 00:09 2024-08-17T02:43:29.338 INFO:teuthology.orchestra.run.smithi123.stdout:(69/133): python3-jsonpointer-2.0-4.el9.noarch. 329 kB/s | 19 kB 00:00 2024-08-17T02:43:29.405 INFO:teuthology.orchestra.run.smithi123.stdout:(70/133): python3-markupsafe-1.1.1-12.el9.x86_6 521 kB/s | 35 kB 00:00 2024-08-17T02:43:29.438 INFO:teuthology.orchestra.run.smithi123.stdout:(71/133): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-08-17T02:43:29.622 INFO:teuthology.orchestra.run.smithi123.stdout:(72/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 250 kB 00:00 2024-08-17T02:43:29.764 INFO:teuthology.orchestra.run.smithi123.stdout:(73/133): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-08-17T02:43:29.856 INFO:teuthology.orchestra.run.smithi123.stdout:(74/133): python3-packaging-20.9-5.el9.noarch.r 841 kB/s | 77 kB 00:00 2024-08-17T02:43:29.915 INFO:teuthology.orchestra.run.smithi123.stdout:(75/133): python3-prettytable-0.7.2-27.el9.noar 727 kB/s | 42 kB 00:00 2024-08-17T02:43:30.023 INFO:teuthology.orchestra.run.smithi123.stdout:(76/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-08-17T02:43:30.190 INFO:teuthology.orchestra.run.smithi123.stdout:(77/133): python3-pyasn1-modules-0.4.8-6.el9.no 1.6 MB/s | 279 kB 00:00 2024-08-17T02:43:30.240 INFO:teuthology.orchestra.run.smithi123.stdout:(78/133): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-17T02:43:30.291 INFO:teuthology.orchestra.run.smithi123.stdout:(79/133): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-08-17T02:43:30.599 INFO:teuthology.orchestra.run.smithi123.stdout:(80/133): python3-babel-2.9.1-2.el9.noarch.rpm 1.9 MB/s | 6.0 MB 00:03 2024-08-17T02:43:30.658 INFO:teuthology.orchestra.run.smithi123.stdout:(81/133): python3-toml-0.10.2-6.el9.noarch.rpm 719 kB/s | 42 kB 00:00 2024-08-17T02:43:30.833 INFO:teuthology.orchestra.run.smithi123.stdout:(82/133): socat-1.7.4.1-6.el9.x86_64.rpm 1.7 MB/s | 304 kB 00:00 2024-08-17T02:43:30.917 INFO:teuthology.orchestra.run.smithi123.stdout:(83/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.1 MB/s | 96 kB 00:00 2024-08-17T02:43:30.993 INFO:teuthology.orchestra.run.smithi123.stdout:(84/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 844 kB/s | 64 kB 00:00 2024-08-17T02:43:31.015 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-08-17T02:43:31.043 INFO:teuthology.orchestra.run.smithi123.stdout:(85/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-08-17T02:43:31.127 INFO:teuthology.orchestra.run.smithi123.stdout:(86/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 3.6 MB/s | 309 kB 00:00 2024-08-17T02:43:31.169 INFO:teuthology.orchestra.run.smithi123.stdout:(87/133): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-08-17T02:43:31.194 INFO:teuthology.orchestra.run.smithi123.stdout:(88/133): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-08-17T02:43:31.222 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-08-17T02:43:31.222 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-08-17T02:43:31.229 INFO:teuthology.orchestra.run.smithi123.stdout:(89/133): python3-asyncssh-2.13.2-5.el9.noarch. 16 MB/s | 548 kB 00:00 2024-08-17T02:43:31.253 INFO:teuthology.orchestra.run.smithi123.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-17T02:43:31.278 INFO:teuthology.orchestra.run.smithi123.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-08-17T02:43:31.303 INFO:teuthology.orchestra.run.smithi123.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 572 kB/s | 14 kB 00:00 2024-08-17T02:43:31.329 INFO:teuthology.orchestra.run.smithi123.stdout:(93/133): python3-cheroot-8.6.0-4.el9.noarch.rp 6.8 MB/s | 172 kB 00:00 2024-08-17T02:43:31.362 INFO:teuthology.orchestra.run.smithi123.stdout:(94/133): python3-cherrypy-18.6.1-2.el9.noarch. 11 MB/s | 358 kB 00:00 2024-08-17T02:43:31.388 INFO:teuthology.orchestra.run.smithi123.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 8.7 MB/s | 220 kB 00:00 2024-08-17T02:43:31.413 INFO:teuthology.orchestra.run.smithi123.stdout:(96/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 426 kB/s | 11 kB 00:00 2024-08-17T02:43:31.438 INFO:teuthology.orchestra.run.smithi123.stdout:(97/133): python3-jaraco-classes-3.2.1-5.el9.no 717 kB/s | 18 kB 00:00 2024-08-17T02:43:31.464 INFO:teuthology.orchestra.run.smithi123.stdout:(98/133): python3-jaraco-collections-3.0.0-8.el 926 kB/s | 23 kB 00:00 2024-08-17T02:43:31.489 INFO:teuthology.orchestra.run.smithi123.stdout:(99/133): python3-jaraco-functools-3.5.0-2.el9. 791 kB/s | 19 kB 00:00 2024-08-17T02:43:31.539 INFO:teuthology.orchestra.run.smithi123.stdout:(100/133): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-08-17T02:43:31.565 INFO:teuthology.orchestra.run.smithi123.stdout:(101/133): python3-jwt+crypto-2.4.0-1.el9.noarc 362 kB/s | 9.0 kB 00:00 2024-08-17T02:43:31.590 INFO:teuthology.orchestra.run.smithi123.stdout:(102/133): python3-jwt-2.4.0-1.el9.noarch.rpm 1.6 MB/s | 41 kB 00:00 2024-08-17T02:43:31.632 INFO:teuthology.orchestra.run.smithi123.stdout:(103/133): python3-kubernetes-26.1.0-2.el9.noar 24 MB/s | 1.0 MB 00:00 2024-08-17T02:43:31.657 INFO:teuthology.orchestra.run.smithi123.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:43:31.682 INFO:teuthology.orchestra.run.smithi123.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:43:31.758 INFO:teuthology.orchestra.run.smithi123.stdout:(106/133): python3-numpy-1.20.1-5.el9.x86_64.rp 2.2 MB/s | 5.1 MB 00:02 2024-08-17T02:43:31.816 INFO:teuthology.orchestra.run.smithi123.stdout:(107/133): python3-natsort-7.1.1-5.el9.noarch.r 432 kB/s | 58 kB 00:00 2024-08-17T02:43:31.841 INFO:teuthology.orchestra.run.smithi123.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 736 kB/s | 16 kB 00:00 2024-08-17T02:43:31.867 INFO:teuthology.orchestra.run.smithi123.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-17T02:43:31.909 INFO:teuthology.orchestra.run.smithi123.stdout:(110/133): python3-repoze-lru-0.7-16.el9.noarch 741 kB/s | 31 kB 00:00 2024-08-17T02:43:31.942 INFO:teuthology.orchestra.run.smithi123.stdout:(111/133): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-08-17T02:43:31.968 INFO:teuthology.orchestra.run.smithi123.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-17T02:43:31.993 INFO:teuthology.orchestra.run.smithi123.stdout:(113/133): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-08-17T02:43:32.018 INFO:teuthology.orchestra.run.smithi123.stdout:(114/133): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-08-17T02:43:32.044 INFO:teuthology.orchestra.run.smithi123.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-17T02:43:32.069 INFO:teuthology.orchestra.run.smithi123.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-17T02:43:32.095 INFO:teuthology.orchestra.run.smithi123.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-17T02:43:32.119 INFO:teuthology.orchestra.run.smithi123.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 815 kB/s | 20 kB 00:00 2024-08-17T02:43:32.153 INFO:teuthology.orchestra.run.smithi123.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-08-17T02:43:32.204 INFO:teuthology.orchestra.run.smithi123.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-08-17T02:43:32.554 INFO:teuthology.orchestra.run.smithi123.stdout:(121/133): librados2-17.2.7-1375.g2577e813.el9. 7.7 MB/s | 3.1 MB 00:00 2024-08-17T02:43:32.721 INFO:teuthology.orchestra.run.smithi123.stdout:(122/133): librbd1-17.2.7-1375.g2577e813.el9.x8 5.7 MB/s | 2.9 MB 00:00 2024-08-17T02:43:32.796 INFO:teuthology.orchestra.run.smithi123.stdout:(123/133): NetworkManager-1.48.2-2.el9.x86_64.r 9.6 MB/s | 2.3 MB 00:00 2024-08-17T02:43:32.838 INFO:teuthology.orchestra.run.smithi123.stdout:(124/133): NetworkManager-team-1.48.2-2.el9.x86 984 kB/s | 41 kB 00:00 2024-08-17T02:43:32.880 INFO:teuthology.orchestra.run.smithi123.stdout:(125/133): NetworkManager-tui-1.48.2-2.el9.x86_ 5.8 MB/s | 247 kB 00:00 2024-08-17T02:43:32.922 INFO:teuthology.orchestra.run.smithi123.stdout:(126/133): elfutils-debuginfod-client-0.191-4.e 885 kB/s | 37 kB 00:00 2024-08-17T02:43:33.000 INFO:teuthology.orchestra.run.smithi123.stdout:(127/133): NetworkManager-libnm-1.48.2-2.el9.x8 6.5 MB/s | 1.8 MB 00:00 2024-08-17T02:43:33.031 INFO:teuthology.orchestra.run.smithi123.stdout:(128/133): elfutils-libelf-0.191-4.el9.x86_64.r 1.9 MB/s | 207 kB 00:00 2024-08-17T02:43:33.056 INFO:teuthology.orchestra.run.smithi123.stdout:(129/133): elfutils-libs-0.191-4.el9.x86_64.rpm 4.5 MB/s | 260 kB 00:00 2024-08-17T02:43:33.098 INFO:teuthology.orchestra.run.smithi123.stdout:(130/133): openssl-3.2.2-2.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-08-17T02:43:33.165 INFO:teuthology.orchestra.run.smithi123.stdout:(131/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-08-17T02:43:33.199 INFO:teuthology.orchestra.run.smithi123.stdout:(132/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-08-17T02:43:33.326 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-08-17T02:43:33.327 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-08-17T02:43:38.882 INFO:teuthology.orchestra.run.smithi123.stdout:(133/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.9 MB/s | 16 MB 00:08 2024-08-17T02:43:38.887 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:43:38.887 INFO:teuthology.orchestra.run.smithi123.stdout:Total 11 MB/s | 206 MB 00:19 2024-08-17T02:43:39.018 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-08-17T02:43:39.122 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:43:39.173 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:43:39.238 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:43:39.283 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:43:39.315 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:43:39.377 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:43:39.700 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:43:39.807 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:43:39.951 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:43:39.983 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:43:40.093 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:43:40.568 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:43:40.601 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:43:40.632 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-08-17T02:43:40.698 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:43:40.777 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:43:40.803 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:43:40.841 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-08-17T02:43:40.841 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-08-17T02:43:40.905 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:43:40.954 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:43:41.088 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:43:41.378 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:43:41.596 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:43:41.674 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:43:41.783 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:43:41.891 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:43:42.224 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:43:42.263 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:43:42.307 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:43:42.389 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:43:42.440 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:43:42.474 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:43:42.561 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:43:42.626 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:43:42.661 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:43:42.707 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:43:42.786 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:43:42.823 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:43:42.891 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:43:42.923 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-08-17T02:43:42.923 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-08-17T02:43:42.985 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:43:43.149 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:43:43.214 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:43:43.860 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:43:43.956 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:43:44.003 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:43:44.052 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:43:44.096 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:43:44.164 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:43:44.439 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:43:44.642 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:43:44.703 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:43:44.787 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:43:44.835 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:43:44.871 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:43:44.929 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:43:44.982 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:43:45.032 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:43:45.204 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:43:45.248 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:43:45.292 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:43:45.409 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:43:45.465 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:43:45.513 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:43:45.547 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:43:45.584 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:43:45.622 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:43:45.659 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:43:45.694 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:43:45.735 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:43:45.778 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:43:45.811 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:43:45.846 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:43:45.896 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:43:46.018 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:43:46.105 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:43:46.999 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:43:47.053 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:43:47.087 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:43:47.201 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:43:47.245 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:43:47.475 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:43:47.509 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:43:47.609 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:43:48.415 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:43:48.555 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:43:48.888 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-08-17T02:43:49.020 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:43:49.072 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:43:49.138 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:43:49.190 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:43:49.223 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:43:49.280 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:43:49.608 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:43:49.746 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:43:49.892 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:43:49.916 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:43:50.030 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:43:50.162 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:43:50.271 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:43:50.308 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:43:50.359 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:43:50.503 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:43:50.534 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:43:50.624 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:43:50.678 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:43:50.684 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:43:50.719 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:43:50.727 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:43:50.826 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:43:50.854 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:43:50.866 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:43:50.895 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:43:51.032 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:43:51.298 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:43:51.543 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:43:51.620 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:43:51.730 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:43:52.043 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:43:52.586 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:43:52.635 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:43:52.679 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:43:52.761 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:43:52.821 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:43:52.858 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:43:52.963 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:43:53.031 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:43:53.068 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:43:53.118 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:43:53.224 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:43:53.262 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:43:53.308 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:43:53.397 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:43:53.468 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:43:53.508 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:43:53.559 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:43:53.619 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:43:54.105 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:43:54.145 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:43:54.245 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:43:54.275 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:43:54.275 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:43:54.275 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:43:54.275 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:43:54.305 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:43:54.344 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:43:54.396 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:43:54.559 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:43:54.627 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:43:54.664 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:43:54.708 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:43:54.748 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:43:54.808 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:43:54.893 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:43:54.965 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:43:55.002 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:43:55.061 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:43:55.113 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:43:55.171 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:43:55.341 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:43:55.387 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:43:55.430 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:43:55.548 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:43:55.596 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:43:55.640 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:43:55.695 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:43:55.731 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:43:55.770 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:43:55.807 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:43:55.842 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:43:55.875 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:43:55.918 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:43:55.951 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:43:55.986 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:43:56.071 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:43:56.207 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:43:56.265 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:43:57.134 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:43:57.185 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:43:57.219 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:43:57.332 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:43:57.377 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:43:57.601 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:43:57.649 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:43:57.741 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:43:58.543 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:43:58.694 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:44:00.235 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:44:00.336 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:44:00.397 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:44:00.430 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:44:00.743 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:44:00.775 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:44:00.874 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:44:00.902 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:44:03.551 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:44:03.590 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:44:04.182 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:44:04.235 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:44:04.374 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:44:04.374 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:44:04.374 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:44:04.374 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:04.411 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:44:06.224 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:44:06.224 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2024-08-17T02:44:06.224 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2024-08-17T02:44:06.225 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2024-08-17T02:44:06.225 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2024-08-17T02:44:06.225 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2024-08-17T02:44:06.225 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /root 2024-08-17T02:44:06.225 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2024-08-17T02:44:06.225 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:06.425 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:44:06.468 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:44:06.468 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:06.468 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:44:06.468 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:07.922 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:44:07.977 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:44:07.977 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:07.977 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:44:07.977 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:44:07.977 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:44:07.977 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:08.220 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:44:08.271 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:44:08.271 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:08.271 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:44:08.271 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:44:08.271 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:44:08.272 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:08.671 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:44:08.721 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:44:08.721 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:08.721 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:44:08.721 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:44:08.721 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:44:08.722 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:08.846 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:44:08.906 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:44:08.979 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:44:09.204 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:44:09.258 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:44:09.343 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:44:09.461 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:44:09.628 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:44:09.679 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:44:09.705 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:44:09.741 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:44:09.781 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:44:09.807 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:44:10.301 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:44:10.339 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:44:10.369 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:44:10.430 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:44:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:44:11.613 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:44:11.655 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:44:12.736 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:44:12.772 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:44:12.911 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:44:13.066 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:44:13.099 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:44:13.150 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:44:13.150 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:13.150 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:44:13.150 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:44:13.150 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:44:13.150 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:13.225 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:44:13.251 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:44:13.342 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:44:13.414 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:44:14.724 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:44:14.761 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:44:14.858 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:44:14.858 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:14.858 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:44:14.858 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:44:14.858 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:44:14.858 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:14.904 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:44:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:44:14.953 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:14.953 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:44:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:15.013 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:44:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:44:15.064 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:15.064 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:44:15.064 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:44:15.064 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:44:15.064 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:44:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:44:15.431 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:15.431 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:44:15.432 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:44:15.432 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:44:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:16.417 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:44:16.417 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /sys 2024-08-17T02:44:16.417 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /proc 2024-08-17T02:44:16.417 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /mnt 2024-08-17T02:44:16.417 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /var/tmp 2024-08-17T02:44:16.417 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /home 2024-08-17T02:44:16.418 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /root 2024-08-17T02:44:16.418 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /tmp 2024-08-17T02:44:16.418 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:16.619 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:44:16.655 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:44:16.655 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:16.656 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:44:16.656 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:18.104 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:44:18.161 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:44:18.162 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:18.162 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:44:18.162 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:44:18.162 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:44:18.162 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:18.388 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:44:18.439 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:44:18.439 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:18.439 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:44:18.439 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:44:18.439 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:44:18.439 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:18.838 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:44:18.889 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:44:18.889 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:18.889 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:44:18.889 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:44:18.890 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:44:18.890 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:19.021 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:44:19.081 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:44:19.146 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:44:19.369 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:44:19.434 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:44:19.518 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:44:19.618 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:44:19.777 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:44:19.838 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:44:19.864 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:44:19.900 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:44:19.940 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:44:19.966 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:44:20.118 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:44:20.159 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:44:20.204 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:44:20.274 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:44:20.309 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:44:20.342 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:44:20.382 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:44:20.413 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:44:20.461 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:44:20.544 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:44:20.582 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:44:20.620 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:44:20.680 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:44:20.712 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:44:21.757 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:44:21.855 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:44:21.897 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:44:22.016 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:44:22.074 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:44:22.121 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:44:22.249 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:44:22.285 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:44:22.310 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:44:22.336 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:44:22.364 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:44:22.364 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:44:22.464 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:44:22.505 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:44:22.505 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:44:22.615 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:44:22.639 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:44:22.659 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:44:22.660 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:44:22.908 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:44:22.908 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:44:22.976 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:44:23.006 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:44:23.019 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:44:23.050 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:44:23.085 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:44:23.142 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:44:23.157 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:44:23.292 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:44:23.333 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:44:23.361 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:44:23.361 INFO:teuthology.orchestra.run.smithi100.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:44:23.361 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:23.385 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:44:23.385 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:23.385 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:44:23.385 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:44:23.385 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:44:23.385 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:23.442 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:44:23.469 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:44:23.568 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:44:23.627 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:44:24.967 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:44:25.011 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:44:25.140 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:44:25.141 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:25.141 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:44:25.141 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:44:25.141 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:44:25.141 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:25.187 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:44:25.237 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:44:25.238 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:25.238 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:44:25.238 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:25.296 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:44:25.347 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:44:25.347 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:25.347 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:44:25.347 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:44:25.347 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:44:25.347 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:25.663 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:44:25.715 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:44:25.715 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:25.715 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:44:25.715 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:44:25.715 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:44:25.715 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:28.541 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:44:28.541 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:44:28.541 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:44:28.541 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:44:28.541 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:44:28.541 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:44:28.541 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:44:28.541 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:44:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:44:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:44:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:44:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:44:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:44:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:44:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:44:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:44:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:44:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:44:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:44:28.542 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:44:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:44:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:44:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:44:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:44:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:44:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:44:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:44:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:44:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:44:28.543 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:44:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:44:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:44:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:44:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:44:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:44:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:44:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:44:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:44:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:44:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:44:28.544 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:44:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:44:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:44:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:44:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:44:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:44:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:44:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:44:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:44:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:44:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:44:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:44:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:44:28.545 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:44:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:44:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:44:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:44:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:44:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:44:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:44:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:44:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:44:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:44:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:44:28.546 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:44:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:44:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:44:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:44:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:44:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:44:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:44:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:44:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:44:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:44:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:44:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:44:28.547 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:44:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:44:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:44:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:44:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:44:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:44:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:44:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:44:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:44:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:44:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:44:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:44:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:44:28.548 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:44:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:44:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:44:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:44:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:44:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:44:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:44:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:44:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:44:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:44:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:44:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:44:28.549 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:44:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:44:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:44:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:44:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:44:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:44:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:44:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:44:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:44:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:44:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:44:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:44:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:44:28.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:44:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:44:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:44:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:44:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:44:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:44:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:44:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:44:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:44:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:44:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:44:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:44:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:44:28.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:44:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:44:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:44:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:44:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:44:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:44:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:44:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:44:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:44:28.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:44:28.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:44:28.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:44:28.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:44:28.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:44:28.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:44:28.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:44:28.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:44:30.392 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:44:30.434 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:44:30.477 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:44:30.492 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:44:30.492 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:30.492 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-08-17T02:44:30.492 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:44:30.492 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:44:30.492 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:44:30.492 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:44:30.492 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:44:30.492 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:44:30.492 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:44:30.493 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.493 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.493 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:44:30.493 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:44:30.493 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:44:30.493 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-08-17T02:44:30.493 INFO:teuthology.orchestra.run.smithi100.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:44:30.493 INFO:teuthology.orchestra.run.smithi100.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:44:30.493 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.493 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.493 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.493 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.493 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:30.494 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.494 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.494 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.494 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:30.494 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:30.494 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:30.494 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:30.494 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:30.494 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.494 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.494 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:30.494 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.495 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.495 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.495 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:30.495 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:30.495 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.495 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:30.495 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:44:30.495 INFO:teuthology.orchestra.run.smithi100.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:44:30.495 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:44:30.495 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:44:30.495 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:44:30.495 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:44:30.495 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:44:30.496 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:44:30.496 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.496 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.496 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.496 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:44:30.496 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:44:30.496 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:44:30.496 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:44:30.496 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:44:30.496 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.496 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.496 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:44:30.496 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.497 INFO:teuthology.orchestra.run.smithi100.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:44:30.497 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:44:30.497 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:44:30.497 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:44:30.497 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:44:30.497 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:44:30.497 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:44:30.497 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:44:30.497 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:44:30.497 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:44:30.497 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:44:30.497 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:44:30.497 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.498 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.498 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.498 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:44:30.498 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:44:30.498 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:44:30.498 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:44:30.498 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:44:30.498 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:44:30.498 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:44:30.498 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:44:30.498 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:44:30.498 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:44:30.499 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:44:30.499 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:44:30.499 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:44:30.499 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:44:30.499 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:44:30.499 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:44:30.499 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:44:30.499 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:44:30.499 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:44:30.499 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:44:30.499 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:44:30.499 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:44:30.499 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:44:30.500 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:44:30.500 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:44:30.500 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:44:30.500 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:44:30.500 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:44:30.500 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:44:30.500 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:44:30.500 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:44:30.500 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:44:30.500 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:44:30.500 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:44:30.500 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:44:30.501 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:44:30.501 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.501 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.501 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:44:30.501 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:44:30.501 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:44:30.501 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.501 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:44:30.501 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:44:30.501 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:44:30.501 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:44:30.501 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:44:30.502 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:44:30.502 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:44:30.502 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:44:30.502 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:44:30.502 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:44:30.502 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:44:30.502 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.502 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.502 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:30.502 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:44:30.502 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:44:30.502 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:44:30.503 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:44:30.503 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:44:30.503 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:30.503 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-08-17T02:44:30.532 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:44:30.565 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:44:30.600 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:44:30.640 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:44:30.670 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:44:30.719 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:44:31.076 DEBUG:teuthology.parallel:result is None 2024-08-17T02:44:32.036 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:44:32.275 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:44:32.397 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:44:32.445 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:44:32.562 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:44:32.600 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:44:32.625 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:44:32.682 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:44:32.721 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:44:32.721 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:44:32.820 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:44:32.853 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:44:32.853 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:44:32.963 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:44:32.987 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:44:33.009 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:44:33.009 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:44:33.256 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:44:33.256 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:44:33.369 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:44:33.423 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:44:33.454 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:44:33.530 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:44:33.735 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:44:33.735 INFO:teuthology.orchestra.run.smithi123.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:44:33.735 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:38.825 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:44:38.826 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:44:38.826 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:44:38.826 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:44:38.828 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:44:38.828 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:44:38.828 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:44:38.829 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:44:38.829 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:44:38.829 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:44:38.829 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:44:38.829 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:44:38.829 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:44:38.829 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:44:38.829 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:44:38.829 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:44:38.829 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:44:38.829 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:44:38.829 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:44:38.830 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:44:38.830 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:44:38.830 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:44:38.830 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:44:38.830 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:44:38.830 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:44:38.830 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:44:38.830 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:44:38.842 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:44:38.842 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:44:38.842 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:44:38.843 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:44:38.843 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:44:38.843 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:44:38.843 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:44:38.843 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:44:38.843 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:44:38.843 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:44:38.843 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:44:38.843 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:44:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:44:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:44:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:44:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:44:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:44:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:44:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:44:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:44:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:44:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:44:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:44:38.845 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:44:38.845 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:44:38.845 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:44:38.845 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:44:38.845 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:44:38.845 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:44:38.845 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:44:38.846 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:44:38.846 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:44:38.846 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:44:38.846 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:44:38.846 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:44:38.846 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:44:38.846 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:44:38.846 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:44:38.846 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:44:38.846 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:44:38.847 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:44:38.847 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:44:38.847 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:44:38.847 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:44:38.847 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:44:38.847 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:44:38.847 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:44:38.847 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:44:38.847 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:44:38.847 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:44:38.847 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:44:38.847 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:44:38.848 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:44:38.848 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:44:38.848 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:44:38.848 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:44:38.848 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:44:38.848 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:44:38.848 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:44:38.848 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:44:38.848 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:44:38.848 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:44:38.849 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:44:38.849 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:44:38.849 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:44:38.849 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:44:38.849 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:44:38.849 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:44:38.849 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:44:38.849 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:44:38.849 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:44:38.849 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:44:38.849 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:44:38.850 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:44:38.850 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:44:38.850 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:44:38.850 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:44:38.850 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:44:38.850 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:44:38.850 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:44:38.850 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:44:38.850 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:44:38.850 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:44:38.850 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:44:38.850 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:44:38.850 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:44:38.851 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:44:38.851 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:44:38.851 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:44:38.851 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:44:38.851 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:44:38.851 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:44:38.851 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:44:38.851 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:44:38.851 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:44:38.851 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:44:38.851 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:44:38.851 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:44:38.851 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:44:38.852 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:44:38.852 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:44:38.852 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:44:38.852 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:44:38.852 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:44:38.852 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:44:38.852 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:44:38.852 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:44:38.852 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:44:38.853 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:44:38.853 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:44:38.853 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:44:38.853 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:44:38.853 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:44:38.854 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:44:38.854 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:44:38.854 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:44:38.854 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:44:40.912 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:44:40.913 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:40.913 INFO:teuthology.orchestra.run.smithi123.stdout:Upgraded: 2024-08-17T02:44:40.913 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:44:40.913 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:44:40.913 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:44:40.913 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:44:40.913 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:44:40.913 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:44:40.913 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:44:40.913 INFO:teuthology.orchestra.run.smithi123.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.913 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.914 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:44:40.914 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:44:40.914 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:44:40.914 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-08-17T02:44:40.914 INFO:teuthology.orchestra.run.smithi123.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:44:40.914 INFO:teuthology.orchestra.run.smithi123.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:44:40.914 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.914 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.914 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.914 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.914 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:40.914 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.915 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.915 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.915 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:40.915 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:40.915 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:40.915 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:40.915 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:40.915 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.915 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.915 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:40.915 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.915 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.915 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.916 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:40.916 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:40.916 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.916 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:40.916 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:44:40.916 INFO:teuthology.orchestra.run.smithi123.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:44:40.916 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:44:40.916 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:44:40.916 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:44:40.916 INFO:teuthology.orchestra.run.smithi123.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:44:40.916 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:44:40.916 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:44:40.917 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.918 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.918 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.918 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:44:40.918 INFO:teuthology.orchestra.run.smithi123.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:44:40.918 INFO:teuthology.orchestra.run.smithi123.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:44:40.918 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:44:40.918 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:44:40.918 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.918 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.918 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:44:40.918 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.918 INFO:teuthology.orchestra.run.smithi123.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:44:40.919 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:44:40.919 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:44:40.919 INFO:teuthology.orchestra.run.smithi123.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:44:40.919 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:44:40.919 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:44:40.919 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:44:40.919 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:44:40.919 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:44:40.919 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:44:40.919 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:44:40.919 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:44:40.919 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.919 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.920 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.920 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:44:40.920 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:44:40.920 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:44:40.920 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:44:40.920 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:44:40.920 INFO:teuthology.orchestra.run.smithi123.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:44:40.920 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:44:40.921 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:44:40.921 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:44:40.921 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:44:40.921 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:44:40.921 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:44:40.921 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:44:40.921 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:44:40.921 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:44:40.921 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:44:40.921 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:44:40.921 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:44:40.921 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:44:40.921 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:44:40.922 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:44:40.922 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:44:40.922 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:44:40.922 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:44:40.922 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:44:40.922 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:44:40.922 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:44:40.922 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:44:40.922 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:44:40.922 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:44:40.922 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:44:40.922 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:44:40.922 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:44:40.923 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:44:40.923 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:44:40.923 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:44:40.923 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.923 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.923 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:44:40.923 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:44:40.923 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:44:40.923 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.923 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:44:40.923 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:44:40.923 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:44:40.923 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:44:40.924 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:44:40.924 INFO:teuthology.orchestra.run.smithi123.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:44:40.924 INFO:teuthology.orchestra.run.smithi123.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:44:40.924 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:44:40.924 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:44:40.924 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:44:40.924 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:44:40.924 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.925 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.925 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:40.925 INFO:teuthology.orchestra.run.smithi123.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:44:40.925 INFO:teuthology.orchestra.run.smithi123.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:44:40.925 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:44:40.925 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:44:40.926 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:44:40.926 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:40.926 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-08-17T02:44:41.609 DEBUG:teuthology.parallel:result is None 2024-08-17T02:44:41.609 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:44:41.768 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:44:41.819 INFO:teuthology.orchestra.run.smithi100.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:44:41.819 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:44:41.820 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:44:41.822 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:44:41.966 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:44:42.012 INFO:teuthology.orchestra.run.smithi123.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:44:42.013 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:44:42.013 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:44:42.015 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-17T02:44:42.015 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:44:42.015 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:44:42.079 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:44:42.079 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:44:42.137 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-17T02:44:42.137 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:44:42.138 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:44:42.197 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:44:42.294 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:44:42.294 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:44:42.350 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:44:42.449 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-17T02:44:42.449 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:44:42.449 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:44:42.505 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:44:42.600 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:44:42.600 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:44:42.658 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:44:42.753 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-17T02:44:42.754 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:44:42.754 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:44:42.811 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:44:42.906 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:44:42.906 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:44:42.962 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:44:43.060 INFO:teuthology.run_tasks:Running task ceph... 2024-08-17T02:44:43.148 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-17T02:44:43.148 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /var/log/ceph 2024-08-17T02:44:43.152 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 777 /var/log/ceph 2024-08-17T02:44:43.207 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-17T02:44:43.208 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:44:43.212 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:44:43.266 INFO:tasks.ceph:Creating extra log directories... 2024-08-17T02:44:43.266 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:44:43.271 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:44:43.332 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-17T02:44:43.332 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-17T02:44:43.332 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-17T02:44:43.333 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:44:43.333 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:44:43.367 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:44:43.539 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:44:43.595 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:44:43.596 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:44:43.630 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:44:43.803 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:44:43.863 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-17T02:44:43.864 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-17T02:44:43.864 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858291', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7858291', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'targets': {'smithi100.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC1MnRoeqC0usnB9o3wA6Sg6bKE2Vzqcfax8+FGWlyWW381xYCKdK0YF5G7xSzgdcb7oduJZr8K26Q35OSbVAYM=', 'smithi123.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIgTYYPTXso6hK66VhnHfRB+0LWgAL4sDhUZmncXVGWSswxWrLtUt65BajKtqZ5+znAItqUhL+za8b2ZvWBmIAc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_01:10:27', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-17T02:44:43.865 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:44:43.869 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:44:43.904 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:44:43.945 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:44:44.004 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:44:44.004 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:44:44.040 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:44:44.040 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2024-08-17T02:44:44.116 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:44:44.116 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:44:44.116 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 640 Links: 1 2024-08-17T02:44:44.116 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:44:44.116 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:44:44.116 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-08-17 02:44:23.697853674 +0000 2024-08-17T02:44:44.116 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-08-17 02:42:06.061065322 +0000 2024-08-17T02:44:44.117 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-08-17 02:42:06.061065322 +0000 2024-08-17T02:44:44.117 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-08-17 02:42:06.061065322 +0000 2024-08-17T02:44:44.117 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:44:44.209 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-08-17T02:44:44.209 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-08-17T02:44:44.209 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000280269 s, 1.8 MB/s 2024-08-17T02:44:44.212 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:44:44.249 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2024-08-17T02:44:44.324 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:44:44.324 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:44:44.324 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 657 Links: 1 2024-08-17T02:44:44.324 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:44:44.325 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:44:44.325 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-08-17 02:44:23.698853647 +0000 2024-08-17T02:44:44.325 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-08-17 02:42:06.520053150 +0000 2024-08-17T02:44:44.325 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-08-17 02:42:06.520053150 +0000 2024-08-17T02:44:44.325 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-08-17 02:42:06.520053150 +0000 2024-08-17T02:44:44.325 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:44:44.417 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-08-17T02:44:44.417 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-08-17T02:44:44.417 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000278927 s, 1.8 MB/s 2024-08-17T02:44:44.420 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:44:44.457 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2024-08-17T02:44:44.533 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:44:44.533 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:44:44.533 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 676 Links: 1 2024-08-17T02:44:44.533 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:44:44.533 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:44:44.533 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-08-17 02:44:23.699853621 +0000 2024-08-17T02:44:44.533 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-08-17 02:42:07.001040395 +0000 2024-08-17T02:44:44.533 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-08-17 02:42:07.001040395 +0000 2024-08-17T02:44:44.533 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-08-17 02:42:07.001040395 +0000 2024-08-17T02:44:44.534 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:44:44.626 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-08-17T02:44:44.626 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-08-17T02:44:44.626 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.00030114 s, 1.7 MB/s 2024-08-17T02:44:44.628 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:44:44.665 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2024-08-17T02:44:44.741 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:44:44.741 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:44:44.742 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 694 Links: 1 2024-08-17T02:44:44.742 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:44:44.742 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:44:44.742 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-08-17 02:44:23.699853621 +0000 2024-08-17T02:44:44.742 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-08-17 02:42:07.470027958 +0000 2024-08-17T02:44:44.742 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-08-17 02:42:07.470027958 +0000 2024-08-17T02:44:44.742 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-08-17 02:42:07.470027958 +0000 2024-08-17T02:44:44.742 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:44:44.833 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-08-17T02:44:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-08-17T02:44:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000312614 s, 1.6 MB/s 2024-08-17T02:44:44.836 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:44:44.872 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:44:44.873 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:44:44.873 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:44:44.911 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:44:44.912 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_1 2024-08-17T02:44:44.990 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:44:44.990 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:44:44.990 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 638 Links: 1 2024-08-17T02:44:44.990 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:44:44.990 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:44:44.991 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-08-17 02:44:34.089061323 +0000 2024-08-17T02:44:44.991 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-08-17 02:42:06.078408109 +0000 2024-08-17T02:44:44.991 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-08-17 02:42:06.078408109 +0000 2024-08-17T02:44:44.991 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-08-17 02:42:06.078408109 +0000 2024-08-17T02:44:44.991 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:44:45.084 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-08-17T02:44:45.085 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-08-17T02:44:45.085 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000323105 s, 1.6 MB/s 2024-08-17T02:44:45.087 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:44:45.124 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_2 2024-08-17T02:44:45.201 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:44:45.201 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:44:45.201 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 657 Links: 1 2024-08-17T02:44:45.201 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:44:45.201 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:44:45.202 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-08-17 02:44:34.090061299 +0000 2024-08-17T02:44:45.202 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-08-17 02:42:06.571396675 +0000 2024-08-17T02:44:45.202 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-08-17 02:42:06.571396675 +0000 2024-08-17T02:44:45.202 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-08-17 02:42:06.571396675 +0000 2024-08-17T02:44:45.202 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:44:45.295 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-08-17T02:44:45.295 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-08-17T02:44:45.295 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000281477 s, 1.8 MB/s 2024-08-17T02:44:45.297 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:44:45.334 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_3 2024-08-17T02:44:45.409 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:44:45.409 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:44:45.409 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 676 Links: 1 2024-08-17T02:44:45.409 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:44:45.409 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:44:45.409 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-08-17 02:44:34.090061299 +0000 2024-08-17T02:44:45.410 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-08-17 02:42:07.045385682 +0000 2024-08-17T02:44:45.410 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-08-17 02:42:07.046385658 +0000 2024-08-17T02:44:45.410 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-08-17 02:42:07.045385682 +0000 2024-08-17T02:44:45.410 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:44:45.501 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-08-17T02:44:45.501 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-08-17T02:44:45.502 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000260393 s, 2.0 MB/s 2024-08-17T02:44:45.504 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:44:45.540 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_4 2024-08-17T02:44:45.617 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:44:45.617 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:44:45.617 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 697 Links: 1 2024-08-17T02:44:45.617 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:44:45.617 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:44:45.617 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-08-17 02:44:34.091061276 +0000 2024-08-17T02:44:45.617 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-08-17 02:42:07.529374457 +0000 2024-08-17T02:44:45.617 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-08-17 02:42:07.529374457 +0000 2024-08-17T02:44:45.617 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-08-17 02:42:07.529374457 +0000 2024-08-17T02:44:45.618 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:44:45.709 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-08-17T02:44:45.709 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-08-17T02:44:45.709 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000273005 s, 1.9 MB/s 2024-08-17T02:44:45.711 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:44:45.748 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:44:45.748 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:44:45.748 INFO:tasks.ceph:Generating config... 2024-08-17T02:44:45.750 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-17T02:44:45.750 INFO:tasks.ceph:[client] debug client = 20 2024-08-17T02:44:45.750 INFO:tasks.ceph:[client] debug ms = 1 2024-08-17T02:44:45.750 INFO:tasks.ceph:[client] pid file = 2024-08-17T02:44:45.750 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-17T02:44:45.750 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-17T02:44:45.750 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-08-17T02:44:45.750 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-17T02:44:45.751 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-17T02:44:45.751 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-17T02:44:45.751 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-17T02:44:45.751 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-17T02:44:45.751 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-17T02:44:45.751 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-17T02:44:45.751 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-17T02:44:45.751 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-17T02:44:45.751 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-17T02:44:45.751 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-17T02:44:45.751 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-17T02:44:45.751 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-17T02:44:45.751 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-17T02:44:45.751 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-17T02:44:45.752 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-17T02:44:45.752 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-17T02:44:45.752 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-17T02:44:45.752 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-17T02:44:45.752 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-17T02:44:45.752 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-17T02:44:45.752 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-17T02:44:45.752 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-17T02:44:45.752 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-17T02:44:45.752 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-17T02:44:45.752 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-17T02:44:45.752 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-17T02:44:45.752 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-17T02:44:45.752 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-17T02:44:45.753 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-17T02:44:45.753 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-17T02:44:45.753 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-17T02:44:45.753 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-17T02:44:45.753 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-17T02:44:45.753 INFO:tasks.ceph:Setting up mon.a... 2024-08-17T02:44:45.753 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-17T02:44:45.839 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.keyring 2024-08-17T02:44:45.844 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-17T02:44:45.924 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:44:45.979 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.100'), ('mon.b', '172.21.15.123'), ('mon.c', '[v2:172.21.15.123:3301,v1:172.21.15.123:6790]')] 2024-08-17T02:44:45.980 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.100,172.21.15.123,[v2:172.21.15.123:3301,v1:172.21.15.123:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-17T02:44:45.981 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:44:45.981 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:44:46.016 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.100 --add b 172.21.15.123 --addv c '[v2:172.21.15.123:3301,v1:172.21.15.123:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:44:46.126 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:44:46.127 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: generated fsid 9fea90ef-12b1-4f23-8013-27074825f754 2024-08-17T02:44:46.127 INFO:teuthology.orchestra.run.smithi100.stdout:setting min_mon_release = octopus 2024-08-17T02:44:46.127 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 0 2024-08-17T02:44:46.127 INFO:teuthology.orchestra.run.smithi100.stdout:fsid 9fea90ef-12b1-4f23-8013-27074825f754 2024-08-17T02:44:46.127 INFO:teuthology.orchestra.run.smithi100.stdout:last_changed 2024-08-17T02:44:46.127024+0000 2024-08-17T02:44:46.127 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-08-17T02:44:46.127024+0000 2024-08-17T02:44:46.127 INFO:teuthology.orchestra.run.smithi100.stdout:min_mon_release 15 (octopus) 2024-08-17T02:44:46.127 INFO:teuthology.orchestra.run.smithi100.stdout:election_strategy: 1 2024-08-17T02:44:46.127 INFO:teuthology.orchestra.run.smithi100.stdout:0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-08-17T02:44:46.127 INFO:teuthology.orchestra.run.smithi100.stdout:1: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.b 2024-08-17T02:44:46.127 INFO:teuthology.orchestra.run.smithi100.stdout:2: [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] mon.c 2024-08-17T02:44:46.128 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-17T02:44:46.129 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:44:46.163 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9fea90ef-12b1-4f23-8013-27074825f754... 2024-08-17T02:44:46.164 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:44:46.207 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:44:46.299 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2024-08-17T02:44:46.299 INFO:teuthology.orchestra.run.smithi100.stdout: chdir = "" 2024-08-17T02:44:46.299 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:44:46.299 INFO:teuthology.orchestra.run.smithi100.stdout: auth supported = cephx 2024-08-17T02:44:46.299 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.299 INFO:teuthology.orchestra.run.smithi100.stdout: filestore xattr use omap = true 2024-08-17T02:44:46.299 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.300 INFO:teuthology.orchestra.run.smithi100.stdout: mon clock drift allowed = 1.000 2024-08-17T02:44:46.300 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.300 INFO:teuthology.orchestra.run.smithi100.stdout: osd crush chooseleaf type = 0 2024-08-17T02:44:46.300 INFO:teuthology.orchestra.run.smithi100.stdout: auth debug = true 2024-08-17T02:44:46.300 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.300 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on old message = true 2024-08-17T02:44:46.300 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on bug = true 2024-08-17T02:44:46.300 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.300 INFO:teuthology.orchestra.run.smithi100.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:44:46.300 INFO:teuthology.orchestra.run.smithi100.stdout: mon pg warn max object skew = 0 2024-08-17T02:44:46.301 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.301 INFO:teuthology.orchestra.run.smithi100.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:44:46.301 INFO:teuthology.orchestra.run.smithi100.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:44:46.301 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.301 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default size = 2 2024-08-17T02:44:46.301 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.301 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow primary affinity = true 2024-08-17T02:44:46.301 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow pg remap = true 2024-08-17T02:44:46.301 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:44:46.301 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:44:46.301 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on no sortbitwise = false 2024-08-17T02:44:46.301 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:44:46.302 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on too few osds = false 2024-08-17T02:44:46.302 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:44:46.302 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:44:46.302 INFO:teuthology.orchestra.run.smithi100.stdout: mon_allow_pool_size_one = true 2024-08-17T02:44:46.302 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.302 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:44:46.302 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.302 INFO:teuthology.orchestra.run.smithi100.stdout: osd default data pool replay window = 5 2024-08-17T02:44:46.302 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.302 INFO:teuthology.orchestra.run.smithi100.stdout: mon allow pool delete = true 2024-08-17T02:44:46.302 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.302 INFO:teuthology.orchestra.run.smithi100.stdout: mon cluster log file level = debug 2024-08-17T02:44:46.303 INFO:teuthology.orchestra.run.smithi100.stdout: debug asserts on shutdown = true 2024-08-17T02:44:46.303 INFO:teuthology.orchestra.run.smithi100.stdout: mon health detail to clog = false 2024-08-17T02:44:46.303 INFO:teuthology.orchestra.run.smithi100.stdout: mon host = "172.21.15.100,172.21.15.123,[v2:172.21.15.123:3301,v1:172.21.15.123:6790]" 2024-08-17T02:44:46.303 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on skipped message = False 2024-08-17T02:44:46.303 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = 9fea90ef-12b1-4f23-8013-27074825f754 2024-08-17T02:44:46.303 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.303 INFO:teuthology.orchestra.run.smithi100.stdout:[osd] 2024-08-17T02:44:46.303 INFO:teuthology.orchestra.run.smithi100.stdout: osd journal size = 100 2024-08-17T02:44:46.303 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.303 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub load threshold = 5.0 2024-08-17T02:44:46.303 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub max interval = 600 2024-08-17T02:44:46.303 INFO:teuthology.orchestra.run.smithi100.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:44:46.304 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.304 INFO:teuthology.orchestra.run.smithi100.stdout: osd recover clone overlap = true 2024-08-17T02:44:46.304 INFO:teuthology.orchestra.run.smithi100.stdout: osd recovery max chunk = 1048576 2024-08-17T02:44:46.304 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.304 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug shutdown = true 2024-08-17T02:44:46.304 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug op order = true 2024-08-17T02:44:46.304 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify stray on activate = true 2024-08-17T02:44:46.304 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.304 INFO:teuthology.orchestra.run.smithi100.stdout: osd open classes on start = true 2024-08-17T02:44:46.304 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug pg log writeout = true 2024-08-17T02:44:46.304 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.304 INFO:teuthology.orchestra.run.smithi100.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:44:46.304 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.305 INFO:teuthology.orchestra.run.smithi100.stdout: osd map max advance = 10 2024-08-17T02:44:46.305 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.305 INFO:teuthology.orchestra.run.smithi100.stdout: journal zero on create = true 2024-08-17T02:44:46.305 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.305 INFO:teuthology.orchestra.run.smithi100.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:44:46.305 INFO:teuthology.orchestra.run.smithi100.stdout: filestore apply finisher threads = 3 2024-08-17T02:44:46.306 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.306 INFO:teuthology.orchestra.run.smithi100.stdout: bdev debug aio = true 2024-08-17T02:44:46.306 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug misdirected ops = true 2024-08-17T02:44:46.306 INFO:teuthology.orchestra.run.smithi100.stdout: bdev async discard = True 2024-08-17T02:44:46.306 INFO:teuthology.orchestra.run.smithi100.stdout: bdev enable discard = True 2024-08-17T02:44:46.306 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore allocator = bitmap 2024-08-17T02:44:46.306 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore block size = 96636764160 2024-08-17T02:44:46.306 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore fsck on mount = True 2024-08-17T02:44:46.306 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluefs = 1/20 2024-08-17T02:44:46.306 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluestore = 1/20 2024-08-17T02:44:46.306 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-08-17T02:44:46.306 INFO:teuthology.orchestra.run.smithi100.stdout: debug osd = 20 2024-08-17T02:44:46.307 INFO:teuthology.orchestra.run.smithi100.stdout: debug rocksdb = 4/10 2024-08-17T02:44:46.307 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:44:46.309 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd full ratio = 0.9 2024-08-17T02:44:46.309 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:44:46.309 INFO:teuthology.orchestra.run.smithi100.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:44:46.309 INFO:teuthology.orchestra.run.smithi100.stdout: osd objectstore = bluestore 2024-08-17T02:44:46.310 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2024-08-17T02:44:46.310 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.310 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr] 2024-08-17T02:44:46.310 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-08-17T02:44:46.310 INFO:teuthology.orchestra.run.smithi100.stdout: debug mgr = 20 2024-08-17T02:44:46.310 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-08-17T02:44:46.310 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-08-17T02:44:46.310 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:44:46.310 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:44:46.310 INFO:teuthology.orchestra.run.smithi100.stdout: mgr/telemetry/nag = false 2024-08-17T02:44:46.311 INFO:teuthology.orchestra.run.smithi100.stdout: debug client = 20 2024-08-17T02:44:46.311 INFO:teuthology.orchestra.run.smithi100.stdout: debug finisher = 20 2024-08-17T02:44:46.311 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.311 INFO:teuthology.orchestra.run.smithi100.stdout:[mon] 2024-08-17T02:44:46.311 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-08-17T02:44:46.311 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-08-17T02:44:46.311 INFO:teuthology.orchestra.run.smithi100.stdout: debug paxos = 20 2024-08-17T02:44:46.311 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-08-17T02:44:46.311 INFO:teuthology.orchestra.run.smithi100.stdout: mon data avail warn = 5 2024-08-17T02:44:46.311 INFO:teuthology.orchestra.run.smithi100.stdout: mon mgr mkfs grace = 240 2024-08-17T02:44:46.311 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:44:46.312 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd reporter subtree level = osd 2024-08-17T02:44:46.312 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd prime pg temp = true 2024-08-17T02:44:46.312 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:44:46.312 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.312 INFO:teuthology.orchestra.run.smithi100.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:44:46.312 INFO:teuthology.orchestra.run.smithi100.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:44:46.312 INFO:teuthology.orchestra.run.smithi100.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:44:46.312 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.312 INFO:teuthology.orchestra.run.smithi100.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:44:46.312 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:44:46.312 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:44:46.313 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.313 INFO:teuthology.orchestra.run.smithi100.stdout: # 1m isn't quite enough 2024-08-17T02:44:46.313 INFO:teuthology.orchestra.run.smithi100.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:44:46.313 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.313 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:44:46.313 INFO:teuthology.orchestra.run.smithi100.stdout: mon op complaint time = 120 2024-08-17T02:44:46.313 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:44:46.313 INFO:teuthology.orchestra.run.smithi100.stdout:[client] 2024-08-17T02:44:46.313 INFO:teuthology.orchestra.run.smithi100.stdout: rgw cache enabled = true 2024-08-17T02:44:46.313 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable ops log = true 2024-08-17T02:44:46.313 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable usage log = true 2024-08-17T02:44:46.314 INFO:teuthology.orchestra.run.smithi100.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:44:46.314 INFO:teuthology.orchestra.run.smithi100.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:44:46.314 INFO:teuthology.orchestra.run.smithi100.stdout: client mount timeout = 600 2024-08-17T02:44:46.314 INFO:teuthology.orchestra.run.smithi100.stdout: debug client = 20 2024-08-17T02:44:46.314 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-08-17T02:44:46.314 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = "" 2024-08-17T02:44:46.314 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2024-08-17T02:44:46.314 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2024-08-17T02:44:46.314 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.a] 2024-08-17T02:44:46.314 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.b] 2024-08-17T02:44:46.314 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.c] 2024-08-17T02:44:46.315 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2024-08-17T02:44:46.315 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2024-08-17T02:44:46.315 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2024-08-17T02:44:46.315 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2024-08-17T02:44:46.315 INFO:teuthology.orchestra.run.smithi100.stdout:[mds] 2024-08-17T02:44:46.315 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds = 20 2024-08-17T02:44:46.315 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds balancer = 20 2024-08-17T02:44:46.315 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-08-17T02:44:46.315 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug frag = True 2024-08-17T02:44:46.315 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug scatterstat = True 2024-08-17T02:44:46.315 INFO:teuthology.orchestra.run.smithi100.stdout: mds op complaint time = 180 2024-08-17T02:44:46.316 INFO:teuthology.orchestra.run.smithi100.stdout: mds verify scatter = True 2024-08-17T02:44:46.316 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2024-08-17T02:44:46.316 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2024-08-17T02:44:46.316 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2024-08-17T02:44:46.316 INFO:teuthology.orchestra.run.smithi123.stdout:[global] 2024-08-17T02:44:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: chdir = "" 2024-08-17T02:44:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:44:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: auth supported = cephx 2024-08-17T02:44:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: filestore xattr use omap = true 2024-08-17T02:44:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: mon clock drift allowed = 1.000 2024-08-17T02:44:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: osd crush chooseleaf type = 0 2024-08-17T02:44:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: auth debug = true 2024-08-17T02:44:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on old message = true 2024-08-17T02:44:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on bug = true 2024-08-17T02:44:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:44:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: mon pg warn max object skew = 0 2024-08-17T02:44:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:44:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:44:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default size = 2 2024-08-17T02:44:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow primary affinity = true 2024-08-17T02:44:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow pg remap = true 2024-08-17T02:44:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:44:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:44:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on no sortbitwise = false 2024-08-17T02:44:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:44:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on too few osds = false 2024-08-17T02:44:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:44:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:44:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: mon_allow_pool_size_one = true 2024-08-17T02:44:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:44:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: osd default data pool replay window = 5 2024-08-17T02:44:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: mon allow pool delete = true 2024-08-17T02:44:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: mon cluster log file level = debug 2024-08-17T02:44:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: debug asserts on shutdown = true 2024-08-17T02:44:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: mon health detail to clog = false 2024-08-17T02:44:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: mon host = "172.21.15.100,172.21.15.123,[v2:172.21.15.123:3301,v1:172.21.15.123:6790]" 2024-08-17T02:44:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on skipped message = False 2024-08-17T02:44:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: fsid = 9fea90ef-12b1-4f23-8013-27074825f754 2024-08-17T02:44:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.321 INFO:teuthology.orchestra.run.smithi123.stdout:[osd] 2024-08-17T02:44:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: osd journal size = 100 2024-08-17T02:44:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub load threshold = 5.0 2024-08-17T02:44:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub max interval = 600 2024-08-17T02:44:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:44:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: osd recover clone overlap = true 2024-08-17T02:44:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: osd recovery max chunk = 1048576 2024-08-17T02:44:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug shutdown = true 2024-08-17T02:44:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug op order = true 2024-08-17T02:44:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug verify stray on activate = true 2024-08-17T02:44:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: osd open classes on start = true 2024-08-17T02:44:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug pg log writeout = true 2024-08-17T02:44:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:44:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: osd map max advance = 10 2024-08-17T02:44:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: journal zero on create = true 2024-08-17T02:44:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:44:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: filestore apply finisher threads = 3 2024-08-17T02:44:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: bdev debug aio = true 2024-08-17T02:44:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug misdirected ops = true 2024-08-17T02:44:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: bdev async discard = True 2024-08-17T02:44:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: bdev enable discard = True 2024-08-17T02:44:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore allocator = bitmap 2024-08-17T02:44:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore block size = 96636764160 2024-08-17T02:44:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore fsck on mount = True 2024-08-17T02:44:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluefs = 1/20 2024-08-17T02:44:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluestore = 1/20 2024-08-17T02:44:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-08-17T02:44:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: debug osd = 20 2024-08-17T02:44:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: debug rocksdb = 4/10 2024-08-17T02:44:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:44:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd full ratio = 0.9 2024-08-17T02:44:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:44:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:44:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: osd objectstore = bluestore 2024-08-17T02:44:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2024-08-17T02:44:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.325 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr] 2024-08-17T02:44:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-08-17T02:44:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: debug mgr = 20 2024-08-17T02:44:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2024-08-17T02:44:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2024-08-17T02:44:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:44:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:44:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: mgr/telemetry/nag = false 2024-08-17T02:44:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2024-08-17T02:44:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: debug finisher = 20 2024-08-17T02:44:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.326 INFO:teuthology.orchestra.run.smithi123.stdout:[mon] 2024-08-17T02:44:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-08-17T02:44:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2024-08-17T02:44:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: debug paxos = 20 2024-08-17T02:44:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2024-08-17T02:44:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: mon data avail warn = 5 2024-08-17T02:44:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: mon mgr mkfs grace = 240 2024-08-17T02:44:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:44:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd reporter subtree level = osd 2024-08-17T02:44:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd prime pg temp = true 2024-08-17T02:44:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:44:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:44:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:44:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:44:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:44:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:44:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:44:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: # 1m isn't quite enough 2024-08-17T02:44:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:44:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:44:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: mon op complaint time = 120 2024-08-17T02:44:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-08-17T02:44:46.328 INFO:teuthology.orchestra.run.smithi123.stdout:[client] 2024-08-17T02:44:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: rgw cache enabled = true 2024-08-17T02:44:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable ops log = true 2024-08-17T02:44:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable usage log = true 2024-08-17T02:44:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:44:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:44:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: client mount timeout = 600 2024-08-17T02:44:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2024-08-17T02:44:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-08-17T02:44:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = "" 2024-08-17T02:44:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2024-08-17T02:44:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2024-08-17T02:44:46.329 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.a] 2024-08-17T02:44:46.329 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.b] 2024-08-17T02:44:46.329 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.c] 2024-08-17T02:44:46.329 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2024-08-17T02:44:46.329 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c] 2024-08-17T02:44:46.329 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2024-08-17T02:44:46.329 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.d] 2024-08-17T02:44:46.329 INFO:teuthology.orchestra.run.smithi123.stdout:[mds] 2024-08-17T02:44:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds = 20 2024-08-17T02:44:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds balancer = 20 2024-08-17T02:44:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-08-17T02:44:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug frag = True 2024-08-17T02:44:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug scatterstat = True 2024-08-17T02:44:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: mds op complaint time = 180 2024-08-17T02:44:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: mds verify scatter = True 2024-08-17T02:44:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2024-08-17T02:44:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2024-08-17T02:44:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2024-08-17T02:44:46.331 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-17T02:44:46.332 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-17T02:44:46.421 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-17T02:44:46.422 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:44:46.422 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-17T02:44:46.456 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:44:46.457 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-17T02:44:46.531 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi100.front.sepia.ceph.com 2024-08-17T02:44:46.531 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:44:46.531 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:44:46.531 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:44:46.648 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:44:46.648 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:44:46.723 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi123.front.sepia.ceph.com 2024-08-17T02:44:46.723 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:44:46.723 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:44:46.723 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:44:46.801 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:44:46.802 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:44:46.877 INFO:tasks.ceph:Setting up mon nodes... 2024-08-17T02:44:46.877 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-17T02:44:46.877 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:44:46.975 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:44:46.980 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:44:47.087 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:44:47.093 INFO:tasks.ceph:Setting up mds nodes... 2024-08-17T02:44:47.093 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:44:47.191 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:44:47.195 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-17T02:44:47.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:44:47.347 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:44:47.354 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-17T02:44:47.410 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:44:47.507 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:44:47.511 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-17T02:44:47.567 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:44:47.664 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:44:47.668 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-17T02:44:47.724 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-17T02:44:47.724 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-17T02:44:47.799 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-17T02:44:47.825 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-17T02:44:47.900 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-17T02:44:47.926 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-17T02:44:48.002 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-17T02:44:48.028 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-17T02:44:48.103 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-17T02:44:48.129 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-17T02:44:48.129 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:44:48.130 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-17T02:44:48.185 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:44:48.185 INFO:tasks.ceph:role: osd.0 2024-08-17T02:44:48.185 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com 2024-08-17T02:44:48.186 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:44:48.248 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:44:48.248 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:44:48.248 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:44:48.248 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:44:48.249 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:44:48.249 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:44:48.249 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:44:48.249 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:44:48.249 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:44:48.249 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:44:48.651 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-08-17T02:44:48.654 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-08-17T02:44:48.655 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-17T02:44:48.779 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-17T02:44:48.845 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-17T02:44:48.900 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:44:48.900 INFO:tasks.ceph:role: osd.1 2024-08-17T02:44:48.900 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com 2024-08-17T02:44:48.901 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:44:48.963 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:44:48.963 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:44:48.963 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:44:48.963 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:44:48.963 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:44:48.964 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:44:48.964 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:44:48.964 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:44:48.964 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:44:48.964 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:44:49.321 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-08-17T02:44:49.325 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-08-17T02:44:49.325 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-17T02:44:49.411 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-17T02:44:49.472 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-17T02:44:49.527 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:44:49.527 INFO:tasks.ceph:role: osd.2 2024-08-17T02:44:49.527 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com 2024-08-17T02:44:49.527 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:44:49.589 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:44:49.589 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:44:49.589 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:44:49.589 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:44:49.590 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:44:49.590 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:44:49.590 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:44:49.590 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:44:49.590 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:44:49.590 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:44:49.971 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-08-17T02:44:49.976 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-08-17T02:44:49.976 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-17T02:44:50.082 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-17T02:44:50.146 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-17T02:44:50.201 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:44:50.202 INFO:tasks.ceph:role: osd.3 2024-08-17T02:44:50.202 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com 2024-08-17T02:44:50.202 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:44:50.265 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:44:50.265 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:44:50.265 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:44:50.265 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:44:50.265 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:44:50.265 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:44:50.265 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:44:50.265 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:44:50.266 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:44:50.266 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:44:50.653 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-08-17T02:44:50.656 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-08-17T02:44:50.656 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-17T02:44:50.796 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-17T02:44:50.859 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:44:50.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:50.964+0000 7f9f0140e2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-17T02:44:50.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:50.968+0000 7f9f0140e2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-17T02:44:50.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:50.969+0000 7f9f0140e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:44:50.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:50.969+0000 7f9f0140e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:44:50.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:50.969+0000 7f9f0140e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:44:50.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:50.976+0000 7f9f0140e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-17T02:44:51.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:51.522+0000 7f9f0140e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:44:52.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:52.294+0000 7f9f0140e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:44:53.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:53.075+0000 7f9f0140e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:44:53.904 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-17T02:44:53.961 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:44:54.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:54.044+0000 7fda35a292c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-17T02:44:54.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:54.045+0000 7fda35a292c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-17T02:44:54.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:54.045+0000 7fda35a292c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:44:54.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:54.045+0000 7fda35a292c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:44:54.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:54.045+0000 7fda35a292c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:44:54.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:54.047+0000 7fda35a292c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-17T02:44:54.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:54.590+0000 7fda35a292c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:44:55.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:55.359+0000 7fda35a292c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:44:56.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:56.138+0000 7fda35a292c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:44:56.977 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-17T02:44:57.033 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:44:57.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:57.114+0000 7f5c6584f2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-17T02:44:57.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:57.114+0000 7f5c6584f2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-17T02:44:57.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:57.114+0000 7f5c6584f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:44:57.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:57.114+0000 7f5c6584f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:44:57.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:57.114+0000 7f5c6584f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:44:57.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:57.117+0000 7f5c6584f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-17T02:44:57.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:57.662+0000 7f5c6584f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:44:58.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:58.435+0000 7f5c6584f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:44:59.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:44:59.204+0000 7f5c6584f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:00.044 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-17T02:45:00.099 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:00.181+0000 7f8fdb8202c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-17T02:45:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:00.182+0000 7f8fdb8202c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-17T02:45:00.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:00.182+0000 7f8fdb8202c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:45:00.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:00.182+0000 7f8fdb8202c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:45:00.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:00.182+0000 7f8fdb8202c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:45:00.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:00.184+0000 7f8fdb8202c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-17T02:45:00.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:00.723+0000 7f8fdb8202c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:01.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:01.493+0000 7f8fdb8202c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:02.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:02.264+0000 7f8fdb8202c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:03.092 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-17T02:45:03.167 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-17T02:45:03.228 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:03.228 INFO:tasks.ceph:role: osd.4 2024-08-17T02:45:03.228 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com 2024-08-17T02:45:03.228 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:45:03.292 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:45:03.292 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:45:03.293 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:45:03.293 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:45:03.293 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:45:03.293 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:45:03.293 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:45:03.293 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:45:03.293 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:45:03.293 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:45:03.694 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-08-17T02:45:03.698 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-08-17T02:45:03.698 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-17T02:45:03.829 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-17T02:45:03.893 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-17T02:45:03.950 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:03.950 INFO:tasks.ceph:role: osd.5 2024-08-17T02:45:03.950 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com 2024-08-17T02:45:03.950 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:45:04.013 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:45:04.013 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:45:04.013 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:45:04.013 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:45:04.013 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:45:04.013 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:45:04.013 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:45:04.013 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:45:04.013 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:45:04.014 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:45:04.379 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-08-17T02:45:04.383 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-08-17T02:45:04.383 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-17T02:45:04.480 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-17T02:45:04.541 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-17T02:45:04.596 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:04.596 INFO:tasks.ceph:role: osd.6 2024-08-17T02:45:04.596 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com 2024-08-17T02:45:04.596 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:45:04.658 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:45:04.658 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:45:04.658 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:45:04.658 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:45:04.658 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:45:04.658 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:45:04.658 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:45:04.659 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:45:04.659 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:45:04.659 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:45:05.044 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-08-17T02:45:05.047 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-08-17T02:45:05.048 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-17T02:45:05.146 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-17T02:45:05.208 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-17T02:45:05.264 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:05.264 INFO:tasks.ceph:role: osd.7 2024-08-17T02:45:05.265 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com 2024-08-17T02:45:05.265 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:45:05.327 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:45:05.327 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:45:05.327 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:45:05.328 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:45:05.328 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:45:05.328 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:45:05.328 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:45:05.328 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:45:05.328 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:45:05.328 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:45:05.753 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-08-17T02:45:05.757 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-08-17T02:45:05.758 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-17T02:45:05.893 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-17T02:45:05.957 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:06.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:06.114+0000 7fdd9ca0d2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-17T02:45:06.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:06.115+0000 7fdd9ca0d2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-17T02:45:06.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:06.115+0000 7fdd9ca0d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:45:06.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:06.115+0000 7fdd9ca0d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:45:06.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:06.115+0000 7fdd9ca0d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:45:06.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:06.117+0000 7fdd9ca0d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-17T02:45:06.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:06.662+0000 7fdd9ca0d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:07.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:07.452+0000 7fdd9ca0d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:08.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:08.231+0000 7fdd9ca0d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:09.072 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-17T02:45:09.130 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:09.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:09.214+0000 7f19a64692c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-17T02:45:09.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:09.214+0000 7f19a64692c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-17T02:45:09.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:09.214+0000 7f19a64692c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:45:09.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:09.214+0000 7f19a64692c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:45:09.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:09.214+0000 7f19a64692c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:45:09.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:09.216+0000 7f19a64692c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-17T02:45:09.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:09.754+0000 7f19a64692c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:10.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:10.527+0000 7f19a64692c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:11.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:11.297+0000 7f19a64692c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:12.128 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-17T02:45:12.187 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:12.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:12.272+0000 7fd3459212c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-17T02:45:12.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:12.273+0000 7fd3459212c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-17T02:45:12.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:12.273+0000 7fd3459212c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:45:12.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:12.273+0000 7fd3459212c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:45:12.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:12.273+0000 7fd3459212c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:45:12.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:12.274+0000 7fd3459212c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-17T02:45:12.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:12.812+0000 7fd3459212c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:13.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:13.584+0000 7fd3459212c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:13.867 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:45:13.871 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:45:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:14.362+0000 7fd3459212c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:15.198 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-17T02:45:15.253 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:15.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:15.336+0000 7fcc38a0a2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-17T02:45:15.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:15.337+0000 7fcc38a0a2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-17T02:45:15.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:15.337+0000 7fcc38a0a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:45:15.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:15.337+0000 7fcc38a0a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:45:15.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:15.337+0000 7fcc38a0a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:45:15.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:15.338+0000 7fcc38a0a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-17T02:45:15.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:15.891+0000 7fcc38a0a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:16.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:16.661+0000 7fcc38a0a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:17.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:17.440+0000 7fcc38a0a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:18.257 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-17T02:45:18.313 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-17T02:45:18.314 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:45:18.314 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-17T02:45:18.375 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:45:18.376 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-17T02:45:18.473 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:45:18.473 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-17T02:45:18.569 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:45:18.569 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-17T02:45:18.665 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:45:18.665 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-17T02:45:18.760 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:45:18.760 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-17T02:45:18.855 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:45:18.855 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-17T02:45:18.950 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:45:18.950 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-17T02:45:19.009 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:45:19.010 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-17T02:45:19.105 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:45:19.105 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-17T02:45:19.201 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:45:19.201 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-17T02:45:19.296 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:45:19.297 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-17T02:45:19.392 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:45:19.393 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-17T02:45:19.487 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:45:19.488 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-17T02:45:19.585 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:45:19.585 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-17T02:45:19.622 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:45:19.622 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-17T02:45:19.699 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:45:19.699 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-17T02:45:19.733 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:45:19.734 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-17T02:45:19.808 INFO:tasks.ceph:Adding keys to all mons... 2024-08-17T02:45:19.808 DEBUG:teuthology.orchestra.run.smithi100:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:45:19.812 DEBUG:teuthology.orchestra.run.smithi123:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:45:19.862 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.y] 2024-08-17T02:45:19.862 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCeDsBmozEhOhAAXAXbgAOEMQK20irHb/P+nw== 2024-08-17T02:45:19.862 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2024-08-17T02:45:19.862 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCfDsBmkatqCxAAqk765XDex/V72qF8wyPHPA== 2024-08-17T02:45:19.862 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2024-08-17T02:45:19.862 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCfDsBmfNi9FBAAibex/Ku5MvZcQQbPXA6+zg== 2024-08-17T02:45:19.863 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.0] 2024-08-17T02:45:19.863 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCiDsBmHr+DORAAAo1CnXGn1fDClOPW7KTU/g== 2024-08-17T02:45:19.863 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.1] 2024-08-17T02:45:19.863 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCmDsBmxhq6AhAAqsf5q2ngt/RmnW6UX2w11A== 2024-08-17T02:45:19.863 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.2] 2024-08-17T02:45:19.863 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCpDsBmibLtBhAA/idWQJbuilqFZBFNcsKJow== 2024-08-17T02:45:19.863 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.3] 2024-08-17T02:45:19.863 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCsDsBmjXDxChAAEA9BJo1VPh2Rzq5KyuscuA== 2024-08-17T02:45:19.863 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.x] 2024-08-17T02:45:19.863 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCfDsBm5+1CBRAACor1Yz9eoici1JkZzFkePw== 2024-08-17T02:45:19.863 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2024-08-17T02:45:19.863 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCfDsBmYppBHhAA7WM7MkdplGhtxEYAquoalg== 2024-08-17T02:45:19.863 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2024-08-17T02:45:19.864 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCfDsBmVnGgJxAAogDB8enrbYRJRKEwTN8LxQ== 2024-08-17T02:45:19.864 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.4] 2024-08-17T02:45:19.864 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCyDsBmMQ7fBhAAJVA+Z43QZrc9abEqLHQNlw== 2024-08-17T02:45:19.864 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.5] 2024-08-17T02:45:19.864 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC1DsBm9mPODBAAq5blpeYBQcoErKMqaxQyMQ== 2024-08-17T02:45:19.864 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.6] 2024-08-17T02:45:19.864 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC4DsBmRY1FEBAAFEZa6jDFHDVxG1jPKSVgYg== 2024-08-17T02:45:19.864 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.7] 2024-08-17T02:45:19.864 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC7DsBmxKQZFBAAVKdMK0SW5gzFVSV9Lfl2+Q== 2024-08-17T02:45:19.864 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2024-08-17T02:45:19.864 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCfDsBmHdqqLxAAHRfYUMhK+prQck4P7GXboA== 2024-08-17T02:45:19.864 INFO:teuthology.orchestra.run.smithi100.stdout:[client.2] 2024-08-17T02:45:19.864 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCfDsBm10auNRAA52wQWAZACIUhOYfNraWDPw== 2024-08-17T02:45:19.865 INFO:teuthology.orchestra.run.smithi100.stdout:[client.1] 2024-08-17T02:45:19.865 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCgDsBmGyYlABAAAKd4p6lI3u3Op6/6h8itnA== 2024-08-17T02:45:19.865 INFO:teuthology.orchestra.run.smithi100.stdout:[client.3] 2024-08-17T02:45:19.865 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCgDsBmvUotBhAAXAlaMT9Yfnp7Y1Z0Ho9OuA== 2024-08-17T02:45:19.900 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.y] 2024-08-17T02:45:19.900 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCeDsBmozEhOhAAXAXbgAOEMQK20irHb/P+nw== 2024-08-17T02:45:19.900 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2024-08-17T02:45:19.900 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCfDsBmkatqCxAAqk765XDex/V72qF8wyPHPA== 2024-08-17T02:45:19.900 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c] 2024-08-17T02:45:19.900 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCfDsBmfNi9FBAAibex/Ku5MvZcQQbPXA6+zg== 2024-08-17T02:45:19.901 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.0] 2024-08-17T02:45:19.901 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCiDsBmHr+DORAAAo1CnXGn1fDClOPW7KTU/g== 2024-08-17T02:45:19.901 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.1] 2024-08-17T02:45:19.901 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCmDsBmxhq6AhAAqsf5q2ngt/RmnW6UX2w11A== 2024-08-17T02:45:19.901 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.2] 2024-08-17T02:45:19.901 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCpDsBmibLtBhAA/idWQJbuilqFZBFNcsKJow== 2024-08-17T02:45:19.901 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.3] 2024-08-17T02:45:19.901 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCsDsBmjXDxChAAEA9BJo1VPh2Rzq5KyuscuA== 2024-08-17T02:45:19.901 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.x] 2024-08-17T02:45:19.901 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCfDsBm5+1CBRAACor1Yz9eoici1JkZzFkePw== 2024-08-17T02:45:19.901 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2024-08-17T02:45:19.901 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCfDsBmYppBHhAA7WM7MkdplGhtxEYAquoalg== 2024-08-17T02:45:19.901 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.d] 2024-08-17T02:45:19.902 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCfDsBmVnGgJxAAogDB8enrbYRJRKEwTN8LxQ== 2024-08-17T02:45:19.902 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.4] 2024-08-17T02:45:19.902 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCyDsBmMQ7fBhAAJVA+Z43QZrc9abEqLHQNlw== 2024-08-17T02:45:19.902 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.5] 2024-08-17T02:45:19.902 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQC1DsBm9mPODBAAq5blpeYBQcoErKMqaxQyMQ== 2024-08-17T02:45:19.902 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.6] 2024-08-17T02:45:19.902 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQC4DsBmRY1FEBAAFEZa6jDFHDVxG1jPKSVgYg== 2024-08-17T02:45:19.902 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.7] 2024-08-17T02:45:19.902 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQC7DsBmxKQZFBAAVKdMK0SW5gzFVSV9Lfl2+Q== 2024-08-17T02:45:19.902 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-08-17T02:45:19.902 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCfDsBmHdqqLxAAHRfYUMhK+prQck4P7GXboA== 2024-08-17T02:45:19.902 INFO:teuthology.orchestra.run.smithi123.stdout:[client.2] 2024-08-17T02:45:19.902 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCfDsBm10auNRAA52wQWAZACIUhOYfNraWDPw== 2024-08-17T02:45:19.903 INFO:teuthology.orchestra.run.smithi123.stdout:[client.1] 2024-08-17T02:45:19.903 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCgDsBmGyYlABAAAKd4p6lI3u3Op6/6h8itnA== 2024-08-17T02:45:19.903 INFO:teuthology.orchestra.run.smithi123.stdout:[client.3] 2024-08-17T02:45:19.903 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCgDsBmvUotBhAAXAlaMT9Yfnp7Y1Z0Ho9OuA== 2024-08-17T02:45:19.904 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:45:19.910 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:45:20.031 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:45:20.036 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:45:20.125 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:45:20.129 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:45:20.219 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:20.223 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:20.308 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:20.312 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:20.398 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:20.402 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:20.489 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:20.494 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:20.582 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:45:20.586 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:45:20.673 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:45:20.677 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:45:20.769 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:45:20.779 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:45:20.869 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:20.874 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:20.961 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:20.964 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:21.051 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:21.055 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:21.143 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:21.147 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:21.234 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:45:21.239 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:45:21.328 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:45:21.333 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:45:21.423 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:45:21.428 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:45:21.519 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:45:21.523 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:45:21.613 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-17T02:45:21.613 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-17T02:45:21.669 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:45:21.770 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-17T02:45:21.826 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-17T02:45:21.882 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:45:21.981 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-17T02:45:22.036 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-17T02:45:22.092 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:45:22.191 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-17T02:45:22.247 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:22.251 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:22.286 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-17T02:45:22.286 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-17T02:45:22.286 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-17T02:45:22.331 INFO:tasks.ceph.mon.a:Started 2024-08-17T02:45:22.331 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-17T02:45:22.331 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-17T02:45:22.336 INFO:tasks.ceph.mon.b:Started 2024-08-17T02:45:22.336 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-17T02:45:22.336 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-17T02:45:22.341 INFO:tasks.ceph.mon.c:Started 2024-08-17T02:45:22.341 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-17T02:45:22.342 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-17T02:45:22.342 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-17T02:45:22.347 INFO:tasks.ceph.mgr.y:Started 2024-08-17T02:45:22.348 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-17T02:45:22.348 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-17T02:45:22.361 INFO:tasks.ceph.mgr.x:Started 2024-08-17T02:45:22.361 INFO:tasks.ceph:Setting crush tunables to default 2024-08-17T02:45:22.361 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd crush tunables default 2024-08-17T02:45:22.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.512+0000 7fec62000640 1 Processor -- start 2024-08-17T02:45:22.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.512+0000 7fec62000640 1 -- start start 2024-08-17T02:45:22.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.513+0000 7fec62000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec5c159b90 0x7fec5c0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:22.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.513+0000 7fec62000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fec5c0ca8a0 0x7fec5c0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:22.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.513+0000 7fec62000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fec5c159f60 0x7fec5c0ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:22.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.513+0000 7fec62000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c0cb880 con 0x7fec5c0ca8a0 2024-08-17T02:45:22.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.513+0000 7fec62000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c0cd6e0 con 0x7fec5c159f60 2024-08-17T02:45:22.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.513+0000 7fec62000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0cadc0 con 0x7fec5c159b90 2024-08-17T02:45:22.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.513+0000 7fec60c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec5c159b90 0x7fec5c0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:22.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.513+0000 7fec60c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec5c159b90 0x7fec5c0ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:48278/0 (socket says 172.21.15.100:48278) 2024-08-17T02:45:22.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.513+0000 7fec60c00640 1 -- 172.21.15.100:0/3337777782 learned_addr learned my addr 172.21.15.100:0/3337777782 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:22.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.514+0000 7fec61600640 1 --2- 172.21.15.100:0/3337777782 >> v2:172.21.15.123:3300/0 conn(0x7fec5c159f60 0x7fec5c0ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:22.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.514+0000 7fec60c00640 1 -- 172.21.15.100:0/3337777782 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec5c159b90 msgr2=0x7fec5c0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:45:22.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.514+0000 7fec60c00640 1 -- 172.21.15.100:0/3337777782 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec5c159b90 msgr2=0x7fec5c0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:22.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.514+0000 7fec60c00640 1 --2- 172.21.15.100:0/3337777782 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec5c159b90 0x7fec5c0ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:22.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.514+0000 7fec60c00640 1 --2- 172.21.15.100:0/3337777782 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec5c159b90 0x7fec5c0ca360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:45:22.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.514+0000 7fec61600640 1 -- 172.21.15.100:0/3337777782 >> v2:172.21.15.123:3300/0 conn(0x7fec5c159f60 msgr2=0x7fec5c0ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:45:22.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.514+0000 7fec61600640 1 -- 172.21.15.100:0/3337777782 >> v2:172.21.15.123:3300/0 conn(0x7fec5c159f60 msgr2=0x7fec5c0ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:22.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.514+0000 7fec61600640 1 --2- 172.21.15.100:0/3337777782 >> v2:172.21.15.123:3300/0 conn(0x7fec5c159f60 0x7fec5c0ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:22.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.514+0000 7fec5be00640 1 --2- 172.21.15.100:0/3337777782 >> v2:172.21.15.100:3300/0 conn(0x7fec5c0ca8a0 0x7fec5c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:22.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.514+0000 7fec61600640 1 --2- 172.21.15.100:0/3337777782 >> v2:172.21.15.123:3300/0 conn(0x7fec5c159f60 0x7fec5c0ccad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:45:22.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.514+0000 7fec5be00640 1 -- 172.21.15.100:0/3337777782 >> v2:172.21.15.100:3300/0 conn(0x7fec5c0ca8a0 msgr2=0x7fec5c0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:45:22.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.514+0000 7fec5be00640 1 -- 172.21.15.100:0/3337777782 >> v2:172.21.15.100:3300/0 conn(0x7fec5c0ca8a0 msgr2=0x7fec5c0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:22.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.514+0000 7fec5be00640 1 --2- 172.21.15.100:0/3337777782 >> v2:172.21.15.100:3300/0 conn(0x7fec5c0ca8a0 0x7fec5c0cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:22.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.514+0000 7fec5be00640 1 --2- 172.21.15.100:0/3337777782 >> v2:172.21.15.100:3300/0 conn(0x7fec5c0ca8a0 0x7fec5c0cc590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:45:22.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.715+0000 7fec5be00640 1 --2- 172.21.15.100:0/3337777782 >> v2:172.21.15.100:3300/0 conn(0x7fec5c0ca8a0 0x7fec5c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:22.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.715+0000 7fec60c00640 1 --2- 172.21.15.100:0/3337777782 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec5c159b90 0x7fec5c0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:22.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.715+0000 7fec61600640 1 --2- 172.21.15.100:0/3337777782 >> v2:172.21.15.123:3300/0 conn(0x7fec5c159f60 0x7fec5c0ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:22.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.715+0000 7fec5be00640 1 -- 172.21.15.100:0/3337777782 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec5c159b90 msgr2=0x7fec5c0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:22.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.715+0000 7fec5be00640 1 --2- 172.21.15.100:0/3337777782 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec5c159b90 0x7fec5c0ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:22.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.715+0000 7fec5be00640 1 -- 172.21.15.100:0/3337777782 >> v2:172.21.15.123:3300/0 conn(0x7fec5c159f60 msgr2=0x7fec5c0ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:22.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.715+0000 7fec5be00640 1 --2- 172.21.15.100:0/3337777782 >> v2:172.21.15.123:3300/0 conn(0x7fec5c159f60 0x7fec5c0ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:22.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.715+0000 7fec5be00640 1 -- 172.21.15.100:0/3337777782 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c0cb060 con 0x7fec5c0ca8a0 2024-08-17T02:45:22.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.716+0000 7fec5be00640 1 --2- 172.21.15.100:0/3337777782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec5c0ca8a0 0x7fec5c0cc590 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fec5c088fa0 tx=0x7fec48008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab1b710080f7b07 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:22.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.716+0000 7fec5b400640 1 -- 172.21.15.100:0/3337777782 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4802ad40 con 0x7fec5c0ca8a0 2024-08-17T02:45:22.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.716+0000 7fec5b400640 1 -- 172.21.15.100:0/3337777782 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4802e070 con 0x7fec5c0ca8a0 2024-08-17T02:45:22.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.716+0000 7fec5b400640 1 -- 172.21.15.100:0/3337777782 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48034650 con 0x7fec5c0ca8a0 2024-08-17T02:45:22.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.717+0000 7fec62000640 1 -- 172.21.15.100:0/3337777782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec5c0ca8a0 msgr2=0x7fec5c0cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:22.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.717+0000 7fec62000640 1 --2- 172.21.15.100:0/3337777782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec5c0ca8a0 0x7fec5c0cc590 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fec5c088fa0 tx=0x7fec48008040 comp rx=0 tx=0).stop 2024-08-17T02:45:22.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.717+0000 7fec62000640 1 -- 172.21.15.100:0/3337777782 shutdown_connections 2024-08-17T02:45:22.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.717+0000 7fec62000640 1 --2- 172.21.15.100:0/3337777782 >> v2:172.21.15.123:3300/0 conn(0x7fec5c159f60 0x7fec5c0ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:22.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.717+0000 7fec62000640 1 --2- 172.21.15.100:0/3337777782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec5c0ca8a0 0x7fec5c0cc590 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:22.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.717+0000 7fec62000640 1 --2- 172.21.15.100:0/3337777782 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec5c159b90 0x7fec5c0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:22.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.717+0000 7fec62000640 1 -- 172.21.15.100:0/3337777782 >> 172.21.15.100:0/3337777782 conn(0x7fec5c098e00 msgr2=0x7fec5c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:22.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.717+0000 7fec62000640 1 -- 172.21.15.100:0/3337777782 shutdown_connections 2024-08-17T02:45:22.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.717+0000 7fec62000640 1 -- 172.21.15.100:0/3337777782 wait complete. 2024-08-17T02:45:22.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.719+0000 7fec62000640 1 Processor -- start 2024-08-17T02:45:22.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.719+0000 7fec62000640 1 -- start start 2024-08-17T02:45:22.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.720+0000 7fec62000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec5c0ca8a0 0x7fec5c1554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:22.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.720+0000 7fec62000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec5c159b90 0x7fec5c0c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:22.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.720+0000 7fec62000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec5c159f60 0x7fec5c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:22.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.720+0000 7fec62000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0c8220 con 0x7fec5c159f60 2024-08-17T02:45:22.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.720+0000 7fec62000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c1559f0 con 0x7fec5c159b90 2024-08-17T02:45:22.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.720+0000 7fec62000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0c7610 con 0x7fec5c0ca8a0 2024-08-17T02:45:22.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.720+0000 7fec61600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec5c159f60 0x7fec5c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:22.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.720+0000 7fec61600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec5c159f60 0x7fec5c068760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38226/0 (socket says 172.21.15.100:38226) 2024-08-17T02:45:22.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.720+0000 7fec61600640 1 -- 172.21.15.100:0/679183615 learned_addr learned my addr 172.21.15.100:0/679183615 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:22.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.720+0000 7fec5be00640 1 --2- 172.21.15.100:0/679183615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec5c159b90 0x7fec5c0c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:22.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.720+0000 7fec60c00640 1 --2- 172.21.15.100:0/679183615 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec5c0ca8a0 0x7fec5c1554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:22.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.720+0000 7fec5be00640 1 -- 172.21.15.100:0/679183615 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec5c0ca8a0 msgr2=0x7fec5c1554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:22.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.720+0000 7fec5be00640 1 --2- 172.21.15.100:0/679183615 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec5c0ca8a0 0x7fec5c1554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:22.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.720+0000 7fec5be00640 1 -- 172.21.15.100:0/679183615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec5c159f60 msgr2=0x7fec5c068760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:22.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.720+0000 7fec5be00640 1 --2- 172.21.15.100:0/679183615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec5c159f60 0x7fec5c068760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:22.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.721+0000 7fec5be00640 1 -- 172.21.15.100:0/679183615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4800e040 con 0x7fec5c159b90 2024-08-17T02:45:22.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.721+0000 7fec60c00640 1 --2- 172.21.15.100:0/679183615 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec5c0ca8a0 0x7fec5c1554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:22.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.721+0000 7fec5be00640 1 --2- 172.21.15.100:0/679183615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec5c159b90 0x7fec5c0c6bc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fec48032000 tx=0x7fec48036000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:22.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.721+0000 7fec4fe00640 1 -- 172.21.15.100:0/679183615 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48034e00 con 0x7fec5c159b90 2024-08-17T02:45:22.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.721+0000 7fec4fe00640 1 -- 172.21.15.100:0/679183615 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec48033a70 con 0x7fec5c159b90 2024-08-17T02:45:22.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.721+0000 7fec62000640 1 -- 172.21.15.100:0/679183615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5c0c78f0 con 0x7fec5c159b90 2024-08-17T02:45:22.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.721+0000 7fec4fe00640 1 -- 172.21.15.100:0/679183615 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48033e30 con 0x7fec5c159b90 2024-08-17T02:45:22.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.721+0000 7fec62000640 1 -- 172.21.15.100:0/679183615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c0c7eb0 con 0x7fec5c159b90 2024-08-17T02:45:22.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.722+0000 7fec4fe00640 1 -- 172.21.15.100:0/679183615 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fec4803e8c0 con 0x7fec5c159b90 2024-08-17T02:45:22.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.722+0000 7fec4fe00640 1 -- 172.21.15.100:0/679183615 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fec48048840 con 0x7fec5c159b90 2024-08-17T02:45:22.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.722+0000 7fec62000640 1 -- 172.21.15.100:0/679183615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5c071050 con 0x7fec5c159b90 2024-08-17T02:45:22.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.726+0000 7fec4fe00640 1 -- 172.21.15.100:0/679183615 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fec48030070 con 0x7fec5c159b90 2024-08-17T02:45:22.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.792+0000 7fec62000640 1 -- 172.21.15.100:0/679183615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fec5c0ac670 con 0x7fec5c159b90 2024-08-17T02:45:22.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.796+0000 7fec4fe00640 1 -- 172.21.15.100:0/679183615 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fec48056090 con 0x7fec5c159b90 2024-08-17T02:45:22.797 INFO:teuthology.orchestra.run.smithi100.stderr:adjusted tunables profile to default 2024-08-17T02:45:22.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.798+0000 7fec62000640 1 -- 172.21.15.100:0/679183615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec5c159b90 msgr2=0x7fec5c0c6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:22.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.798+0000 7fec62000640 1 --2- 172.21.15.100:0/679183615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec5c159b90 0x7fec5c0c6bc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fec48032000 tx=0x7fec48036000 comp rx=0 tx=0).stop 2024-08-17T02:45:22.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.798+0000 7fec62000640 1 -- 172.21.15.100:0/679183615 shutdown_connections 2024-08-17T02:45:22.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.798+0000 7fec62000640 1 --2- 172.21.15.100:0/679183615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec5c159f60 0x7fec5c068760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:22.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.798+0000 7fec62000640 1 --2- 172.21.15.100:0/679183615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec5c159b90 0x7fec5c0c6bc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:22.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.798+0000 7fec62000640 1 --2- 172.21.15.100:0/679183615 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec5c0ca8a0 0x7fec5c1554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:22.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.798+0000 7fec62000640 1 -- 172.21.15.100:0/679183615 >> 172.21.15.100:0/679183615 conn(0x7fec5c098e00 msgr2=0x7fec5c0679b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:22.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.798+0000 7fec62000640 1 -- 172.21.15.100:0/679183615 shutdown_connections 2024-08-17T02:45:22.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:22.798+0000 7fec62000640 1 -- 172.21.15.100:0/679183615 wait complete. 2024-08-17T02:45:22.813 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-17T02:45:22.814 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:45:22.814 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-17T02:45:22.832 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:22.831+0000 7fb4b1d66ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:45:22.834 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:22.834+0000 7f111e613ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:45:22.874 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:45:22.874 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-17T02:45:22.970 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:45:22.971 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-17T02:45:22.978 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:22.977+0000 7fb4b1d66ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:45:22.990 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:22.989+0000 7f111e613ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:45:23.037 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:23.035+0000 7fb4b1d66ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:45:23.045 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-08-17T02:45:23.046 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-17T02:45:23.051 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:23.050+0000 7f111e613ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:45:23.105 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:45:23.106 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-17T02:45:23.160 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:45:23.161 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-17T02:45:23.257 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:45:23.257 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-17T02:45:23.328 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:23.326+0000 7fb4b1d66ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:45:23.342 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:23.342+0000 7f111e613ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:45:23.352 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-08-17T02:45:23.353 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-17T02:45:23.381 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:23.380+0000 7fb4b1d66ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:45:23.392 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:23.392+0000 7f111e613ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:45:23.437 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new bcae4c92-2028-4303-8687-b1a80c4cb027 0 2024-08-17T02:45:23.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.619+0000 7f1c31c00640 1 Processor -- start 2024-08-17T02:45:23.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.619+0000 7f1c31c00640 1 -- start start 2024-08-17T02:45:23.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.620+0000 7f1c31c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1c2c159f60 0x7f1c2c0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:23.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.620+0000 7f1c31c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c2c0ceb40 0x7f1c2c0ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:23.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.620+0000 7f1c31c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2c0cadc0 con 0x7f1c2c159b90 2024-08-17T02:45:23.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.620+0000 7f1c31c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c2c0cb880 con 0x7f1c2c159f60 2024-08-17T02:45:23.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.620+0000 7f1c31c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c0cd6e0 con 0x7f1c2c0ceb40 2024-08-17T02:45:23.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.621+0000 7f1c31200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c2c0ceb40 0x7f1c2c0ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:23.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.621+0000 7f1c2be00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1c2c159b90 0x7f1c2c0ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59776/0 (socket says 172.21.15.123:59776) 2024-08-17T02:45:23.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.621+0000 7f1c2be00640 1 -- 172.21.15.123:0/3048746196 learned_addr learned my addr 172.21.15.123:0/3048746196 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-08-17T02:45:23.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.621+0000 7f1c23e00640 1 --2- 172.21.15.123:0/3048746196 >> v2:172.21.15.100:3300/0 conn(0x7f1c2c159f60 0x7f1c2c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:23.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.621+0000 7f1c31200640 1 -- 172.21.15.123:0/3048746196 >> v2:172.21.15.100:3300/0 conn(0x7f1c2c159f60 msgr2=0x7f1c2c0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:23.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.621+0000 7f1c31200640 1 --2- 172.21.15.123:0/3048746196 >> v2:172.21.15.100:3300/0 conn(0x7f1c2c159f60 0x7f1c2c0cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:23.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.621+0000 7f1c31200640 1 -- 172.21.15.123:0/3048746196 >> v1:172.21.15.123:6789/0 conn(0x7f1c2c159b90 legacy=0x7f1c2c0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:23.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.621+0000 7f1c2b400640 1 -- 172.21.15.123:0/3048746196 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097419885 0 0) 0x7f1c2c0cadc0 con 0x7f1c2c159b90 2024-08-17T02:45:23.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.621+0000 7f1c31200640 1 -- 172.21.15.123:0/3048746196 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c0cb060 con 0x7f1c2c0ceb40 2024-08-17T02:45:23.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.622+0000 7f1c31200640 1 --2- 172.21.15.123:0/3048746196 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c2c0ceb40 0x7f1c2c0ccad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009e60 tx=0x7f1c24009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17d9ba7f4f5f8179 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:23.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.622+0000 7f1c2b400640 1 -- 172.21.15.123:0/3048746196 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c24007550 con 0x7f1c2c0ceb40 2024-08-17T02:45:23.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.622+0000 7f1c2b400640 1 -- 172.21.15.123:0/3048746196 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2402d050 con 0x7f1c2c0ceb40 2024-08-17T02:45:23.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.622+0000 7f1c2b400640 1 -- 172.21.15.123:0/3048746196 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c240078e0 con 0x7f1c2c0ceb40 2024-08-17T02:45:23.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.623+0000 7f1c31c00640 1 -- 172.21.15.123:0/3048746196 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c2c0ceb40 msgr2=0x7f1c2c0ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:23.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.623+0000 7f1c31c00640 1 --2- 172.21.15.123:0/3048746196 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c2c0ceb40 0x7f1c2c0ccad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009e60 tx=0x7f1c24009780 comp rx=0 tx=0).stop 2024-08-17T02:45:23.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.623+0000 7f1c31c00640 1 -- 172.21.15.123:0/3048746196 shutdown_connections 2024-08-17T02:45:23.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.623+0000 7f1c31c00640 1 --2- 172.21.15.123:0/3048746196 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c2c0ceb40 0x7f1c2c0ccad0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:23.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.623+0000 7f1c31c00640 1 --2- 172.21.15.123:0/3048746196 >> v2:172.21.15.100:3300/0 conn(0x7f1c2c159f60 0x7f1c2c0cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:23.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.623+0000 7f1c31c00640 1 -- 172.21.15.123:0/3048746196 >> 172.21.15.123:0/3048746196 conn(0x7f1c2c098e00 msgr2=0x7f1c2c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:23.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.623+0000 7f1c31c00640 1 -- 172.21.15.123:0/3048746196 shutdown_connections 2024-08-17T02:45:23.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.623+0000 7f1c31c00640 1 -- 172.21.15.123:0/3048746196 wait complete. 2024-08-17T02:45:23.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.625+0000 7f1c31c00640 1 Processor -- start 2024-08-17T02:45:23.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.625+0000 7f1c31c00640 1 -- start start 2024-08-17T02:45:23.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.625+0000 7f1c31c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c2c0ceb40 0x7f1c2c155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:23.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.625+0000 7f1c31c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c2c159b90 0x7f1c2c0c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:23.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.625+0000 7f1c31c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c2c159f60 0x7f1c2c0b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:23.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.625+0000 7f1c31c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c09ab20 con 0x7f1c2c0ceb40 2024-08-17T02:45:23.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.626+0000 7f1c31c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c0c4ce0 con 0x7f1c2c159f60 2024-08-17T02:45:23.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.626+0000 7f1c31c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c09a340 con 0x7f1c2c159b90 2024-08-17T02:45:23.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.626+0000 7f1c23e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c2c159b90 0x7f1c2c0c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:23.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.626+0000 7f1c31200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c2c159f60 0x7f1c2c0b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:23.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.626+0000 7f1c2be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c2c0ceb40 0x7f1c2c155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:23.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.626+0000 7f1c23e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c2c159b90 0x7f1c2c0c3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:39324/0 (socket says 172.21.15.123:39324) 2024-08-17T02:45:23.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.626+0000 7f1c23e00640 1 -- 172.21.15.123:0/3119533445 learned_addr learned my addr 172.21.15.123:0/3119533445 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-17T02:45:23.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.626+0000 7f1c23e00640 1 -- 172.21.15.123:0/3119533445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c2c159f60 msgr2=0x7f1c2c0b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:23.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.626+0000 7f1c23e00640 1 --2- 172.21.15.123:0/3119533445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c2c159f60 0x7f1c2c0b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:23.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.626+0000 7f1c23e00640 1 -- 172.21.15.123:0/3119533445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c2c0ceb40 msgr2=0x7f1c2c155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.626+0000 7f1c23e00640 1 --2- 172.21.15.123:0/3119533445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c2c0ceb40 0x7f1c2c155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.626+0000 7f1c23e00640 1 -- 172.21.15.123:0/3119533445 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c24009a20 con 0x7f1c2c159b90 2024-08-17T02:45:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.626+0000 7f1c23e00640 1 --2- 172.21.15.123:0/3119533445 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c2c159b90 0x7f1c2c0c3610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400e900 tx=0x7f1c140090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.627+0000 7f1c23400640 1 -- 172.21.15.123:0/3119533445 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14009480 con 0x7f1c2c159b90 2024-08-17T02:45:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.627+0000 7f1c23400640 1 -- 172.21.15.123:0/3119533445 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1400c8e0 con 0x7f1c2c159b90 2024-08-17T02:45:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.627+0000 7f1c23400640 1 -- 172.21.15.123:0/3119533445 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1400cc60 con 0x7f1c2c159b90 2024-08-17T02:45:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.627+0000 7f1c31c00640 1 -- 172.21.15.123:0/3119533445 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2c0c40c0 con 0x7f1c2c159b90 2024-08-17T02:45:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.627+0000 7f1c31c00640 1 -- 172.21.15.123:0/3119533445 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2c0c4900 con 0x7f1c2c159b90 2024-08-17T02:45:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.627+0000 7f1c23400640 1 -- 172.21.15.123:0/3119533445 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f1c14005970 con 0x7f1c2c159b90 2024-08-17T02:45:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.627+0000 7f1c23400640 1 -- 172.21.15.123:0/3119533445 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1c14013be0 con 0x7f1c2c159b90 2024-08-17T02:45:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.628+0000 7f1c31c00640 1 -- 172.21.15.123:0/3119533445 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c2c071050 con 0x7f1c2c159b90 2024-08-17T02:45:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.631+0000 7f1c23400640 1 -- 172.21.15.123:0/3119533445 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f1c14021060 con 0x7f1c2c159b90 2024-08-17T02:45:23.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.762+0000 7f1c31c00640 1 -- 172.21.15.123:0/3119533445 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bcae4c92-2028-4303-8687-b1a80c4cb027", "id": 0} v 0) v1 -- 0x7f1c2c0698f0 con 0x7f1c2c159b90 2024-08-17T02:45:23.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.770+0000 7f1c23400640 1 -- 172.21.15.123:0/3119533445 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bcae4c92-2028-4303-8687-b1a80c4cb027", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1c14017070 con 0x7f1c2c159b90 2024-08-17T02:45:23.772 INFO:teuthology.orchestra.run.smithi123.stdout:0 2024-08-17T02:45:23.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.771+0000 7f1c31c00640 1 -- 172.21.15.123:0/3119533445 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c2c159b90 msgr2=0x7f1c2c0c3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:23.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.771+0000 7f1c31c00640 1 --2- 172.21.15.123:0/3119533445 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c2c159b90 0x7f1c2c0c3610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400e900 tx=0x7f1c140090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:23.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.771+0000 7f1c31c00640 1 -- 172.21.15.123:0/3119533445 shutdown_connections 2024-08-17T02:45:23.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.772+0000 7f1c31c00640 1 --2- 172.21.15.123:0/3119533445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c2c159f60 0x7f1c2c0b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:23.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.772+0000 7f1c31c00640 1 --2- 172.21.15.123:0/3119533445 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c2c159b90 0x7f1c2c0c3610 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:23.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.772+0000 7f1c31c00640 1 --2- 172.21.15.123:0/3119533445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c2c0ceb40 0x7f1c2c155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:23.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.772+0000 7f1c31c00640 1 -- 172.21.15.123:0/3119533445 >> 172.21.15.123:0/3119533445 conn(0x7f1c2c098e00 msgr2=0x7f1c2c067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:23.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.772+0000 7f1c31c00640 1 -- 172.21.15.123:0/3119533445 shutdown_connections 2024-08-17T02:45:23.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.772+0000 7f1c31c00640 1 -- 172.21.15.123:0/3119533445 wait complete. 2024-08-17T02:45:23.787 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 06af85ca-1cfc-4cfe-b199-fca43d69a12c 1 2024-08-17T02:45:23.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.930+0000 7f51ffe00640 1 Processor -- start 2024-08-17T02:45:23.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.931+0000 7f51ffe00640 1 -- start start 2024-08-17T02:45:23.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.932+0000 7f51ffe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5200159aa0 0x7f52000ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:23.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.932+0000 7f51ffe00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5200159e70 0x7f52000cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:23.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.932+0000 7f51ffe00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52000cad60 con 0x7f520015a2c0 2024-08-17T02:45:23.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.932+0000 7f51ffe00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52000c4b90 con 0x7f5200159aa0 2024-08-17T02:45:23.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.932+0000 7f51ffe00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52000ce630 con 0x7f5200159e70 2024-08-17T02:45:23.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.932+0000 7f51fea00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5200159aa0 0x7f52000ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:23.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.932+0000 7f51fe000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5200159e70 0x7f52000cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:23.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.932+0000 7f51fea00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5200159aa0 0x7f52000ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47824/0 (socket says 172.21.15.123:47824) 2024-08-17T02:45:23.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.932+0000 7f51fea00640 1 -- 172.21.15.123:0/1087111735 learned_addr learned my addr 172.21.15.123:0/1087111735 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-17T02:45:23.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.932+0000 7f51fe000640 1 -- 172.21.15.123:0/1087111735 >> v2:172.21.15.123:3300/0 conn(0x7f5200159aa0 msgr2=0x7f52000ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:23.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.932+0000 7f51fe000640 1 --2- 172.21.15.123:0/1087111735 >> v2:172.21.15.123:3300/0 conn(0x7f5200159aa0 0x7f52000ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:23.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.933+0000 7f51fe000640 1 -- 172.21.15.123:0/1087111735 >> v1:172.21.15.100:6789/0 conn(0x7f520015a2c0 legacy=0x7f52000cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:23.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.933+0000 7f51fe000640 1 -- 172.21.15.123:0/1087111735 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52000ce910 con 0x7f5200159e70 2024-08-17T02:45:23.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.933+0000 7f51fea00640 1 --2- 172.21.15.123:0/1087111735 >> v2:172.21.15.123:3300/0 conn(0x7f5200159aa0 0x7f52000ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:23.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.934+0000 7f51fe000640 1 --2- 172.21.15.123:0/1087111735 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5200159e70 0x7f52000cc7f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009850 tx=0x7f51ec0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1198aeb0b7872438 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:23.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.934+0000 7f51fd600640 1 -- 172.21.15.123:0/1087111735 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec02ad90 con 0x7f5200159e70 2024-08-17T02:45:23.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.934+0000 7f51fd600640 1 -- 172.21.15.123:0/1087111735 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec032440 con 0x7f5200159e70 2024-08-17T02:45:23.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.934+0000 7f51fd600640 1 -- 172.21.15.123:0/1087111735 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec032820 con 0x7f5200159e70 2024-08-17T02:45:23.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.934+0000 7f51ffe00640 1 -- 172.21.15.123:0/1087111735 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5200159e70 msgr2=0x7f52000cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:23.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.934+0000 7f51ffe00640 1 --2- 172.21.15.123:0/1087111735 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5200159e70 0x7f52000cc7f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009850 tx=0x7f51ec0090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:23.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.934+0000 7f51ffe00640 1 -- 172.21.15.123:0/1087111735 shutdown_connections 2024-08-17T02:45:23.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.934+0000 7f51ffe00640 1 --2- 172.21.15.123:0/1087111735 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5200159e70 0x7f52000cc7f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:23.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.934+0000 7f51ffe00640 1 --2- 172.21.15.123:0/1087111735 >> v2:172.21.15.123:3300/0 conn(0x7f5200159aa0 0x7f52000ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:23.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.934+0000 7f51ffe00640 1 -- 172.21.15.123:0/1087111735 >> 172.21.15.123:0/1087111735 conn(0x7f5200099040 msgr2=0x7f520006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:23.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.935+0000 7f51ffe00640 1 -- 172.21.15.123:0/1087111735 shutdown_connections 2024-08-17T02:45:23.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.935+0000 7f51ffe00640 1 -- 172.21.15.123:0/1087111735 wait complete. 2024-08-17T02:45:23.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.936+0000 7f51ffe00640 1 Processor -- start 2024-08-17T02:45:23.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.936+0000 7f51ffe00640 1 -- start start 2024-08-17T02:45:23.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.937+0000 7f51ffe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5200159aa0 0x7f52000b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:23.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.937+0000 7f51ffe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5200159e70 0x7f520014f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:23.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.937+0000 7f51ffe00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f520015a2c0 0x7f52001514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:23.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.937+0000 7f51ffe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52000c6550 con 0x7f5200159e70 2024-08-17T02:45:23.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.937+0000 7f51ffe00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52000c5940 con 0x7f5200159aa0 2024-08-17T02:45:23.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.937+0000 7f51ffe00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52000c5c20 con 0x7f520015a2c0 2024-08-17T02:45:23.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.937+0000 7f51fea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5200159aa0 0x7f52000b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:23.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.937+0000 7f51fea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5200159aa0 0x7f52000b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47838/0 (socket says 172.21.15.123:47838) 2024-08-17T02:45:23.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.937+0000 7f51fea00640 1 -- 172.21.15.123:0/2642743551 learned_addr learned my addr 172.21.15.123:0/2642743551 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-17T02:45:23.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.937+0000 7f51fe000640 1 --2- 172.21.15.123:0/2642743551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5200159e70 0x7f520014f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:23.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.937+0000 7f51ff400640 1 --2- 172.21.15.123:0/2642743551 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f520015a2c0 0x7f52001514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:23.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.937+0000 7f51fea00640 1 -- 172.21.15.123:0/2642743551 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f520015a2c0 msgr2=0x7f52001514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:23.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.937+0000 7f51fea00640 1 --2- 172.21.15.123:0/2642743551 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f520015a2c0 0x7f52001514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:23.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.937+0000 7f51fea00640 1 -- 172.21.15.123:0/2642743551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5200159e70 msgr2=0x7f520014f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:23.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.937+0000 7f51fea00640 1 --2- 172.21.15.123:0/2642743551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5200159e70 0x7f520014f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:23.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.937+0000 7f51fea00640 1 -- 172.21.15.123:0/2642743551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f0009450 con 0x7f5200159aa0 2024-08-17T02:45:23.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.938+0000 7f51fea00640 1 --2- 172.21.15.123:0/2642743551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5200159aa0 0x7f52000b54f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f51f000ec80 tx=0x7f51f00091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:23.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.938+0000 7f51f6000640 1 -- 172.21.15.123:0/2642743551 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f000eec0 con 0x7f5200159aa0 2024-08-17T02:45:23.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.938+0000 7f51f6000640 1 -- 172.21.15.123:0/2642743551 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f000cbc0 con 0x7f5200159aa0 2024-08-17T02:45:23.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.938+0000 7f51f6000640 1 -- 172.21.15.123:0/2642743551 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f0013470 con 0x7f5200159aa0 2024-08-17T02:45:23.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.938+0000 7f51ffe00640 1 -- 172.21.15.123:0/2642743551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec009390 con 0x7f5200159aa0 2024-08-17T02:45:23.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.938+0000 7f51ffe00640 1 -- 172.21.15.123:0/2642743551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52000c61e0 con 0x7f5200159aa0 2024-08-17T02:45:23.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.938+0000 7f51f6000640 1 -- 172.21.15.123:0/2642743551 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f51f0005970 con 0x7f5200159aa0 2024-08-17T02:45:23.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.938+0000 7f51f6000640 1 -- 172.21.15.123:0/2642743551 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f51f0006020 con 0x7f5200159aa0 2024-08-17T02:45:23.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.939+0000 7f51ffe00640 1 -- 172.21.15.123:0/2642743551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5200071050 con 0x7f5200159aa0 2024-08-17T02:45:23.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:23.941+0000 7f51f6000640 1 -- 172.21.15.123:0/2642743551 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f51f0021060 con 0x7f5200159aa0 2024-08-17T02:45:24.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.016+0000 7f51ffe00640 1 -- 172.21.15.123:0/2642743551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd new", "uuid": "06af85ca-1cfc-4cfe-b199-fca43d69a12c", "id": 1} v 0) v1 -- 0x7f520006f480 con 0x7f5200159aa0 2024-08-17T02:45:24.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.024+0000 7f51f6000640 1 -- 172.21.15.123:0/2642743551 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "06af85ca-1cfc-4cfe-b199-fca43d69a12c", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f51f0029020 con 0x7f5200159aa0 2024-08-17T02:45:24.026 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-08-17T02:45:24.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.025+0000 7f51ffe00640 1 -- 172.21.15.123:0/2642743551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5200159aa0 msgr2=0x7f52000b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:24.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.025+0000 7f51ffe00640 1 --2- 172.21.15.123:0/2642743551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5200159aa0 0x7f52000b54f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f51f000ec80 tx=0x7f51f00091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.025+0000 7f51ffe00640 1 -- 172.21.15.123:0/2642743551 shutdown_connections 2024-08-17T02:45:24.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.025+0000 7f51ffe00640 1 --2- 172.21.15.123:0/2642743551 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f520015a2c0 0x7f52001514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.025+0000 7f51ffe00640 1 --2- 172.21.15.123:0/2642743551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5200159e70 0x7f520014f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.025+0000 7f51ffe00640 1 --2- 172.21.15.123:0/2642743551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5200159aa0 0x7f52000b54f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.025+0000 7f51ffe00640 1 -- 172.21.15.123:0/2642743551 >> 172.21.15.123:0/2642743551 conn(0x7f5200099040 msgr2=0x7f5200158920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:24.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.025+0000 7f51ffe00640 1 -- 172.21.15.123:0/2642743551 shutdown_connections 2024-08-17T02:45:24.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.025+0000 7f51ffe00640 1 -- 172.21.15.123:0/2642743551 wait complete. 2024-08-17T02:45:24.042 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 7d21e3ad-72fa-45c9-9bae-3ab967e4815e 2 2024-08-17T02:45:24.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.184+0000 7efff7000640 1 Processor -- start 2024-08-17T02:45:24.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.184+0000 7efff7000640 1 -- start start 2024-08-17T02:45:24.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.185+0000 7efff7000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efff0158ea0 0x7efff00d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:24.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.186+0000 7efff7000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efff00caa00 0x7efff00c7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:24.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.186+0000 7efff7000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff006f240 con 0x7efff00d09a0 2024-08-17T02:45:24.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.186+0000 7efff7000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff00c6f20 con 0x7efff0158ea0 2024-08-17T02:45:24.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.186+0000 7efff7000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff00cf410 con 0x7efff00caa00 2024-08-17T02:45:24.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.186+0000 7effe7e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7efff00d09a0 0x7efff00ca2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59784/0 (socket says 172.21.15.123:59784) 2024-08-17T02:45:24.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.186+0000 7efff5000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efff00caa00 0x7efff00c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:24.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.186+0000 7effe7e00640 1 -- 172.21.15.123:0/3131064505 learned_addr learned my addr 172.21.15.123:0/3131064505 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-08-17T02:45:24.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.186+0000 7effefe00640 1 --2- 172.21.15.123:0/3131064505 >> v2:172.21.15.100:3300/0 conn(0x7efff0158ea0 0x7efff00d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:24.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.186+0000 7efff5000640 1 -- 172.21.15.123:0/3131064505 >> v2:172.21.15.100:3300/0 conn(0x7efff0158ea0 msgr2=0x7efff00d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:24.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.186+0000 7efff5000640 1 --2- 172.21.15.123:0/3131064505 >> v2:172.21.15.100:3300/0 conn(0x7efff0158ea0 0x7efff00d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.186+0000 7efff5000640 1 -- 172.21.15.123:0/3131064505 >> v1:172.21.15.123:6789/0 conn(0x7efff00d09a0 legacy=0x7efff00ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:24.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.186+0000 7efff5000640 1 -- 172.21.15.123:0/3131064505 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff00ceb70 con 0x7efff00caa00 2024-08-17T02:45:24.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.186+0000 7effef400640 1 -- 172.21.15.123:0/3131064505 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29160455 0 0) 0x7efff006f240 con 0x7efff00d09a0 2024-08-17T02:45:24.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.187+0000 7efff5000640 1 --2- 172.21.15.123:0/3131064505 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efff00caa00 0x7efff00c7370 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7effe8009e60 tx=0x7effe8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d6045c3a1888afa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:24.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.187+0000 7effef400640 1 -- 172.21.15.123:0/3131064505 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe8007550 con 0x7efff00caa00 2024-08-17T02:45:24.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.187+0000 7effef400640 1 -- 172.21.15.123:0/3131064505 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe802d050 con 0x7efff00caa00 2024-08-17T02:45:24.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.187+0000 7effef400640 1 -- 172.21.15.123:0/3131064505 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe80078e0 con 0x7efff00caa00 2024-08-17T02:45:24.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.188+0000 7efff7000640 1 -- 172.21.15.123:0/3131064505 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efff00caa00 msgr2=0x7efff00c7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:24.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.188+0000 7efff7000640 1 --2- 172.21.15.123:0/3131064505 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efff00caa00 0x7efff00c7370 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7effe8009e60 tx=0x7effe8009780 comp rx=0 tx=0).stop 2024-08-17T02:45:24.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.188+0000 7efff7000640 1 -- 172.21.15.123:0/3131064505 shutdown_connections 2024-08-17T02:45:24.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.188+0000 7efff7000640 1 --2- 172.21.15.123:0/3131064505 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efff00caa00 0x7efff00c7370 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.188+0000 7efff7000640 1 --2- 172.21.15.123:0/3131064505 >> v2:172.21.15.100:3300/0 conn(0x7efff0158ea0 0x7efff00d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.188+0000 7efff7000640 1 -- 172.21.15.123:0/3131064505 >> 172.21.15.123:0/3131064505 conn(0x7efff006eb90 msgr2=0x7efff00cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:24.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.188+0000 7efff7000640 1 -- 172.21.15.123:0/3131064505 shutdown_connections 2024-08-17T02:45:24.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.188+0000 7efff7000640 1 -- 172.21.15.123:0/3131064505 wait complete. 2024-08-17T02:45:24.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.190+0000 7efff7000640 1 Processor -- start 2024-08-17T02:45:24.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.190+0000 7efff7000640 1 -- start start 2024-08-17T02:45:24.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.191+0000 7efff7000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efff00caa00 0x7efff00c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:24.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.191+0000 7efff7000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efff00d09a0 0x7efff00c3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:24.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.191+0000 7efff7000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efff0158ea0 0x7efff00c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:24.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.191+0000 7efff7000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff00c4070 con 0x7efff00d09a0 2024-08-17T02:45:24.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.191+0000 7efff7000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff00c4350 con 0x7efff0158ea0 2024-08-17T02:45:24.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.191+0000 7efff7000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff00c4630 con 0x7efff00caa00 2024-08-17T02:45:24.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.191+0000 7effefe00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efff00caa00 0x7efff00c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:24.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.191+0000 7efff5000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efff0158ea0 0x7efff00c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:24.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.191+0000 7effefe00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efff00caa00 0x7efff00c6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:39362/0 (socket says 172.21.15.123:39362) 2024-08-17T02:45:24.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.191+0000 7effefe00640 1 -- 172.21.15.123:0/3918556299 learned_addr learned my addr 172.21.15.123:0/3918556299 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-17T02:45:24.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.191+0000 7effe7e00640 1 --2- 172.21.15.123:0/3918556299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efff00d09a0 0x7efff00c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:24.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.191+0000 7effefe00640 1 -- 172.21.15.123:0/3918556299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efff0158ea0 msgr2=0x7efff00c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:24.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.192+0000 7effefe00640 1 --2- 172.21.15.123:0/3918556299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efff0158ea0 0x7efff00c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.192+0000 7effefe00640 1 -- 172.21.15.123:0/3918556299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efff00d09a0 msgr2=0x7efff00c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:24.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.192+0000 7effefe00640 1 --2- 172.21.15.123:0/3918556299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efff00d09a0 0x7efff00c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.192+0000 7effefe00640 1 -- 172.21.15.123:0/3918556299 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe8009a20 con 0x7efff00caa00 2024-08-17T02:45:24.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.192+0000 7effefe00640 1 --2- 172.21.15.123:0/3918556299 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efff00caa00 0x7efff00c6430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7effe000e900 tx=0x7effe00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:24.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.192+0000 7effe7400640 1 -- 172.21.15.123:0/3918556299 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe000c8e0 con 0x7efff00caa00 2024-08-17T02:45:24.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.192+0000 7effe7400640 1 -- 172.21.15.123:0/3918556299 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe000ca40 con 0x7efff00caa00 2024-08-17T02:45:24.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.192+0000 7effe7400640 1 -- 172.21.15.123:0/3918556299 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe000cde0 con 0x7efff00caa00 2024-08-17T02:45:24.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.192+0000 7efff7000640 1 -- 172.21.15.123:0/3918556299 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff009c4b0 con 0x7efff00caa00 2024-08-17T02:45:24.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.193+0000 7efff7000640 1 -- 172.21.15.123:0/3918556299 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff00c6970 con 0x7efff00caa00 2024-08-17T02:45:24.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.193+0000 7effe7400640 1 -- 172.21.15.123:0/3918556299 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7effe0013680 con 0x7efff00caa00 2024-08-17T02:45:24.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.193+0000 7effe7400640 1 -- 172.21.15.123:0/3918556299 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7effe0013d60 con 0x7efff00caa00 2024-08-17T02:45:24.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.194+0000 7efff7000640 1 -- 172.21.15.123:0/3918556299 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff009c310 con 0x7efff00caa00 2024-08-17T02:45:24.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.196+0000 7effe7400640 1 -- 172.21.15.123:0/3918556299 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7efff009c310 con 0x7efff00caa00 2024-08-17T02:45:24.214 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:24.213+0000 7f111e613ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:45:24.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.292+0000 7efff7000640 1 -- 172.21.15.123:0/3918556299 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7d21e3ad-72fa-45c9-9bae-3ab967e4815e", "id": 2} v 0) v1 -- 0x7efff0071050 con 0x7efff00caa00 2024-08-17T02:45:24.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.300+0000 7effe7400640 1 -- 172.21.15.123:0/3918556299 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7d21e3ad-72fa-45c9-9bae-3ab967e4815e", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7effe002a020 con 0x7efff00caa00 2024-08-17T02:45:24.302 INFO:teuthology.orchestra.run.smithi123.stdout:2 2024-08-17T02:45:24.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.301+0000 7efff7000640 1 -- 172.21.15.123:0/3918556299 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efff00caa00 msgr2=0x7efff00c6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:24.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.301+0000 7efff7000640 1 --2- 172.21.15.123:0/3918556299 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efff00caa00 0x7efff00c6430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7effe000e900 tx=0x7effe00090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.301+0000 7efff7000640 1 -- 172.21.15.123:0/3918556299 shutdown_connections 2024-08-17T02:45:24.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.301+0000 7efff7000640 1 --2- 172.21.15.123:0/3918556299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efff0158ea0 0x7efff00c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.301+0000 7efff7000640 1 --2- 172.21.15.123:0/3918556299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efff00d09a0 0x7efff00c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.301+0000 7efff7000640 1 --2- 172.21.15.123:0/3918556299 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efff00caa00 0x7efff00c6430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.301+0000 7efff7000640 1 -- 172.21.15.123:0/3918556299 >> 172.21.15.123:0/3918556299 conn(0x7efff006eb90 msgr2=0x7efff00c7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:24.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.301+0000 7efff7000640 1 -- 172.21.15.123:0/3918556299 shutdown_connections 2024-08-17T02:45:24.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.302+0000 7efff7000640 1 -- 172.21.15.123:0/3918556299 wait complete. 2024-08-17T02:45:24.312 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:24.312+0000 7f111e613ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:45:24.317 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 543c56c4-f565-4f82-8f9a-3bc9252b6423 3 2024-08-17T02:45:24.330 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:24.329+0000 7fb4b1d66ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:45:24.361 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:24.360+0000 7f111e613ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:45:24.432 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:24.430+0000 7fb4b1d66ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:45:24.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.458+0000 7f84edc00640 1 Processor -- start 2024-08-17T02:45:24.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.458+0000 7f84edc00640 1 -- start start 2024-08-17T02:45:24.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.459+0000 7f84edc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f84e8068d10 0x7f84e80cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:24.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.459+0000 7f84edc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e80cd950 con 0x7f84e81591b0 2024-08-17T02:45:24.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.459+0000 7f84edc00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e80ccf80 con 0x7f84e8158de0 2024-08-17T02:45:24.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.459+0000 7f84edc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e80ac3d0 con 0x7f84e8068d10 2024-08-17T02:45:24.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.459+0000 7f84e6a00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f84e8158de0 0x7f84e80cb9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59790/0 (socket says 172.21.15.123:59790) 2024-08-17T02:45:24.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.460+0000 7f84e6a00640 1 -- 172.21.15.123:0/419353564 learned_addr learned my addr 172.21.15.123:0/419353564 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-08-17T02:45:24.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.460+0000 7f84e7400640 1 --2- 172.21.15.123:0/419353564 >> v2:172.21.15.100:3300/0 conn(0x7f84e8068d10 0x7f84e80cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:24.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.460+0000 7f84e5600640 1 -- 172.21.15.123:0/419353564 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219124925 0 0) 0x7f84e80ccf80 con 0x7f84e8158de0 2024-08-17T02:45:24.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.460+0000 7f84e5600640 1 -- 172.21.15.123:0/419353564 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84cc0034e0 con 0x7f84e8158de0 2024-08-17T02:45:24.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.460+0000 7f84e5600640 1 -- 172.21.15.123:0/419353564 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494576467 0 0) 0x7f84d4001110 con 0x7f84e81591b0 2024-08-17T02:45:24.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.460+0000 7f84e7400640 1 -- 172.21.15.123:0/419353564 >> v1:172.21.15.123:6789/0 conn(0x7f84e8158de0 legacy=0x7f84e80cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:24.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.460+0000 7f84e7400640 1 -- 172.21.15.123:0/419353564 >> v1:172.21.15.100:6789/0 conn(0x7f84e81591b0 legacy=0x7f84e8068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:24.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.460+0000 7f84e7400640 1 -- 172.21.15.123:0/419353564 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e80cc100 con 0x7f84e8068d10 2024-08-17T02:45:24.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.461+0000 7f84e7400640 1 --2- 172.21.15.123:0/419353564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e8068d10 0x7f84e80cd410 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009e60 tx=0x7f84e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400cee68a1bdac01 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:24.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.461+0000 7f84e5600640 1 -- 172.21.15.123:0/419353564 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0007550 con 0x7f84e8068d10 2024-08-17T02:45:24.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.461+0000 7f84e5600640 1 -- 172.21.15.123:0/419353564 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e002d050 con 0x7f84e8068d10 2024-08-17T02:45:24.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.461+0000 7f84e5600640 1 -- 172.21.15.123:0/419353564 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0007900 con 0x7f84e8068d10 2024-08-17T02:45:24.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.462+0000 7f84edc00640 1 -- 172.21.15.123:0/419353564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e8068d10 msgr2=0x7f84e80cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:24.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.462+0000 7f84edc00640 1 --2- 172.21.15.123:0/419353564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e8068d10 0x7f84e80cd410 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009e60 tx=0x7f84e0009780 comp rx=0 tx=0).stop 2024-08-17T02:45:24.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.462+0000 7f84edc00640 1 -- 172.21.15.123:0/419353564 shutdown_connections 2024-08-17T02:45:24.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.462+0000 7f84edc00640 1 --2- 172.21.15.123:0/419353564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e8068d10 0x7f84e80cd410 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.462+0000 7f84edc00640 1 -- 172.21.15.123:0/419353564 >> 172.21.15.123:0/419353564 conn(0x7f84e8096a70 msgr2=0x7f84e8096e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:24.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.462+0000 7f84edc00640 1 -- 172.21.15.123:0/419353564 shutdown_connections 2024-08-17T02:45:24.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.462+0000 7f84edc00640 1 -- 172.21.15.123:0/419353564 wait complete. 2024-08-17T02:45:24.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.464+0000 7f84edc00640 1 Processor -- start 2024-08-17T02:45:24.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.464+0000 7f84edc00640 1 -- start start 2024-08-17T02:45:24.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.465+0000 7f84edc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e8068d10 0x7f84e8143c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:24.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.465+0000 7f84edc00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84e8158de0 0x7f84e80c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:24.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.465+0000 7f84edc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84e81591b0 0x7f84e80c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:24.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.465+0000 7f84edc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e80c7720 con 0x7f84e8068d10 2024-08-17T02:45:24.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.465+0000 7f84edc00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e8098270 con 0x7f84e81591b0 2024-08-17T02:45:24.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.465+0000 7f84edc00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e81690d0 con 0x7f84e8158de0 2024-08-17T02:45:24.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.465+0000 7f84e7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84e81591b0 0x7f84e80c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:24.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.465+0000 7f84e6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e8068d10 0x7f84e8143c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:24.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.465+0000 7f84e6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e8068d10 0x7f84e8143c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.123:49172/0 (socket says 172.21.15.123:49172) 2024-08-17T02:45:24.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.465+0000 7f84e6000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84e8158de0 0x7f84e80c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:24.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.465+0000 7f84e7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84e81591b0 0x7f84e80c71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47852/0 (socket says 172.21.15.123:47852) 2024-08-17T02:45:24.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.465+0000 7f84e6a00640 1 -- 172.21.15.123:0/657610088 learned_addr learned my addr 172.21.15.123:0/657610088 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-17T02:45:24.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.465+0000 7f84e6a00640 1 -- 172.21.15.123:0/657610088 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84e8158de0 msgr2=0x7f84e80c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:24.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.465+0000 7f84e6a00640 1 --2- 172.21.15.123:0/657610088 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84e8158de0 0x7f84e80c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.465+0000 7f84e6a00640 1 -- 172.21.15.123:0/657610088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84e81591b0 msgr2=0x7f84e80c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:24.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.465+0000 7f84e6a00640 1 --2- 172.21.15.123:0/657610088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84e81591b0 0x7f84e80c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.465+0000 7f84e6a00640 1 -- 172.21.15.123:0/657610088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e0009a20 con 0x7f84e8068d10 2024-08-17T02:45:24.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.466+0000 7f84e7400640 1 --2- 172.21.15.123:0/657610088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84e81591b0 0x7f84e80c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:24.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.466+0000 7f84e6a00640 1 --2- 172.21.15.123:0/657610088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e8068d10 0x7f84e8143c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f84d800c560 tx=0x7f84d8007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:24.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.466+0000 7f84de000640 1 -- 172.21.15.123:0/657610088 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8005aa0 con 0x7f84e8068d10 2024-08-17T02:45:24.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.466+0000 7f84de000640 1 -- 172.21.15.123:0/657610088 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d8005c00 con 0x7f84e8068d10 2024-08-17T02:45:24.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.466+0000 7f84edc00640 1 -- 172.21.15.123:0/657610088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e816a090 con 0x7f84e8068d10 2024-08-17T02:45:24.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.466+0000 7f84de000640 1 -- 172.21.15.123:0/657610088 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d80070d0 con 0x7f84e8068d10 2024-08-17T02:45:24.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.466+0000 7f84edc00640 1 -- 172.21.15.123:0/657610088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e8097c20 con 0x7f84e8068d10 2024-08-17T02:45:24.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.466+0000 7f84de000640 1 -- 172.21.15.123:0/657610088 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f84d80074c0 con 0x7f84e8068d10 2024-08-17T02:45:24.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.466+0000 7f84de000640 1 -- 172.21.15.123:0/657610088 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f84d801c440 con 0x7f84e8068d10 2024-08-17T02:45:24.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.467+0000 7f84edc00640 1 -- 172.21.15.123:0/657610088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e8071050 con 0x7f84e8068d10 2024-08-17T02:45:24.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.470+0000 7f84de000640 1 -- 172.21.15.123:0/657610088 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f84d8017070 con 0x7f84e8068d10 2024-08-17T02:45:24.483 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:24.481+0000 7fb4b1d66ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:45:24.528 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:24.527+0000 7f111e613ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:45:24.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.542+0000 7f84edc00640 1 -- 172.21.15.123:0/657610088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd new", "uuid": "543c56c4-f565-4f82-8f9a-3bc9252b6423", "id": 3} v 0) v1 -- 0x7f84e80cbec0 con 0x7f84e8068d10 2024-08-17T02:45:24.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.550+0000 7f84de000640 1 -- 172.21.15.123:0/657610088 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "543c56c4-f565-4f82-8f9a-3bc9252b6423", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f84d801ca30 con 0x7f84e8068d10 2024-08-17T02:45:24.551 INFO:teuthology.orchestra.run.smithi123.stdout:3 2024-08-17T02:45:24.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.551+0000 7f84edc00640 1 -- 172.21.15.123:0/657610088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e8068d10 msgr2=0x7f84e8143c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:24.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.551+0000 7f84edc00640 1 --2- 172.21.15.123:0/657610088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e8068d10 0x7f84e8143c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f84d800c560 tx=0x7f84d8007d60 comp rx=0 tx=0).stop 2024-08-17T02:45:24.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.551+0000 7f84edc00640 1 -- 172.21.15.123:0/657610088 shutdown_connections 2024-08-17T02:45:24.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.551+0000 7f84edc00640 1 --2- 172.21.15.123:0/657610088 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84e81591b0 0x7f84e80c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.551+0000 7f84edc00640 1 --2- 172.21.15.123:0/657610088 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84e8158de0 0x7f84e80c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.551+0000 7f84edc00640 1 --2- 172.21.15.123:0/657610088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e8068d10 0x7f84e8143c90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.551+0000 7f84edc00640 1 -- 172.21.15.123:0/657610088 >> 172.21.15.123:0/657610088 conn(0x7f84e8096a70 msgr2=0x7f84e806bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:24.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.551+0000 7f84edc00640 1 -- 172.21.15.123:0/657610088 shutdown_connections 2024-08-17T02:45:24.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.551+0000 7f84edc00640 1 -- 172.21.15.123:0/657610088 wait complete. 2024-08-17T02:45:24.566 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new d761f1a3-519b-47ff-823a-7327d58832dc 4 2024-08-17T02:45:24.584 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:24.584+0000 7f111e613ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:45:24.643 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:24.642+0000 7f111e613ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:45:24.656 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:24.654+0000 7fb4b1d66ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:45:24.714 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:24.712+0000 7fb4b1d66ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:45:24.749 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:24.748+0000 7f111e613ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:45:24.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.749+0000 7f22f7600640 1 Processor -- start 2024-08-17T02:45:24.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.749+0000 7f22f7600640 1 -- start start 2024-08-17T02:45:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.750+0000 7f22f7600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f22f00aae50 0x7f22f00ada50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.751+0000 7f22f7600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f22f00adf90 0x7f22f006d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.751+0000 7f22f7600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f00ad5c0 con 0x7f22f00aaa80 2024-08-17T02:45:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.751+0000 7f22f7600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f00ae3f0 con 0x7f22f00aae50 2024-08-17T02:45:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.751+0000 7f22f7600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f00ac9b0 con 0x7f22f00adf90 2024-08-17T02:45:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.751+0000 7f22efe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f22f00aae50 0x7f22f00ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.751+0000 7f22f5600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f22f00adf90 0x7f22f006d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.751+0000 7f22efe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f22f00aae50 0x7f22f00ada50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47858/0 (socket says 172.21.15.123:47858) 2024-08-17T02:45:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.751+0000 7f22efe00640 1 -- 172.21.15.123:0/3217935395 learned_addr learned my addr 172.21.15.123:0/3217935395 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-17T02:45:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.751+0000 7f22f5600640 1 -- 172.21.15.123:0/3217935395 >> v2:172.21.15.123:3300/0 conn(0x7f22f00aae50 msgr2=0x7f22f00ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:24.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.751+0000 7f22f5600640 1 --2- 172.21.15.123:0/3217935395 >> v2:172.21.15.123:3300/0 conn(0x7f22f00aae50 0x7f22f00ada50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.751+0000 7f22f5600640 1 -- 172.21.15.123:0/3217935395 >> v1:172.21.15.123:6789/0 conn(0x7f22f00aaa80 legacy=0x7f22f01561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:24.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.751+0000 7f22f5600640 1 -- 172.21.15.123:0/3217935395 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f00acc90 con 0x7f22f00adf90 2024-08-17T02:45:24.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.751+0000 7f22efe00640 1 --2- 172.21.15.123:0/3217935395 >> v2:172.21.15.123:3300/0 conn(0x7f22f00aae50 0x7f22f00ada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:24.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.752+0000 7f22f5600640 1 --2- 172.21.15.123:0/3217935395 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f22f00adf90 0x7f22f006d640 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009e60 tx=0x7f22e8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6014d3f26ea48ae server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:24.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.753+0000 7f22ef400640 1 -- 172.21.15.123:0/3217935395 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e8007550 con 0x7f22f00adf90 2024-08-17T02:45:24.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.753+0000 7f22ef400640 1 -- 172.21.15.123:0/3217935395 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e802d050 con 0x7f22f00adf90 2024-08-17T02:45:24.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.753+0000 7f22ef400640 1 -- 172.21.15.123:0/3217935395 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e8007900 con 0x7f22f00adf90 2024-08-17T02:45:24.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.753+0000 7f22f7600640 1 -- 172.21.15.123:0/3217935395 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f22f00adf90 msgr2=0x7f22f006d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:24.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.753+0000 7f22f7600640 1 --2- 172.21.15.123:0/3217935395 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f22f00adf90 0x7f22f006d640 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009e60 tx=0x7f22e8009780 comp rx=0 tx=0).stop 2024-08-17T02:45:24.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.753+0000 7f22f7600640 1 -- 172.21.15.123:0/3217935395 shutdown_connections 2024-08-17T02:45:24.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.753+0000 7f22f7600640 1 --2- 172.21.15.123:0/3217935395 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f22f00adf90 0x7f22f006d640 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.753+0000 7f22f7600640 1 --2- 172.21.15.123:0/3217935395 >> v2:172.21.15.123:3300/0 conn(0x7f22f00aae50 0x7f22f00ada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.753+0000 7f22f7600640 1 -- 172.21.15.123:0/3217935395 >> 172.21.15.123:0/3217935395 conn(0x7f22f00cb8d0 msgr2=0x7f22f00cbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:24.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.753+0000 7f22f7600640 1 -- 172.21.15.123:0/3217935395 shutdown_connections 2024-08-17T02:45:24.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.753+0000 7f22f7600640 1 -- 172.21.15.123:0/3217935395 wait complete. 2024-08-17T02:45:24.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.755+0000 7f22f7600640 1 Processor -- start 2024-08-17T02:45:24.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.755+0000 7f22f7600640 1 -- start start 2024-08-17T02:45:24.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.756+0000 7f22f7600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f00aaa80 0x7f22f015b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:24.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.756+0000 7f22f7600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22f00aae50 0x7f22f0156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:24.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.756+0000 7f22f7600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f22f00adf90 0x7f22f006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:24.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.756+0000 7f22f7600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f01570f0 con 0x7f22f00aaa80 2024-08-17T02:45:24.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.756+0000 7f22f7600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f015a850 con 0x7f22f00aae50 2024-08-17T02:45:24.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.756+0000 7f22f7600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f015ad80 con 0x7f22f00adf90 2024-08-17T02:45:24.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.756+0000 7f22efe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22f00aae50 0x7f22f0156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:24.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.756+0000 7f22f5600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f22f00adf90 0x7f22f006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:24.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.756+0000 7f22efe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22f00aae50 0x7f22f0156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47874/0 (socket says 172.21.15.123:47874) 2024-08-17T02:45:24.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.756+0000 7f22efe00640 1 -- 172.21.15.123:0/1449466746 learned_addr learned my addr 172.21.15.123:0/1449466746 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-17T02:45:24.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.756+0000 7f22f4c00640 1 --2- 172.21.15.123:0/1449466746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f00aaa80 0x7f22f015b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:24.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.756+0000 7f22efe00640 1 -- 172.21.15.123:0/1449466746 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f22f00adf90 msgr2=0x7f22f006d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:24.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.756+0000 7f22efe00640 1 --2- 172.21.15.123:0/1449466746 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f22f00adf90 0x7f22f006d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.756+0000 7f22efe00640 1 -- 172.21.15.123:0/1449466746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f00aaa80 msgr2=0x7f22f015b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:24.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.756+0000 7f22efe00640 1 --2- 172.21.15.123:0/1449466746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f00aaa80 0x7f22f015b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.756+0000 7f22efe00640 1 -- 172.21.15.123:0/1449466746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc009450 con 0x7f22f00aae50 2024-08-17T02:45:24.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.756+0000 7f22f5600640 1 --2- 172.21.15.123:0/1449466746 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f22f00adf90 0x7f22f006d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:24.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.756+0000 7f22f4c00640 1 --2- 172.21.15.123:0/1449466746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f00aaa80 0x7f22f015b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:24.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.757+0000 7f22efe00640 1 --2- 172.21.15.123:0/1449466746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22f00aae50 0x7f22f0156bb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00ecb0 tx=0x7f22dc0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:24.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.757+0000 7f22e3e00640 1 -- 172.21.15.123:0/1449466746 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc00cbc0 con 0x7f22f00aae50 2024-08-17T02:45:24.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.757+0000 7f22e3e00640 1 -- 172.21.15.123:0/1449466746 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22dc00cd20 con 0x7f22f00aae50 2024-08-17T02:45:24.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.757+0000 7f22e3e00640 1 -- 172.21.15.123:0/1449466746 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc0136a0 con 0x7f22f00aae50 2024-08-17T02:45:24.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.757+0000 7f22f7600640 1 -- 172.21.15.123:0/1449466746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e8009a20 con 0x7f22f00aae50 2024-08-17T02:45:24.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.757+0000 7f22f7600640 1 -- 172.21.15.123:0/1449466746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f0158f90 con 0x7f22f00aae50 2024-08-17T02:45:24.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.758+0000 7f22e3e00640 1 -- 172.21.15.123:0/1449466746 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f22dc013a50 con 0x7f22f00aae50 2024-08-17T02:45:24.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.758+0000 7f22f7600640 1 -- 172.21.15.123:0/1449466746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f015b2b0 con 0x7f22f00aae50 2024-08-17T02:45:24.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.758+0000 7f22e3e00640 1 -- 172.21.15.123:0/1449466746 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f22dc013d00 con 0x7f22f00aae50 2024-08-17T02:45:24.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.760+0000 7f22e3e00640 1 -- 172.21.15.123:0/1449466746 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f22dc021060 con 0x7f22f00aae50 2024-08-17T02:45:24.777 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:24.776+0000 7fb4b1d66ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:45:24.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.834+0000 7f22f7600640 1 -- 172.21.15.123:0/1449466746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d761f1a3-519b-47ff-823a-7327d58832dc", "id": 4} v 0) v1 -- 0x7f22f00cc760 con 0x7f22f00aae50 2024-08-17T02:45:24.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.842+0000 7f22e3e00640 1 -- 172.21.15.123:0/1449466746 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d761f1a3-519b-47ff-823a-7327d58832dc", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f22dc0290b0 con 0x7f22f00aae50 2024-08-17T02:45:24.844 INFO:teuthology.orchestra.run.smithi123.stdout:4 2024-08-17T02:45:24.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.843+0000 7f22f7600640 1 -- 172.21.15.123:0/1449466746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22f00aae50 msgr2=0x7f22f0156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:24.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.843+0000 7f22f7600640 1 --2- 172.21.15.123:0/1449466746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22f00aae50 0x7f22f0156bb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00ecb0 tx=0x7f22dc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.843+0000 7f22f7600640 1 -- 172.21.15.123:0/1449466746 shutdown_connections 2024-08-17T02:45:24.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.843+0000 7f22f7600640 1 --2- 172.21.15.123:0/1449466746 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f22f00adf90 0x7f22f006d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.843+0000 7f22f7600640 1 --2- 172.21.15.123:0/1449466746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22f00aae50 0x7f22f0156bb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.843+0000 7f22f7600640 1 --2- 172.21.15.123:0/1449466746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f00aaa80 0x7f22f015b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:24.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.844+0000 7f22f7600640 1 -- 172.21.15.123:0/1449466746 >> 172.21.15.123:0/1449466746 conn(0x7f22f00cb8d0 msgr2=0x7f22f00ab5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:24.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.844+0000 7f22f7600640 1 -- 172.21.15.123:0/1449466746 shutdown_connections 2024-08-17T02:45:24.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:24.844+0000 7f22f7600640 1 -- 172.21.15.123:0/1449466746 wait complete. 2024-08-17T02:45:24.859 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 3b46ce72-4a79-499c-9e4b-015e28c6b671 5 2024-08-17T02:45:24.890 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:24.888+0000 7fb4b1d66ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:45:25.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.002+0000 7fefc7800640 1 Processor -- start 2024-08-17T02:45:25.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.002+0000 7fefc7800640 1 -- start start 2024-08-17T02:45:25.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.004+0000 7fefc7800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefc00adec0 0x7fefc0161890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:25.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.004+0000 7fefc7800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc015b030 con 0x7fefc0156990 2024-08-17T02:45:25.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.004+0000 7fefc7800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc00cc2e0 con 0x7fefc0156d60 2024-08-17T02:45:25.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.004+0000 7fefc7800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc00af950 con 0x7fefc00adec0 2024-08-17T02:45:25.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.004+0000 7fefc5800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefc00adec0 0x7fefc0161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:25.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.004+0000 7fefbfe00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fefc0156d60 0x7fefc00ad7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59812/0 (socket says 172.21.15.123:59812) 2024-08-17T02:45:25.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.004+0000 7fefbfe00640 1 -- 172.21.15.123:0/3882335754 learned_addr learned my addr 172.21.15.123:0/3882335754 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-08-17T02:45:25.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.004+0000 7fefc5800640 1 -- 172.21.15.123:0/3882335754 >> v1:172.21.15.123:6789/0 conn(0x7fefc0156d60 legacy=0x7fefc00ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.004+0000 7fefc5800640 1 -- 172.21.15.123:0/3882335754 >> v1:172.21.15.100:6789/0 conn(0x7fefc0156990 legacy=0x7fefc00b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.004+0000 7fefc5800640 1 -- 172.21.15.123:0/3882335754 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc00b1110 con 0x7fefc00adec0 2024-08-17T02:45:25.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.005+0000 7fefc5800640 1 --2- 172.21.15.123:0/3882335754 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefc00adec0 0x7fefc0161890 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009e90 tx=0x7fefb8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d190457f6747bcce server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:25.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.006+0000 7fefbf400640 1 -- 172.21.15.123:0/3882335754 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb8007550 con 0x7fefc00adec0 2024-08-17T02:45:25.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.006+0000 7fefbf400640 1 -- 172.21.15.123:0/3882335754 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb802d050 con 0x7fefc00adec0 2024-08-17T02:45:25.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.006+0000 7fefbf400640 1 -- 172.21.15.123:0/3882335754 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb80078e0 con 0x7fefc00adec0 2024-08-17T02:45:25.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.006+0000 7fefc7800640 1 -- 172.21.15.123:0/3882335754 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefc00adec0 msgr2=0x7fefc0161890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.006+0000 7fefc7800640 1 --2- 172.21.15.123:0/3882335754 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefc00adec0 0x7fefc0161890 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009e90 tx=0x7fefb8009780 comp rx=0 tx=0).stop 2024-08-17T02:45:25.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.006+0000 7fefc7800640 1 -- 172.21.15.123:0/3882335754 shutdown_connections 2024-08-17T02:45:25.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.006+0000 7fefc7800640 1 --2- 172.21.15.123:0/3882335754 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefc00adec0 0x7fefc0161890 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.006+0000 7fefc7800640 1 -- 172.21.15.123:0/3882335754 >> 172.21.15.123:0/3882335754 conn(0x7fefc0067750 msgr2=0x7fefc00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:25.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.006+0000 7fefc7800640 1 -- 172.21.15.123:0/3882335754 shutdown_connections 2024-08-17T02:45:25.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.006+0000 7fefc7800640 1 -- 172.21.15.123:0/3882335754 wait complete. 2024-08-17T02:45:25.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.008+0000 7fefc7800640 1 Processor -- start 2024-08-17T02:45:25.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.008+0000 7fefc7800640 1 -- start start 2024-08-17T02:45:25.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.009+0000 7fefc7800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefc00adec0 0x7fefc00ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:25.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.009+0000 7fefc7800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefc0156990 0x7fefc0155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:25.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.009+0000 7fefc7800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefc0156d60 0x7fefc00abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:25.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.009+0000 7fefc7800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc00add10 con 0x7fefc0156990 2024-08-17T02:45:25.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.009+0000 7fefc7800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc00ad340 con 0x7fefc0156d60 2024-08-17T02:45:25.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.009+0000 7fefc7800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc00ac730 con 0x7fefc00adec0 2024-08-17T02:45:25.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.009+0000 7fefc4e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefc00adec0 0x7fefc00ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:25.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.009+0000 7fefc5800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefc0156d60 0x7fefc00abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:25.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.009+0000 7fefc4e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefc00adec0 0x7fefc00ad7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:39414/0 (socket says 172.21.15.123:39414) 2024-08-17T02:45:25.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.009+0000 7fefc4e00640 1 -- 172.21.15.123:0/4254659049 learned_addr learned my addr 172.21.15.123:0/4254659049 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-17T02:45:25.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.009+0000 7fefbfe00640 1 --2- 172.21.15.123:0/4254659049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefc0156990 0x7fefc0155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:25.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.009+0000 7fefc4e00640 1 -- 172.21.15.123:0/4254659049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefc0156d60 msgr2=0x7fefc00abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.009+0000 7fefc4e00640 1 --2- 172.21.15.123:0/4254659049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefc0156d60 0x7fefc00abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.009+0000 7fefc4e00640 1 -- 172.21.15.123:0/4254659049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefc0156990 msgr2=0x7fefc0155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.009+0000 7fefc4e00640 1 --2- 172.21.15.123:0/4254659049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefc0156990 0x7fefc0155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.009+0000 7fefc4e00640 1 -- 172.21.15.123:0/4254659049 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb8009a20 con 0x7fefc00adec0 2024-08-17T02:45:25.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.010+0000 7fefc4e00640 1 --2- 172.21.15.123:0/4254659049 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefc00adec0 0x7fefc00ad7d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fefb400c590 tx=0x7fefb4007ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:25.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.010+0000 7fefb3e00640 1 -- 172.21.15.123:0/4254659049 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb4012630 con 0x7fefc00adec0 2024-08-17T02:45:25.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.010+0000 7fefb3e00640 1 -- 172.21.15.123:0/4254659049 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb40127b0 con 0x7fefc00adec0 2024-08-17T02:45:25.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.010+0000 7fefb3e00640 1 -- 172.21.15.123:0/4254659049 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb4012b70 con 0x7fefc00adec0 2024-08-17T02:45:25.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.010+0000 7fefc7800640 1 -- 172.21.15.123:0/4254659049 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc00aca10 con 0x7fefc00adec0 2024-08-17T02:45:25.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.010+0000 7fefc7800640 1 -- 172.21.15.123:0/4254659049 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc00acfd0 con 0x7fefc00adec0 2024-08-17T02:45:25.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.010+0000 7fefb3e00640 1 -- 172.21.15.123:0/4254659049 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fefb401b400 con 0x7fefc00adec0 2024-08-17T02:45:25.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.010+0000 7fefb3e00640 1 -- 172.21.15.123:0/4254659049 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fefb4011380 con 0x7fefc00adec0 2024-08-17T02:45:25.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.011+0000 7fefc7800640 1 -- 172.21.15.123:0/4254659049 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc0071050 con 0x7fefc00adec0 2024-08-17T02:45:25.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.013+0000 7fefb3e00640 1 -- 172.21.15.123:0/4254659049 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fefb401b6b0 con 0x7fefc00adec0 2024-08-17T02:45:25.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.086+0000 7fefc7800640 1 -- 172.21.15.123:0/4254659049 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3b46ce72-4a79-499c-9e4b-015e28c6b671", "id": 5} v 0) v1 -- 0x7fefc00640d0 con 0x7fefc00adec0 2024-08-17T02:45:25.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.095+0000 7fefb3e00640 1 -- 172.21.15.123:0/4254659049 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3b46ce72-4a79-499c-9e4b-015e28c6b671", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fefb401b850 con 0x7fefc00adec0 2024-08-17T02:45:25.096 INFO:teuthology.orchestra.run.smithi123.stdout:5 2024-08-17T02:45:25.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.096+0000 7fefc7800640 1 -- 172.21.15.123:0/4254659049 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefc00adec0 msgr2=0x7fefc00ad7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.096+0000 7fefc7800640 1 --2- 172.21.15.123:0/4254659049 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefc00adec0 0x7fefc00ad7d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fefb400c590 tx=0x7fefb4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.096+0000 7fefc7800640 1 -- 172.21.15.123:0/4254659049 shutdown_connections 2024-08-17T02:45:25.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.096+0000 7fefc7800640 1 --2- 172.21.15.123:0/4254659049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefc0156d60 0x7fefc00abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.096+0000 7fefc7800640 1 --2- 172.21.15.123:0/4254659049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefc0156990 0x7fefc0155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.096+0000 7fefc7800640 1 --2- 172.21.15.123:0/4254659049 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefc00adec0 0x7fefc00ad7d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.096+0000 7fefc7800640 1 -- 172.21.15.123:0/4254659049 >> 172.21.15.123:0/4254659049 conn(0x7fefc0067750 msgr2=0x7fefc0153620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:25.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.096+0000 7fefc7800640 1 -- 172.21.15.123:0/4254659049 shutdown_connections 2024-08-17T02:45:25.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.096+0000 7fefc7800640 1 -- 172.21.15.123:0/4254659049 wait complete. 2024-08-17T02:45:25.111 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 61ea0cd7-b91e-4cd5-98a1-62e53429f21c 6 2024-08-17T02:45:25.192 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:25.191+0000 7f111e613ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:45:25.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.294+0000 7fe6f1600640 1 Processor -- start 2024-08-17T02:45:25.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.294+0000 7fe6f1600640 1 -- start start 2024-08-17T02:45:25.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.295+0000 7fe6f1600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe6ec158ea0 0x7fe6ec0d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:25.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.295+0000 7fe6f1600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6ec0caa00 0x7fe6ec0c7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:25.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.295+0000 7fe6f1600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6ec06f240 con 0x7fe6ec0d09a0 2024-08-17T02:45:25.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.295+0000 7fe6f1600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6ec0c6f20 con 0x7fe6ec158ea0 2024-08-17T02:45:25.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.295+0000 7fe6f1600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec0cf410 con 0x7fe6ec0caa00 2024-08-17T02:45:25.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.295+0000 7fe6eb400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6ec0caa00 0x7fe6ec0c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:25.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.295+0000 7fe6eaa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe6ec158ea0 0x7fe6ec0d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:25.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.295+0000 7fe6eaa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe6ec158ea0 0x7fe6ec0d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.123:49204/0 (socket says 172.21.15.123:49204) 2024-08-17T02:45:25.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.295+0000 7fe6eb400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6ec0caa00 0x7fe6ec0c7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:39424/0 (socket says 172.21.15.123:39424) 2024-08-17T02:45:25.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.295+0000 7fe6eaa00640 1 -- 172.21.15.123:0/2003986189 learned_addr learned my addr 172.21.15.123:0/2003986189 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-17T02:45:25.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.296+0000 7fe6eb400640 1 -- 172.21.15.123:0/2003986189 >> v2:172.21.15.100:3300/0 conn(0x7fe6ec158ea0 msgr2=0x7fe6ec0d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:25.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.296+0000 7fe6eb400640 1 --2- 172.21.15.123:0/2003986189 >> v2:172.21.15.100:3300/0 conn(0x7fe6ec158ea0 0x7fe6ec0d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.296+0000 7fe6eb400640 1 -- 172.21.15.123:0/2003986189 >> v1:172.21.15.100:6789/0 conn(0x7fe6ec0d09a0 legacy=0x7fe6ec0ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.296+0000 7fe6eb400640 1 -- 172.21.15.123:0/2003986189 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec0ceb70 con 0x7fe6ec0caa00 2024-08-17T02:45:25.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.296+0000 7fe6eaa00640 1 --2- 172.21.15.123:0/2003986189 >> v2:172.21.15.100:3300/0 conn(0x7fe6ec158ea0 0x7fe6ec0d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:25.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.297+0000 7fe6eb400640 1 --2- 172.21.15.123:0/2003986189 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6ec0caa00 0x7fe6ec0c7370 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009e60 tx=0x7fe6e4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87410cbe62553f33 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:25.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.297+0000 7fe6e9600640 1 -- 172.21.15.123:0/2003986189 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4007550 con 0x7fe6ec0caa00 2024-08-17T02:45:25.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.297+0000 7fe6e9600640 1 -- 172.21.15.123:0/2003986189 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e402d050 con 0x7fe6ec0caa00 2024-08-17T02:45:25.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.297+0000 7fe6e9600640 1 -- 172.21.15.123:0/2003986189 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4007920 con 0x7fe6ec0caa00 2024-08-17T02:45:25.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.298+0000 7fe6f1600640 1 -- 172.21.15.123:0/2003986189 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6ec0caa00 msgr2=0x7fe6ec0c7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.298+0000 7fe6f1600640 1 --2- 172.21.15.123:0/2003986189 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6ec0caa00 0x7fe6ec0c7370 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009e60 tx=0x7fe6e4009780 comp rx=0 tx=0).stop 2024-08-17T02:45:25.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.298+0000 7fe6f1600640 1 -- 172.21.15.123:0/2003986189 shutdown_connections 2024-08-17T02:45:25.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.298+0000 7fe6f1600640 1 --2- 172.21.15.123:0/2003986189 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6ec0caa00 0x7fe6ec0c7370 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.298+0000 7fe6f1600640 1 --2- 172.21.15.123:0/2003986189 >> v2:172.21.15.100:3300/0 conn(0x7fe6ec158ea0 0x7fe6ec0d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.298+0000 7fe6f1600640 1 -- 172.21.15.123:0/2003986189 >> 172.21.15.123:0/2003986189 conn(0x7fe6ec06eb90 msgr2=0x7fe6ec0cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:25.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.298+0000 7fe6f1600640 1 -- 172.21.15.123:0/2003986189 shutdown_connections 2024-08-17T02:45:25.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.298+0000 7fe6f1600640 1 -- 172.21.15.123:0/2003986189 wait complete. 2024-08-17T02:45:25.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.299+0000 7fe6f1600640 1 Processor -- start 2024-08-17T02:45:25.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.299+0000 7fe6f1600640 1 -- start start 2024-08-17T02:45:25.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.300+0000 7fe6f1600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6ec0caa00 0x7fe6ec168f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:25.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.300+0000 7fe6f1600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6ec0d09a0 0x7fe6ec09c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:25.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.300+0000 7fe6f1600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec158ea0 0x7fe6ec156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:25.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.300+0000 7fe6f1600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec09d6e0 con 0x7fe6ec0d09a0 2024-08-17T02:45:25.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.300+0000 7fe6f1600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec0b26f0 con 0x7fe6ec158ea0 2024-08-17T02:45:25.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.300+0000 7fe6f1600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec09c810 con 0x7fe6ec0caa00 2024-08-17T02:45:25.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.300+0000 7fe6eaa00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6ec0caa00 0x7fe6ec168f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:25.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.301+0000 7fe6eaa00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6ec0caa00 0x7fe6ec168f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:39426/0 (socket says 172.21.15.123:39426) 2024-08-17T02:45:25.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.301+0000 7fe6eaa00640 1 -- 172.21.15.123:0/3002179660 learned_addr learned my addr 172.21.15.123:0/3002179660 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-17T02:45:25.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.301+0000 7fe6ea000640 1 --2- 172.21.15.123:0/3002179660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6ec0d09a0 0x7fe6ec09c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:25.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.301+0000 7fe6eb400640 1 --2- 172.21.15.123:0/3002179660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec158ea0 0x7fe6ec156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:25.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.301+0000 7fe6eaa00640 1 -- 172.21.15.123:0/3002179660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec158ea0 msgr2=0x7fe6ec156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.301+0000 7fe6eaa00640 1 --2- 172.21.15.123:0/3002179660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec158ea0 0x7fe6ec156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.301+0000 7fe6eaa00640 1 -- 172.21.15.123:0/3002179660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6ec0d09a0 msgr2=0x7fe6ec09c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.301+0000 7fe6eaa00640 1 --2- 172.21.15.123:0/3002179660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6ec0d09a0 0x7fe6ec09c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.301+0000 7fe6eaa00640 1 -- 172.21.15.123:0/3002179660 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6dc009450 con 0x7fe6ec0caa00 2024-08-17T02:45:25.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.301+0000 7fe6eb400640 1 --2- 172.21.15.123:0/3002179660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec158ea0 0x7fe6ec156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:25.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.301+0000 7fe6eaa00640 1 --2- 172.21.15.123:0/3002179660 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6ec0caa00 0x7fe6ec168f80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00ea30 tx=0x7fe6dc0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:25.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.301+0000 7fe6e2000640 1 -- 172.21.15.123:0/3002179660 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc00ca10 con 0x7fe6ec0caa00 2024-08-17T02:45:25.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.302+0000 7fe6e2000640 1 -- 172.21.15.123:0/3002179660 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc00cb70 con 0x7fe6ec0caa00 2024-08-17T02:45:25.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.302+0000 7fe6e2000640 1 -- 172.21.15.123:0/3002179660 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc013470 con 0x7fe6ec0caa00 2024-08-17T02:45:25.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.302+0000 7fe6f1600640 1 -- 172.21.15.123:0/3002179660 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e4009a20 con 0x7fe6ec0caa00 2024-08-17T02:45:25.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.302+0000 7fe6f1600640 1 -- 172.21.15.123:0/3002179660 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ec09cdb0 con 0x7fe6ec0caa00 2024-08-17T02:45:25.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.302+0000 7fe6e2000640 1 -- 172.21.15.123:0/3002179660 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fe6dc005970 con 0x7fe6ec0caa00 2024-08-17T02:45:25.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.302+0000 7fe6e2000640 1 -- 172.21.15.123:0/3002179660 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fe6dc005c20 con 0x7fe6ec0caa00 2024-08-17T02:45:25.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.303+0000 7fe6f1600640 1 -- 172.21.15.123:0/3002179660 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6ec071050 con 0x7fe6ec0caa00 2024-08-17T02:45:25.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.305+0000 7fe6e2000640 1 -- 172.21.15.123:0/3002179660 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fe6dc021060 con 0x7fe6ec0caa00 2024-08-17T02:45:25.359 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:25.357+0000 7fb4b1d66ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:45:25.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.379+0000 7fe6f1600640 1 -- 172.21.15.123:0/3002179660 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd new", "uuid": "61ea0cd7-b91e-4cd5-98a1-62e53429f21c", "id": 6} v 0) v1 -- 0x7fe6ec0cf600 con 0x7fe6ec0caa00 2024-08-17T02:45:25.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.385+0000 7fe6e2000640 1 -- 172.21.15.123:0/3002179660 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "61ea0cd7-b91e-4cd5-98a1-62e53429f21c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe6dc0290b0 con 0x7fe6ec0caa00 2024-08-17T02:45:25.387 INFO:teuthology.orchestra.run.smithi123.stdout:6 2024-08-17T02:45:25.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.386+0000 7fe6f1600640 1 -- 172.21.15.123:0/3002179660 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6ec0caa00 msgr2=0x7fe6ec168f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.386+0000 7fe6f1600640 1 --2- 172.21.15.123:0/3002179660 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6ec0caa00 0x7fe6ec168f80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00ea30 tx=0x7fe6dc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.386+0000 7fe6f1600640 1 -- 172.21.15.123:0/3002179660 shutdown_connections 2024-08-17T02:45:25.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.386+0000 7fe6f1600640 1 --2- 172.21.15.123:0/3002179660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec158ea0 0x7fe6ec156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.386+0000 7fe6f1600640 1 --2- 172.21.15.123:0/3002179660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6ec0d09a0 0x7fe6ec09c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.386+0000 7fe6f1600640 1 --2- 172.21.15.123:0/3002179660 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6ec0caa00 0x7fe6ec168f80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.386+0000 7fe6f1600640 1 -- 172.21.15.123:0/3002179660 >> 172.21.15.123:0/3002179660 conn(0x7fe6ec06eb90 msgr2=0x7fe6ec0b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:25.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.386+0000 7fe6f1600640 1 -- 172.21.15.123:0/3002179660 shutdown_connections 2024-08-17T02:45:25.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.386+0000 7fe6f1600640 1 -- 172.21.15.123:0/3002179660 wait complete. 2024-08-17T02:45:25.402 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 8132fd78-fb77-4543-b0ae-030456d0ba03 7 2024-08-17T02:45:25.455 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:25.455+0000 7f111e613ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:45:25.513 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:25.513+0000 7f111e613ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:45:25.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.545+0000 7f0ac3200640 1 Processor -- start 2024-08-17T02:45:25.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.545+0000 7f0ac3200640 1 -- start start 2024-08-17T02:45:25.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.546+0000 7f0ac3200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0ac4159aa0 0x7f0ac40ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:25.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.547+0000 7f0ac3200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ac40ccf00 0x7f0ac41629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:25.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.547+0000 7f0ac3200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac40cad60 con 0x7f0ac4159e70 2024-08-17T02:45:25.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.547+0000 7f0ac3200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac40c4b90 con 0x7f0ac4159aa0 2024-08-17T02:45:25.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.547+0000 7f0ac3200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac40ce630 con 0x7f0ac40ccf00 2024-08-17T02:45:25.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.547+0000 7f0ac1e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0ac4159aa0 0x7f0ac40ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:25.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.547+0000 7f0ac1e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0ac4159aa0 0x7f0ac40ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47898/0 (socket says 172.21.15.123:47898) 2024-08-17T02:45:25.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.547+0000 7f0ac1e00640 1 -- 172.21.15.123:0/327269038 learned_addr learned my addr 172.21.15.123:0/327269038 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-17T02:45:25.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.547+0000 7f0ac2800640 1 --2- 172.21.15.123:0/327269038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ac40ccf00 0x7f0ac41629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:25.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.547+0000 7f0ac1e00640 1 -- 172.21.15.123:0/327269038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ac40ccf00 msgr2=0x7f0ac41629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:25.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.547+0000 7f0ac1e00640 1 --2- 172.21.15.123:0/327269038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ac40ccf00 0x7f0ac41629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.547+0000 7f0ac1e00640 1 -- 172.21.15.123:0/327269038 >> v1:172.21.15.100:6789/0 conn(0x7f0ac4159e70 legacy=0x7f0ac40cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.547+0000 7f0ac1e00640 1 -- 172.21.15.123:0/327269038 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac40ce910 con 0x7f0ac4159aa0 2024-08-17T02:45:25.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.547+0000 7f0ac2800640 1 --2- 172.21.15.123:0/327269038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ac40ccf00 0x7f0ac41629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:25.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.548+0000 7f0ac1e00640 1 --2- 172.21.15.123:0/327269038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac4159aa0 0x7f0ac40ce050 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009910 tx=0x7f0ab40091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6583838fa48c76b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:25.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.548+0000 7f0ac0a00640 1 -- 172.21.15.123:0/327269038 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab402ae40 con 0x7f0ac4159aa0 2024-08-17T02:45:25.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.549+0000 7f0ac0a00640 1 -- 172.21.15.123:0/327269038 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab4032440 con 0x7f0ac4159aa0 2024-08-17T02:45:25.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.549+0000 7f0ac0a00640 1 -- 172.21.15.123:0/327269038 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4032820 con 0x7f0ac4159aa0 2024-08-17T02:45:25.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.549+0000 7f0ac3200640 1 -- 172.21.15.123:0/327269038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac4159aa0 msgr2=0x7f0ac40ce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.549+0000 7f0ac3200640 1 --2- 172.21.15.123:0/327269038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac4159aa0 0x7f0ac40ce050 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009910 tx=0x7f0ab40091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.549+0000 7f0ac3200640 1 -- 172.21.15.123:0/327269038 shutdown_connections 2024-08-17T02:45:25.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.549+0000 7f0ac3200640 1 --2- 172.21.15.123:0/327269038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ac40ccf00 0x7f0ac41629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.549+0000 7f0ac3200640 1 --2- 172.21.15.123:0/327269038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac4159aa0 0x7f0ac40ce050 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.549+0000 7f0ac3200640 1 -- 172.21.15.123:0/327269038 >> 172.21.15.123:0/327269038 conn(0x7f0ac4099040 msgr2=0x7f0ac406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:25.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.549+0000 7f0ac3200640 1 -- 172.21.15.123:0/327269038 shutdown_connections 2024-08-17T02:45:25.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.549+0000 7f0ac3200640 1 -- 172.21.15.123:0/327269038 wait complete. 2024-08-17T02:45:25.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.551+0000 7f0ac3200640 1 Processor -- start 2024-08-17T02:45:25.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.551+0000 7f0ac3200640 1 -- start start 2024-08-17T02:45:25.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.552+0000 7f0ac3200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac40ccf00 0x7f0ac4099b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:25.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.552+0000 7f0ac3200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac4159aa0 0x7f0ac40c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:25.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.552+0000 7f0ac3200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ac4159e70 0x7f0ac4169240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:25.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.552+0000 7f0ac3200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac40c7210 con 0x7f0ac40ccf00 2024-08-17T02:45:25.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.552+0000 7f0ac3200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac4169b00 con 0x7f0ac4159aa0 2024-08-17T02:45:25.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.552+0000 7f0ac3200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac4169de0 con 0x7f0ac4159e70 2024-08-17T02:45:25.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.552+0000 7f0ac1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac40ccf00 0x7f0ac4099b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:25.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.552+0000 7f0ac2800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ac4159e70 0x7f0ac4169240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:25.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.552+0000 7f0ac1400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac4159aa0 0x7f0ac40c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:25.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.552+0000 7f0ac1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac40ccf00 0x7f0ac4099b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.123:49224/0 (socket says 172.21.15.123:49224) 2024-08-17T02:45:25.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.552+0000 7f0ac1e00640 1 -- 172.21.15.123:0/743878353 learned_addr learned my addr 172.21.15.123:0/743878353 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-08-17T02:45:25.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.553+0000 7f0ac1e00640 1 -- 172.21.15.123:0/743878353 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ac4159e70 msgr2=0x7f0ac4169240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.553+0000 7f0ac1e00640 1 --2- 172.21.15.123:0/743878353 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ac4159e70 0x7f0ac4169240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.553+0000 7f0ac1e00640 1 -- 172.21.15.123:0/743878353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac4159aa0 msgr2=0x7f0ac40c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.553+0000 7f0ac1e00640 1 --2- 172.21.15.123:0/743878353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac4159aa0 0x7f0ac40c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.553+0000 7f0ac1e00640 1 -- 172.21.15.123:0/743878353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc009a20 con 0x7f0ac40ccf00 2024-08-17T02:45:25.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.553+0000 7f0ac1400640 1 --2- 172.21.15.123:0/743878353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac4159aa0 0x7f0ac40c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:25.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.553+0000 7f0ac1e00640 1 --2- 172.21.15.123:0/743878353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac40ccf00 0x7f0ac4099b60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4035040 tx=0x7f0ab4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:25.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.553+0000 7f0ab9600640 1 -- 172.21.15.123:0/743878353 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4031bb0 con 0x7f0ac40ccf00 2024-08-17T02:45:25.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.553+0000 7f0ab9600640 1 -- 172.21.15.123:0/743878353 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab4031d70 con 0x7f0ac40ccf00 2024-08-17T02:45:25.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.553+0000 7f0ab9600640 1 -- 172.21.15.123:0/743878353 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab403d670 con 0x7f0ac40ccf00 2024-08-17T02:45:25.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.553+0000 7f0ac3200640 1 -- 172.21.15.123:0/743878353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab4009450 con 0x7f0ac40ccf00 2024-08-17T02:45:25.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.553+0000 7f0ac3200640 1 -- 172.21.15.123:0/743878353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac40c6ea0 con 0x7f0ac40ccf00 2024-08-17T02:45:25.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.554+0000 7f0ab9600640 1 -- 172.21.15.123:0/743878353 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f0ab4039040 con 0x7f0ac40ccf00 2024-08-17T02:45:25.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.554+0000 7f0ab9600640 1 -- 172.21.15.123:0/743878353 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f0ab402ae40 con 0x7f0ac40ccf00 2024-08-17T02:45:25.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.554+0000 7f0ac3200640 1 -- 172.21.15.123:0/743878353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac4071050 con 0x7f0ac40ccf00 2024-08-17T02:45:25.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.557+0000 7f0ab9600640 1 -- 172.21.15.123:0/743878353 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f0ab4042070 con 0x7f0ac40ccf00 2024-08-17T02:45:25.623 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:25.623+0000 7f111e613ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:45:25.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.631+0000 7f0ac3200640 1 -- 172.21.15.123:0/743878353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8132fd78-fb77-4543-b0ae-030456d0ba03", "id": 7} v 0) v1 -- 0x7f0ac406f480 con 0x7f0ac40ccf00 2024-08-17T02:45:25.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.636+0000 7f0ab9600640 1 -- 172.21.15.123:0/743878353 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8132fd78-fb77-4543-b0ae-030456d0ba03", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0ab4037070 con 0x7f0ac40ccf00 2024-08-17T02:45:25.638 INFO:teuthology.orchestra.run.smithi123.stdout:7 2024-08-17T02:45:25.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.638+0000 7f0ac3200640 1 -- 172.21.15.123:0/743878353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac40ccf00 msgr2=0x7f0ac4099b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.638+0000 7f0ac3200640 1 --2- 172.21.15.123:0/743878353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac40ccf00 0x7f0ac4099b60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4035040 tx=0x7f0ab4032000 comp rx=0 tx=0).stop 2024-08-17T02:45:25.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.638+0000 7f0ac3200640 1 -- 172.21.15.123:0/743878353 shutdown_connections 2024-08-17T02:45:25.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.638+0000 7f0ac3200640 1 --2- 172.21.15.123:0/743878353 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ac4159e70 0x7f0ac4169240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.638+0000 7f0ac3200640 1 --2- 172.21.15.123:0/743878353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac4159aa0 0x7f0ac40c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.638+0000 7f0ac3200640 1 --2- 172.21.15.123:0/743878353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac40ccf00 0x7f0ac4099b60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.638+0000 7f0ac3200640 1 -- 172.21.15.123:0/743878353 >> 172.21.15.123:0/743878353 conn(0x7f0ac4099040 msgr2=0x7f0ac40c5310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:25.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.638+0000 7f0ac3200640 1 -- 172.21.15.123:0/743878353 shutdown_connections 2024-08-17T02:45:25.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-08-17T02:45:25.638+0000 7f0ac3200640 1 -- 172.21.15.123:0/743878353 wait complete. 2024-08-17T02:45:25.640 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:25.639+0000 7fb4b1d66ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:45:25.659 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-17T02:45:25.659 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-17T02:45:25.663 INFO:tasks.ceph.osd.0:Started 2024-08-17T02:45:25.663 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-17T02:45:25.663 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-17T02:45:25.667 INFO:tasks.ceph.osd.1:Started 2024-08-17T02:45:25.667 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-17T02:45:25.667 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-17T02:45:25.671 INFO:tasks.ceph.osd.2:Started 2024-08-17T02:45:25.671 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-17T02:45:25.671 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-17T02:45:25.676 INFO:tasks.ceph.osd.3:Started 2024-08-17T02:45:25.676 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-17T02:45:25.676 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-17T02:45:25.680 INFO:tasks.ceph.osd.4:Started 2024-08-17T02:45:25.680 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-17T02:45:25.680 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-17T02:45:25.684 INFO:tasks.ceph.osd.5:Started 2024-08-17T02:45:25.684 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-17T02:45:25.684 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-17T02:45:25.688 INFO:tasks.ceph.osd.6:Started 2024-08-17T02:45:25.688 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-17T02:45:25.688 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-17T02:45:25.693 INFO:tasks.ceph.osd.7:Started 2024-08-17T02:45:25.694 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:45:25.715 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:25.714+0000 7fb4b1d66ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:45:25.861 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:25.859+0000 7fb4b1d66ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:45:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.934+0000 7fd14de00640 1 Processor -- start 2024-08-17T02:45:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.934+0000 7fd14de00640 1 -- start start 2024-08-17T02:45:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.935+0000 7fd14de00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd148155a20 0x7fd1480adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.935+0000 7fd14de00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd148156670 con 0x7fd14806df00 2024-08-17T02:45:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.935+0000 7fd14de00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd14806e5e0 con 0x7fd148155df0 2024-08-17T02:45:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.935+0000 7fd14de00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1480b0350 con 0x7fd148155a20 2024-08-17T02:45:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.936+0000 7fd147400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd14806df00 0x7fd148156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44228/0 (socket says 172.21.15.100:44228) 2024-08-17T02:45:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.936+0000 7fd147400640 1 -- 172.21.15.100:0/4271721886 learned_addr learned my addr 172.21.15.100:0/4271721886 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.936+0000 7fd146a00640 1 --2- 172.21.15.100:0/4271721886 >> v2:172.21.15.100:3300/0 conn(0x7fd148155a20 0x7fd1480adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.936+0000 7fd145600640 1 -- 172.21.15.100:0/4271721886 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882196139 0 0) 0x7fd148156670 con 0x7fd14806df00 2024-08-17T02:45:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.936+0000 7fd145600640 1 -- 172.21.15.100:0/4271721886 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd12c0034e0 con 0x7fd14806df00 2024-08-17T02:45:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.936+0000 7fd145600640 1 -- 172.21.15.100:0/4271721886 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720890849 0 0) 0x7fd14806e5e0 con 0x7fd148155df0 2024-08-17T02:45:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.936+0000 7fd145600640 1 -- 172.21.15.100:0/4271721886 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd148156670 con 0x7fd148155df0 2024-08-17T02:45:25.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.936+0000 7fd146a00640 1 -- 172.21.15.100:0/4271721886 >> v1:172.21.15.123:6789/0 conn(0x7fd148155df0 legacy=0x7fd14806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.936+0000 7fd146a00640 1 -- 172.21.15.100:0/4271721886 >> v1:172.21.15.100:6789/0 conn(0x7fd14806df00 legacy=0x7fd148156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.936+0000 7fd146a00640 1 -- 172.21.15.100:0/4271721886 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14806e8c0 con 0x7fd148155a20 2024-08-17T02:45:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.937+0000 7fd146a00640 1 --2- 172.21.15.100:0/4271721886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd148155a20 0x7fd1480adf10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd138009850 tx=0x7fd1380090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4611cf275ec38c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.937+0000 7fd145600640 1 -- 172.21.15.100:0/4271721886 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13802ad90 con 0x7fd148155a20 2024-08-17T02:45:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.938+0000 7fd145600640 1 -- 172.21.15.100:0/4271721886 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd138032440 con 0x7fd148155a20 2024-08-17T02:45:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.938+0000 7fd145600640 1 -- 172.21.15.100:0/4271721886 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1380327c0 con 0x7fd148155a20 2024-08-17T02:45:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.938+0000 7fd14de00640 1 -- 172.21.15.100:0/4271721886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd148155a20 msgr2=0x7fd1480adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.938+0000 7fd14de00640 1 --2- 172.21.15.100:0/4271721886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd148155a20 0x7fd1480adf10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd138009850 tx=0x7fd1380090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.938+0000 7fd14de00640 1 -- 172.21.15.100:0/4271721886 shutdown_connections 2024-08-17T02:45:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.938+0000 7fd14de00640 1 --2- 172.21.15.100:0/4271721886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd148155a20 0x7fd1480adf10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.938+0000 7fd14de00640 1 -- 172.21.15.100:0/4271721886 >> 172.21.15.100:0/4271721886 conn(0x7fd1480cb9b0 msgr2=0x7fd1480cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:25.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.938+0000 7fd14de00640 1 -- 172.21.15.100:0/4271721886 shutdown_connections 2024-08-17T02:45:25.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.938+0000 7fd14de00640 1 -- 172.21.15.100:0/4271721886 wait complete. 2024-08-17T02:45:25.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.940+0000 7fd14de00640 1 Processor -- start 2024-08-17T02:45:25.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.940+0000 7fd14de00640 1 -- start start 2024-08-17T02:45:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.941+0000 7fd14de00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd14806df00 0x7fd1481508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.941+0000 7fd14de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd148155a20 0x7fd1480c09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.941+0000 7fd14de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd148155df0 0x7fd1480c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.941+0000 7fd14de00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1480aa3f0 con 0x7fd148155df0 2024-08-17T02:45:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.941+0000 7fd14de00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1480a9870 con 0x7fd148155a20 2024-08-17T02:45:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.941+0000 7fd14de00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1480a9b50 con 0x7fd14806df00 2024-08-17T02:45:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.941+0000 7fd147400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd148155df0 0x7fd1480c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.941+0000 7fd147400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd148155df0 0x7fd1480c14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38274/0 (socket says 172.21.15.100:38274) 2024-08-17T02:45:25.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.941+0000 7fd147400640 1 -- 172.21.15.100:0/1523355630 learned_addr learned my addr 172.21.15.100:0/1523355630 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:25.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.941+0000 7fd146a00640 1 --2- 172.21.15.100:0/1523355630 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd14806df00 0x7fd1481508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:25.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.941+0000 7fd146000640 1 --2- 172.21.15.100:0/1523355630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd148155a20 0x7fd1480c09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:25.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.941+0000 7fd147400640 1 -- 172.21.15.100:0/1523355630 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd14806df00 msgr2=0x7fd1481508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.941+0000 7fd147400640 1 --2- 172.21.15.100:0/1523355630 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd14806df00 0x7fd1481508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.941+0000 7fd147400640 1 -- 172.21.15.100:0/1523355630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd148155a20 msgr2=0x7fd1480c09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:25.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.941+0000 7fd147400640 1 --2- 172.21.15.100:0/1523355630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd148155a20 0x7fd1480c09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:25.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.941+0000 7fd147400640 1 -- 172.21.15.100:0/1523355630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd138009390 con 0x7fd148155df0 2024-08-17T02:45:25.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.942+0000 7fd147400640 1 --2- 172.21.15.100:0/1523355630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd148155df0 0x7fd1480c14f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd140001460 tx=0x7fd140001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:25.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.942+0000 7fd13e000640 1 -- 172.21.15.100:0/1523355630 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14000ce90 con 0x7fd148155df0 2024-08-17T02:45:25.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.942+0000 7fd13e000640 1 -- 172.21.15.100:0/1523355630 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14000a850 con 0x7fd148155df0 2024-08-17T02:45:25.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.942+0000 7fd13e000640 1 -- 172.21.15.100:0/1523355630 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14000ac10 con 0x7fd148155df0 2024-08-17T02:45:25.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.942+0000 7fd14de00640 1 -- 172.21.15.100:0/1523355630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1480a9e30 con 0x7fd148155df0 2024-08-17T02:45:25.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.942+0000 7fd14de00640 1 -- 172.21.15.100:0/1523355630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd148150e30 con 0x7fd148155df0 2024-08-17T02:45:25.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.942+0000 7fd13e000640 1 -- 172.21.15.100:0/1523355630 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fd140007300 con 0x7fd148155df0 2024-08-17T02:45:25.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.942+0000 7fd13e000640 1 -- 172.21.15.100:0/1523355630 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fd14001bb70 con 0x7fd148155df0 2024-08-17T02:45:25.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.943+0000 7fd14de00640 1 -- 172.21.15.100:0/1523355630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd148064db0 con 0x7fd148155df0 2024-08-17T02:45:25.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:25.945+0000 7fd13e000640 1 -- 172.21.15.100:0/1523355630 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fd14001bdf0 con 0x7fd148155df0 2024-08-17T02:45:26.007 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:26.007+0000 7f111e613ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:45:26.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:26.007+0000 7fd14de00640 1 -- 172.21.15.100:0/1523355630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd148153f90 con 0x7fd148155df0 2024-08-17T02:45:26.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:26.008+0000 7fd13e000640 1 -- 172.21.15.100:0/1523355630 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fd140007670 con 0x7fd148155df0 2024-08-17T02:45:26.009 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:26.009 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":10,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:25.633713+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:45:26.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:26.009+0000 7fd14de00640 1 -- 172.21.15.100:0/1523355630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd148155df0 msgr2=0x7fd1480c14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:26.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:26.009+0000 7fd14de00640 1 --2- 172.21.15.100:0/1523355630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd148155df0 0x7fd1480c14f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd140001460 tx=0x7fd140001ac0 comp rx=0 tx=0).stop 2024-08-17T02:45:26.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:26.009+0000 7fd14de00640 1 -- 172.21.15.100:0/1523355630 shutdown_connections 2024-08-17T02:45:26.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:26.009+0000 7fd14de00640 1 --2- 172.21.15.100:0/1523355630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd148155df0 0x7fd1480c14f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:26.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:26.009+0000 7fd14de00640 1 --2- 172.21.15.100:0/1523355630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd148155a20 0x7fd1480c09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:26.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:26.009+0000 7fd14de00640 1 --2- 172.21.15.100:0/1523355630 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd14806df00 0x7fd1481508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:26.009+0000 7fd14de00640 1 -- 172.21.15.100:0/1523355630 >> 172.21.15.100:0/1523355630 conn(0x7fd1480cb9b0 msgr2=0x7fd1480ad790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:26.009+0000 7fd14de00640 1 -- 172.21.15.100:0/1523355630 shutdown_connections 2024-08-17T02:45:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:26.009+0000 7fd14de00640 1 -- 172.21.15.100:0/1523355630 wait complete. 2024-08-17T02:45:26.030 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-17T02:45:26.030 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-17T02:45:26.068 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:26.068+0000 7f111e613ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:45:26.138 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:26.137+0000 7fb4b1d66ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:45:26.191 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:26.189+0000 7fb4b1d66ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:45:26.245 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:26.245+0000 7f111e613ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:45:26.301 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:26.300+0000 7f111e613ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:45:26.332 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-08-17T02:45:26.332+0000 7f9e8ad1d2c0 -1 Falling back to public interface 2024-08-17T02:45:26.338 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-08-17T02:45:26.338+0000 7f69e651f2c0 -1 Falling back to public interface 2024-08-17T02:45:26.340 INFO:tasks.ceph.osd.5.smithi123.stderr:2024-08-17T02:45:26.339+0000 7f6b47d802c0 -1 Falling back to public interface 2024-08-17T02:45:26.350 INFO:tasks.ceph.osd.6.smithi123.stderr:2024-08-17T02:45:26.349+0000 7f72b80692c0 -1 Falling back to public interface 2024-08-17T02:45:26.355 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-08-17T02:45:26.355+0000 7f955f04a2c0 -1 Falling back to public interface 2024-08-17T02:45:26.368 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:26.366+0000 7fb4b1d66ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:45:26.376 INFO:tasks.ceph.osd.4.smithi123.stderr:2024-08-17T02:45:26.374+0000 7f5f0ef212c0 -1 Falling back to public interface 2024-08-17T02:45:26.376 INFO:tasks.ceph.osd.7.smithi123.stderr:2024-08-17T02:45:26.374+0000 7f9959a4f2c0 -1 Falling back to public interface 2024-08-17T02:45:26.380 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-08-17T02:45:26.380+0000 7fd9dac8b2c0 -1 Falling back to public interface 2024-08-17T02:45:26.381 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:26.380+0000 7f111e613ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:45:26.431 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:26.429+0000 7fb4b1d66ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:45:26.432 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:26.432+0000 7f111e613ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:45:26.508 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:26.506+0000 7fb4b1d66ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:45:26.558 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:26.557+0000 7fb4b1d66ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:45:26.836 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:45:26.958 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:26.957+0000 7f111e613ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:45:26.968 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.968+0000 7f53bf200640 1 Processor -- start 2024-08-17T02:45:26.968 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.968+0000 7f53bf200640 1 -- start start 2024-08-17T02:45:26.970 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.969+0000 7f53bf200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53c00d0590 0x7f53c00cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:26.970 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.969+0000 7f53bf200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f53c00cbec0 0x7f53c00cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:26.970 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.969+0000 7f53bf200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c00b30b0 con 0x7f53c00cda00 2024-08-17T02:45:26.970 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.969+0000 7f53bf200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c00ca940 con 0x7f53c00cbec0 2024-08-17T02:45:26.970 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.969+0000 7f53bf200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c00cabe0 con 0x7f53c00d0590 2024-08-17T02:45:26.970 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.969+0000 7f53bd400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53c00d0590 0x7f53c00cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:26.970 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.969+0000 7f53bde00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f53c00cda00 0x7f53c00b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.100:43104/0 (socket says 172.21.15.100:43104) 2024-08-17T02:45:26.970 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.969+0000 7f53bde00640 1 -- 172.21.15.100:0/1419896111 learned_addr learned my addr 172.21.15.100:0/1419896111 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:26.971 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.969+0000 7f53be800640 1 --2- 172.21.15.100:0/1419896111 >> v2:172.21.15.123:3300/0 conn(0x7f53c00cbec0 0x7f53c00cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:26.971 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.970+0000 7f53be800640 1 -- 172.21.15.100:0/1419896111 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53c00d0590 msgr2=0x7f53c00cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:26.971 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.970+0000 7f53be800640 1 --2- 172.21.15.100:0/1419896111 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53c00d0590 0x7f53c00cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:26.972 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.970+0000 7f53be800640 1 -- 172.21.15.100:0/1419896111 >> v1:172.21.15.123:6789/0 conn(0x7f53c00cda00 legacy=0x7f53c00b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:26.972 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.970+0000 7f53be800640 1 -- 172.21.15.100:0/1419896111 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c00caec0 con 0x7f53c00cbec0 2024-08-17T02:45:26.972 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.970+0000 7f53bd400640 1 --2- 172.21.15.100:0/1419896111 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53c00d0590 0x7f53c00cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:26.972 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.971+0000 7f53be800640 1 --2- 172.21.15.100:0/1419896111 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c00cbec0 0x7f53c00cddd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f53b8009e60 tx=0x7f53b8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf3b7b86376a59ba server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:26.972 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.971+0000 7f53bca00640 1 -- 172.21.15.100:0/1419896111 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8007550 con 0x7f53c00cbec0 2024-08-17T02:45:26.972 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.971+0000 7f53bca00640 1 -- 172.21.15.100:0/1419896111 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b802d050 con 0x7f53c00cbec0 2024-08-17T02:45:26.972 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.971+0000 7f53bca00640 1 -- 172.21.15.100:0/1419896111 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8007920 con 0x7f53c00cbec0 2024-08-17T02:45:26.973 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.972+0000 7f53bf200640 1 -- 172.21.15.100:0/1419896111 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c00cbec0 msgr2=0x7f53c00cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:26.973 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.972+0000 7f53bf200640 1 --2- 172.21.15.100:0/1419896111 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c00cbec0 0x7f53c00cddd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f53b8009e60 tx=0x7f53b8009780 comp rx=0 tx=0).stop 2024-08-17T02:45:26.973 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.972+0000 7f53bf200640 1 -- 172.21.15.100:0/1419896111 shutdown_connections 2024-08-17T02:45:26.973 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.972+0000 7f53bf200640 1 --2- 172.21.15.100:0/1419896111 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c00cbec0 0x7f53c00cddd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:26.973 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.972+0000 7f53bf200640 1 --2- 172.21.15.100:0/1419896111 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53c00d0590 0x7f53c00cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:26.973 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.972+0000 7f53bf200640 1 -- 172.21.15.100:0/1419896111 >> 172.21.15.100:0/1419896111 conn(0x7f53c006ec90 msgr2=0x7f53c00cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:26.973 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.972+0000 7f53bf200640 1 -- 172.21.15.100:0/1419896111 shutdown_connections 2024-08-17T02:45:26.973 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.972+0000 7f53bf200640 1 -- 172.21.15.100:0/1419896111 wait complete. 2024-08-17T02:45:26.974 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.973+0000 7f53bf200640 1 Processor -- start 2024-08-17T02:45:26.974 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.973+0000 7f53bf200640 1 -- start start 2024-08-17T02:45:26.976 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.974+0000 7f53bf200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c00cbec0 0x7f53c0151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:26.976 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.974+0000 7f53bf200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53c00cda00 0x7f53c015a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:26.977 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.974+0000 7f53bf200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c00d0590 0x7f53c015a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:26.977 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.974+0000 7f53bf200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c0159750 con 0x7f53c00cbec0 2024-08-17T02:45:26.977 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.974+0000 7f53bf200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c00c7780 con 0x7f53c00d0590 2024-08-17T02:45:26.977 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.974+0000 7f53bf200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c0152120 con 0x7f53c00cda00 2024-08-17T02:45:26.977 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.974+0000 7f53bde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c00cbec0 0x7f53c0151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:26.977 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.974+0000 7f53bde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c00cbec0 0x7f53c0151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56716/0 (socket says 172.21.15.100:56716) 2024-08-17T02:45:26.977 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.974+0000 7f53be800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c00d0590 0x7f53c015a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:26.977 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.974+0000 7f53bde00640 1 -- 172.21.15.100:0/2171130572 learned_addr learned my addr 172.21.15.100:0/2171130572 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:26.977 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.974+0000 7f53bd400640 1 --2- 172.21.15.100:0/2171130572 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53c00cda00 0x7f53c015a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:26.978 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.975+0000 7f53be800640 1 -- 172.21.15.100:0/2171130572 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53c00cda00 msgr2=0x7f53c015a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:26.978 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.975+0000 7f53be800640 1 --2- 172.21.15.100:0/2171130572 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53c00cda00 0x7f53c015a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:26.978 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.975+0000 7f53be800640 1 -- 172.21.15.100:0/2171130572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c00cbec0 msgr2=0x7f53c0151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:26.979 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.975+0000 7f53be800640 1 --2- 172.21.15.100:0/2171130572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c00cbec0 0x7f53c0151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:26.979 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.975+0000 7f53be800640 1 -- 172.21.15.100:0/2171130572 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac009390 con 0x7f53c00d0590 2024-08-17T02:45:26.979 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.975+0000 7f53be800640 1 --2- 172.21.15.100:0/2171130572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c00d0590 0x7f53c015a7a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f53b8031000 tx=0x7f53b8037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:26.979 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.975+0000 7f53b5600640 1 -- 172.21.15.100:0/2171130572 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8031ac0 con 0x7f53c00d0590 2024-08-17T02:45:26.979 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.975+0000 7f53b5600640 1 -- 172.21.15.100:0/2171130572 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b8031c20 con 0x7f53c00d0590 2024-08-17T02:45:26.979 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.975+0000 7f53b5600640 1 -- 172.21.15.100:0/2171130572 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b803c420 con 0x7f53c00d0590 2024-08-17T02:45:26.979 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.975+0000 7f53bf200640 1 -- 172.21.15.100:0/2171130572 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b8009a20 con 0x7f53c00d0590 2024-08-17T02:45:26.979 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.976+0000 7f53bf200640 1 -- 172.21.15.100:0/2171130572 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c00c7130 con 0x7f53c00d0590 2024-08-17T02:45:26.979 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.976+0000 7f53b5600640 1 -- 172.21.15.100:0/2171130572 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f53b803c7b0 con 0x7f53c00d0590 2024-08-17T02:45:26.980 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.976+0000 7f53b5600640 1 -- 172.21.15.100:0/2171130572 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f53b8045ae0 con 0x7f53c00d0590 2024-08-17T02:45:26.980 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.977+0000 7f53bf200640 1 -- 172.21.15.100:0/2171130572 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c0071100 con 0x7f53c00d0590 2024-08-17T02:45:26.980 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:26.979+0000 7f53b5600640 1 -- 172.21.15.100:0/2171130572 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f53b804a060 con 0x7f53c00d0590 2024-08-17T02:45:27.042 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:27.041+0000 7f53bf200640 1 -- 172.21.15.100:0/2171130572 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53c00c78c0 con 0x7f53c00d0590 2024-08-17T02:45:27.043 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:27.042+0000 7f53b5600640 1 -- 172.21.15.100:0/2171130572 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f53b8041070 con 0x7f53c00d0590 2024-08-17T02:45:27.043 INFO:teuthology.misc.health.smithi100.stdout: 2024-08-17T02:45:27.043 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":10,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:25.633713+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:45:27.044 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:27.043+0000 7f53bf200640 1 -- 172.21.15.100:0/2171130572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c00d0590 msgr2=0x7f53c015a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:27.044 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:27.043+0000 7f53bf200640 1 --2- 172.21.15.100:0/2171130572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c00d0590 0x7f53c015a7a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f53b8031000 tx=0x7f53b8037000 comp rx=0 tx=0).stop 2024-08-17T02:45:27.044 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:27.043+0000 7f53bf200640 1 -- 172.21.15.100:0/2171130572 shutdown_connections 2024-08-17T02:45:27.044 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:27.043+0000 7f53bf200640 1 --2- 172.21.15.100:0/2171130572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c00d0590 0x7f53c015a7a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:27.044 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:27.043+0000 7f53bf200640 1 --2- 172.21.15.100:0/2171130572 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53c00cda00 0x7f53c015a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:27.044 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:27.043+0000 7f53bf200640 1 --2- 172.21.15.100:0/2171130572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c00cbec0 0x7f53c0151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:27.044 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:27.043+0000 7f53bf200640 1 -- 172.21.15.100:0/2171130572 >> 172.21.15.100:0/2171130572 conn(0x7f53c006ec90 msgr2=0x7f53c00cddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:27.045 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:27.044+0000 7f53bf200640 1 -- 172.21.15.100:0/2171130572 shutdown_connections 2024-08-17T02:45:27.045 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:27.044+0000 7f53bf200640 1 -- 172.21.15.100:0/2171130572 wait complete. 2024-08-17T02:45:27.056 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:45:27.072 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:27.072+0000 7f111e613ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:45:27.082 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:27.081+0000 7fb4b1d66ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:45:27.198 INFO:tasks.ceph.mgr.x.smithi123.stderr:2024-08-17T02:45:27.196+0000 7fb4b1d66ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:45:28.093 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:28.093+0000 7f1102e00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-17T02:45:28.094 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-08-17T02:45:28.093+0000 7f1102e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-17T02:45:29.892 INFO:tasks.ceph.osd.5.smithi123.stderr:2024-08-17T02:45:29.890+0000 7f6b47d802c0 -1 osd.5 0 log_to_monitors true 2024-08-17T02:45:29.930 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-08-17T02:45:29.929+0000 7f69e651f2c0 -1 osd.2 0 log_to_monitors true 2024-08-17T02:45:29.981 INFO:tasks.ceph.osd.4.smithi123.stderr:2024-08-17T02:45:29.979+0000 7f5f0ef212c0 -1 osd.4 0 log_to_monitors true 2024-08-17T02:45:29.986 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-08-17T02:45:29.985+0000 7f9e8ad1d2c0 -1 osd.0 0 log_to_monitors true 2024-08-17T02:45:29.987 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-08-17T02:45:29.987+0000 7f955f04a2c0 -1 osd.1 0 log_to_monitors true 2024-08-17T02:45:30.002 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-08-17T02:45:30.000+0000 7fd9dac8b2c0 -1 osd.3 0 log_to_monitors true 2024-08-17T02:45:30.231 INFO:tasks.ceph.osd.7.smithi123.stderr:2024-08-17T02:45:30.230+0000 7f9959a4f2c0 -1 osd.7 0 log_to_monitors true 2024-08-17T02:45:30.236 INFO:tasks.ceph.osd.6.smithi123.stderr:2024-08-17T02:45:30.234+0000 7f72b80692c0 -1 osd.6 0 log_to_monitors true 2024-08-17T02:45:32.686 INFO:tasks.ceph.osd.5.smithi123.stderr:2024-08-17T02:45:32.684+0000 7f6b41400640 -1 osd.5 0 waiting for initial osdmap 2024-08-17T02:45:32.688 INFO:tasks.ceph.osd.4.smithi123.stderr:2024-08-17T02:45:32.687+0000 7f5f08600640 -1 osd.4 0 waiting for initial osdmap 2024-08-17T02:45:32.698 INFO:tasks.ceph.osd.4.smithi123.stderr:2024-08-17T02:45:32.696+0000 7f5effa00640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:45:32.698 INFO:tasks.ceph.osd.5.smithi123.stderr:2024-08-17T02:45:32.697+0000 7f6b38800640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:45:33.431 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-08-17T02:45:33.431+0000 7fd9d4a00640 -1 osd.3 0 waiting for initial osdmap 2024-08-17T02:45:33.444 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-08-17T02:45:33.443+0000 7fd9cbe00640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:45:33.448 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-08-17T02:45:33.448+0000 7f9e84400640 -1 osd.0 0 waiting for initial osdmap 2024-08-17T02:45:33.455 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-08-17T02:45:33.455+0000 7f9e7b800640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:45:33.469 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-08-17T02:45:33.469+0000 7f69dfc00640 -1 osd.2 0 waiting for initial osdmap 2024-08-17T02:45:33.472 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-08-17T02:45:33.471+0000 7f955a200640 -1 osd.1 0 waiting for initial osdmap 2024-08-17T02:45:33.475 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-08-17T02:45:33.475+0000 7f69d7000640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:45:33.479 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-08-17T02:45:33.479+0000 7f954f800640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:45:33.612 INFO:tasks.ceph.osd.6.smithi123.stderr:2024-08-17T02:45:33.611+0000 7f72b1e00640 -1 osd.6 0 waiting for initial osdmap 2024-08-17T02:45:33.619 INFO:tasks.ceph.osd.6.smithi123.stderr:2024-08-17T02:45:33.617+0000 7f72a9200640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:45:33.638 INFO:tasks.ceph.osd.7.smithi123.stderr:2024-08-17T02:45:33.636+0000 7f9953800640 -1 osd.7 0 waiting for initial osdmap 2024-08-17T02:45:33.642 INFO:tasks.ceph.osd.7.smithi123.stderr:2024-08-17T02:45:33.641+0000 7f994ac00640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:45:33.865 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:45:33.994 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.992+0000 7f83ba200640 1 Processor -- start 2024-08-17T02:45:33.994 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.992+0000 7f83ba200640 1 -- start start 2024-08-17T02:45:33.996 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.994+0000 7f83ba200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f83b413f2f0 0x7f83b40c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:33.996 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.994+0000 7f83ba200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f83b413f6c0 0x7f83b40cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:33.996 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.994+0000 7f83ba200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b40ca310 con 0x7f83b406e5e0 2024-08-17T02:45:33.996 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.994+0000 7f83ba200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b40cb8f0 con 0x7f83b413f6c0 2024-08-17T02:45:33.996 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.994+0000 7f83ba200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b40ca5f0 con 0x7f83b413f2f0 2024-08-17T02:45:33.996 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.994+0000 7f83b3400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f83b413f2f0 0x7f83b40c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:33.997 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.994+0000 7f83b2a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f83b413f6c0 0x7f83b40cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:33.997 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.994+0000 7f83b3400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f83b413f2f0 0x7f83b40c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:40906/0 (socket says 172.21.15.100:40906) 2024-08-17T02:45:33.997 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.994+0000 7f83b3400640 1 -- 172.21.15.100:0/3885788553 learned_addr learned my addr 172.21.15.100:0/3885788553 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:33.997 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.994+0000 7f83b3e00640 1 --1- 172.21.15.100:0/3885788553 >> v1:172.21.15.123:6789/0 conn(0x7f83b406e5e0 0x7f83b40ad430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.100:43114/0 (socket says 172.21.15.100:43114) 2024-08-17T02:45:33.997 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.994+0000 7f83b2000640 1 -- 172.21.15.100:0/3885788553 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219050596 0 0) 0x7f83b40ca310 con 0x7f83b406e5e0 2024-08-17T02:45:33.997 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.994+0000 7f83b2000640 1 -- 172.21.15.100:0/3885788553 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83980034e0 con 0x7f83b406e5e0 2024-08-17T02:45:33.997 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.994+0000 7f83b2a00640 1 -- 172.21.15.100:0/3885788553 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f83b413f2f0 msgr2=0x7f83b40c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:33.997 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.994+0000 7f83b2a00640 1 --2- 172.21.15.100:0/3885788553 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f83b413f2f0 0x7f83b40c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:33.997 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.994+0000 7f83b2a00640 1 -- 172.21.15.100:0/3885788553 >> v1:172.21.15.123:6789/0 conn(0x7f83b406e5e0 legacy=0x7f83b40ad430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:33.997 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.995+0000 7f83b2a00640 1 -- 172.21.15.100:0/3885788553 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b40ca8d0 con 0x7f83b413f6c0 2024-08-17T02:45:33.997 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.995+0000 7f83b3400640 1 --2- 172.21.15.100:0/3885788553 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f83b413f2f0 0x7f83b40c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:33.998 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.995+0000 7f83b2a00640 1 --2- 172.21.15.100:0/3885788553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83b413f6c0 0x7f83b40cb3b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009850 tx=0x7f83a00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3053d33edd91872 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:33.999 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.996+0000 7f83b2000640 1 -- 172.21.15.100:0/3885788553 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a002ae10 con 0x7f83b413f6c0 2024-08-17T02:45:33.999 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.996+0000 7f83b2000640 1 -- 172.21.15.100:0/3885788553 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a0032440 con 0x7f83b413f6c0 2024-08-17T02:45:33.999 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.996+0000 7f83b2000640 1 -- 172.21.15.100:0/3885788553 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0032800 con 0x7f83b413f6c0 2024-08-17T02:45:33.999 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.996+0000 7f83ba200640 1 -- 172.21.15.100:0/3885788553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83b413f6c0 msgr2=0x7f83b40cb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:33.999 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.996+0000 7f83ba200640 1 --2- 172.21.15.100:0/3885788553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83b413f6c0 0x7f83b40cb3b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009850 tx=0x7f83a00090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:33.999 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.996+0000 7f83ba200640 1 -- 172.21.15.100:0/3885788553 shutdown_connections 2024-08-17T02:45:33.999 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.996+0000 7f83ba200640 1 --2- 172.21.15.100:0/3885788553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83b413f6c0 0x7f83b40cb3b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:33.999 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.996+0000 7f83ba200640 1 --2- 172.21.15.100:0/3885788553 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f83b413f2f0 0x7f83b40c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:33.999 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.996+0000 7f83ba200640 1 -- 172.21.15.100:0/3885788553 >> 172.21.15.100:0/3885788553 conn(0x7f83b4067810 msgr2=0x7f83b406c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:33.999 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.997+0000 7f83ba200640 1 -- 172.21.15.100:0/3885788553 shutdown_connections 2024-08-17T02:45:33.999 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.997+0000 7f83ba200640 1 -- 172.21.15.100:0/3885788553 wait complete. 2024-08-17T02:45:34.000 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.998+0000 7f83ba200640 1 Processor -- start 2024-08-17T02:45:34.000 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.998+0000 7f83ba200640 1 -- start start 2024-08-17T02:45:34.002 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.999+0000 7f83ba200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83b406e5e0 0x7f83b413fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:34.002 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.999+0000 7f83ba200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f83b413f2f0 0x7f83b4136b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:34.002 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.999+0000 7f83ba200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83b413f6c0 0x7f83b4154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:34.002 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.999+0000 7f83ba200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b4137090 con 0x7f83b413f6c0 2024-08-17T02:45:34.002 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.999+0000 7f83ba200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b41374e0 con 0x7f83b406e5e0 2024-08-17T02:45:34.003 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.999+0000 7f83ba200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b4137730 con 0x7f83b413f2f0 2024-08-17T02:45:34.003 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.999+0000 7f83b3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83b413f6c0 0x7f83b4154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:34.003 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.999+0000 7f83b3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83b413f6c0 0x7f83b4154060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56824/0 (socket says 172.21.15.100:56824) 2024-08-17T02:45:34.003 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.999+0000 7f83b3e00640 1 -- 172.21.15.100:0/3278121700 learned_addr learned my addr 172.21.15.100:0/3278121700 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:34.003 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:33.999+0000 7f83b3400640 1 --2- 172.21.15.100:0/3278121700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83b406e5e0 0x7f83b413fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:34.003 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.000+0000 7f83b2a00640 1 --2- 172.21.15.100:0/3278121700 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f83b413f2f0 0x7f83b4136b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:34.003 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.000+0000 7f83b3e00640 1 -- 172.21.15.100:0/3278121700 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f83b413f2f0 msgr2=0x7f83b4136b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:34.003 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.000+0000 7f83b3e00640 1 --2- 172.21.15.100:0/3278121700 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f83b413f2f0 0x7f83b4136b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.003 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.000+0000 7f83b3e00640 1 -- 172.21.15.100:0/3278121700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83b406e5e0 msgr2=0x7f83b413fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:34.003 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.000+0000 7f83b3e00640 1 --2- 172.21.15.100:0/3278121700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83b406e5e0 0x7f83b413fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.003 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.000+0000 7f83b3e00640 1 -- 172.21.15.100:0/3278121700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a400b700 con 0x7f83b413f6c0 2024-08-17T02:45:34.003 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.000+0000 7f83b3400640 1 --2- 172.21.15.100:0/3278121700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83b406e5e0 0x7f83b413fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:34.003 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.000+0000 7f83b2a00640 1 --2- 172.21.15.100:0/3278121700 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f83b413f2f0 0x7f83b4136b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:34.004 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.000+0000 7f83b3e00640 1 --2- 172.21.15.100:0/3278121700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83b413f6c0 0x7f83b4154060 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00c910 tx=0x7f83ac0016e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:34.004 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.000+0000 7f83aaa00640 1 -- 172.21.15.100:0/3278121700 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac005d60 con 0x7f83b413f6c0 2024-08-17T02:45:34.004 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.000+0000 7f83aaa00640 1 -- 172.21.15.100:0/3278121700 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac00a5e0 con 0x7f83b413f6c0 2024-08-17T02:45:34.004 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.000+0000 7f83aaa00640 1 -- 172.21.15.100:0/3278121700 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00a9a0 con 0x7f83b413f6c0 2024-08-17T02:45:34.004 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.000+0000 7f83ba200640 1 -- 172.21.15.100:0/3278121700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a0009390 con 0x7f83b413f6c0 2024-08-17T02:45:34.004 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.000+0000 7f83ba200640 1 -- 172.21.15.100:0/3278121700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b4159490 con 0x7f83b413f6c0 2024-08-17T02:45:34.005 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.001+0000 7f83ba200640 1 -- 172.21.15.100:0/3278121700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b4064a50 con 0x7f83b413f6c0 2024-08-17T02:45:34.005 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.002+0000 7f83aaa00640 1 -- 172.21.15.100:0/3278121700 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f83ac0070f0 con 0x7f83b413f6c0 2024-08-17T02:45:34.005 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.003+0000 7f83aaa00640 1 --2- 172.21.15.100:0/3278121700 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f83940650c0 0x7f8394067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:34.005 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.003+0000 7f83aaa00640 1 -- 172.21.15.100:0/3278121700 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f83ac081d70 con 0x7f83b413f6c0 2024-08-17T02:45:34.005 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.003+0000 7f83b3400640 1 --2- 172.21.15.100:0/3278121700 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f83940650c0 0x7f8394067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:34.005 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.003+0000 7f83b3400640 1 --2- 172.21.15.100:0/3278121700 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f83940650c0 0x7f8394067570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f83a4006cb0 tx=0x7f83a400b460 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:34.009 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.008+0000 7f83aaa00640 1 -- 172.21.15.100:0/3278121700 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f83ac050330 con 0x7f83b413f6c0 2024-08-17T02:45:34.186 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.184+0000 7f83ba200640 1 -- 172.21.15.100:0/3278121700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83b40ae440 con 0x7f83b413f6c0 2024-08-17T02:45:34.187 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.185+0000 7f83aaa00640 1 -- 172.21.15.100:0/3278121700 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10444 (secure 0 0 0) 0x7f83ac00b0d0 con 0x7f83b413f6c0 2024-08-17T02:45:34.187 INFO:teuthology.misc.health.smithi100.stdout: 2024-08-17T02:45:34.187 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":14,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:33.704193+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:45:34.190 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.188+0000 7f83ba200640 1 -- 172.21.15.100:0/3278121700 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f83940650c0 msgr2=0x7f8394067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:34.190 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.188+0000 7f83ba200640 1 --2- 172.21.15.100:0/3278121700 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f83940650c0 0x7f8394067570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f83a4006cb0 tx=0x7f83a400b460 comp rx=0 tx=0).stop 2024-08-17T02:45:34.190 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.188+0000 7f83ba200640 1 -- 172.21.15.100:0/3278121700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83b413f6c0 msgr2=0x7f83b4154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:34.190 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.188+0000 7f83ba200640 1 --2- 172.21.15.100:0/3278121700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83b413f6c0 0x7f83b4154060 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00c910 tx=0x7f83ac0016e0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.190 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.188+0000 7f83ba200640 1 -- 172.21.15.100:0/3278121700 shutdown_connections 2024-08-17T02:45:34.190 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.188+0000 7f83ba200640 1 --2- 172.21.15.100:0/3278121700 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f83940650c0 0x7f8394067570 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.190 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.188+0000 7f83ba200640 1 --2- 172.21.15.100:0/3278121700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83b413f6c0 0x7f83b4154060 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.190 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.188+0000 7f83ba200640 1 --2- 172.21.15.100:0/3278121700 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f83b413f2f0 0x7f83b4136b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.190 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.188+0000 7f83ba200640 1 --2- 172.21.15.100:0/3278121700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83b406e5e0 0x7f83b413fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.191 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.188+0000 7f83ba200640 1 -- 172.21.15.100:0/3278121700 >> 172.21.15.100:0/3278121700 conn(0x7f83b4067810 msgr2=0x7f83b4155510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:34.191 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.188+0000 7f83ba200640 1 -- 172.21.15.100:0/3278121700 shutdown_connections 2024-08-17T02:45:34.191 INFO:teuthology.misc.health.smithi100.stderr:2024-08-17T02:45:34.188+0000 7f83ba200640 1 -- 172.21.15.100:0/3278121700 wait complete. 2024-08-17T02:45:34.202 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-17T02:45:34.203 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-17T02:45:34.203 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:45:34.203 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:45:34.207 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:45:34.207 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:45:34.207 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:45:34.211 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:45:34.211 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:45:34.211 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:45:34.217 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:45:34.217 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:45:34.217 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:45:34.220 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:45:34.221 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-17T02:45:34.221 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:45:34.333 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-08-17T02:45:34.338 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2024-08-17T02:45:34.340 INFO:tasks.ceph.mds.b.smithi123.stdout:starting mds.b at 2024-08-17T02:45:34.341 INFO:tasks.ceph.mds.d.smithi123.stdout:starting mds.d at 2024-08-17T02:45:34.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.380+0000 7f43e9200640 1 Processor -- start 2024-08-17T02:45:34.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.380+0000 7f43e9200640 1 -- start start 2024-08-17T02:45:34.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.381+0000 7f43e9200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43e4158f80 0x7f43e40ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:34.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.381+0000 7f43e9200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f43e4159350 0x7f43e40ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:34.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.381+0000 7f43e9200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e40cb560 con 0x7f43e40cf280 2024-08-17T02:45:34.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.381+0000 7f43e9200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e40cf7e0 con 0x7f43e4159350 2024-08-17T02:45:34.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.381+0000 7f43e9200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e40cfac0 con 0x7f43e4158f80 2024-08-17T02:45:34.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.382+0000 7f43e1e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43e4158f80 0x7f43e40ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:34.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.382+0000 7f43d9400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f43e4159350 0x7f43e40ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:34.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.382+0000 7f43e2800640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f43e40cf280 0x7f43e40cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.100:43146/0 (socket says 172.21.15.100:43146) 2024-08-17T02:45:34.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.382+0000 7f43e1e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43e4158f80 0x7f43e40ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:40950/0 (socket says 172.21.15.100:40950) 2024-08-17T02:45:34.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.382+0000 7f43e2800640 1 -- 172.21.15.100:0/1400959694 learned_addr learned my addr 172.21.15.100:0/1400959694 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:34.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.382+0000 7f43e1e00640 1 -- 172.21.15.100:0/1400959694 >> v2:172.21.15.123:3300/0 conn(0x7f43e4159350 msgr2=0x7f43e40ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:34.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.383+0000 7f43e1e00640 1 --2- 172.21.15.100:0/1400959694 >> v2:172.21.15.123:3300/0 conn(0x7f43e4159350 0x7f43e40ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.382+0000 7f43e1400640 1 -- 172.21.15.100:0/1400959694 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162025586 0 0) 0x7f43e40cb560 con 0x7f43e40cf280 2024-08-17T02:45:34.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.383+0000 7f43e1e00640 1 -- 172.21.15.100:0/1400959694 >> v1:172.21.15.123:6789/0 conn(0x7f43e40cf280 legacy=0x7f43e40cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:34.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.383+0000 7f43e1e00640 1 -- 172.21.15.100:0/1400959694 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e40caf10 con 0x7f43e4158f80 2024-08-17T02:45:34.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.384+0000 7f43e1e00640 1 --2- 172.21.15.100:0/1400959694 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43e4158f80 0x7f43e40ca330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f43d4009850 tx=0x7f43d40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=770526b60a4e14f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:34.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.384+0000 7f43e1400640 1 -- 172.21.15.100:0/1400959694 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d402ad90 con 0x7f43e4158f80 2024-08-17T02:45:34.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.384+0000 7f43e1400640 1 -- 172.21.15.100:0/1400959694 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d4032440 con 0x7f43e4158f80 2024-08-17T02:45:34.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.384+0000 7f43e1400640 1 -- 172.21.15.100:0/1400959694 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d40327e0 con 0x7f43e4158f80 2024-08-17T02:45:34.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.384+0000 7f43e9200640 1 -- 172.21.15.100:0/1400959694 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43e4158f80 msgr2=0x7f43e40ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:34.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.384+0000 7f43e9200640 1 --2- 172.21.15.100:0/1400959694 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43e4158f80 0x7f43e40ca330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f43d4009850 tx=0x7f43d40090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.384+0000 7f43e9200640 1 -- 172.21.15.100:0/1400959694 shutdown_connections 2024-08-17T02:45:34.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.384+0000 7f43e9200640 1 --2- 172.21.15.100:0/1400959694 >> v2:172.21.15.123:3300/0 conn(0x7f43e4159350 0x7f43e40ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.384+0000 7f43e9200640 1 --2- 172.21.15.100:0/1400959694 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43e4158f80 0x7f43e40ca330 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.384+0000 7f43e9200640 1 -- 172.21.15.100:0/1400959694 >> 172.21.15.100:0/1400959694 conn(0x7f43e40cfd90 msgr2=0x7f43e40d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:34.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.384+0000 7f43e9200640 1 -- 172.21.15.100:0/1400959694 shutdown_connections 2024-08-17T02:45:34.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.384+0000 7f43e9200640 1 -- 172.21.15.100:0/1400959694 wait complete. 2024-08-17T02:45:34.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.386+0000 7f43e9200640 1 Processor -- start 2024-08-17T02:45:34.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.386+0000 7f43e9200640 1 -- start start 2024-08-17T02:45:34.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.387+0000 7f43e9200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43e40cf280 0x7f43e416bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:34.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.387+0000 7f43e9200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43e4158f80 0x7f43e415c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:34.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.387+0000 7f43e9200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43e4159350 0x7f43e4169ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:34.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.387+0000 7f43e9200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e415a1d0 con 0x7f43e4158f80 2024-08-17T02:45:34.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.387+0000 7f43e9200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e40b3ce0 con 0x7f43e4159350 2024-08-17T02:45:34.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.387+0000 7f43e9200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e40c3470 con 0x7f43e40cf280 2024-08-17T02:45:34.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.387+0000 7f43d9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43e4158f80 0x7f43e415c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:34.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.387+0000 7f43d9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43e4158f80 0x7f43e415c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56834/0 (socket says 172.21.15.100:56834) 2024-08-17T02:45:34.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.387+0000 7f43d9400640 1 -- 172.21.15.100:0/357936688 learned_addr learned my addr 172.21.15.100:0/357936688 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:34.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.387+0000 7f43e2800640 1 --2- 172.21.15.100:0/357936688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43e4159350 0x7f43e4169ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:34.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.387+0000 7f43e1e00640 1 --2- 172.21.15.100:0/357936688 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43e40cf280 0x7f43e416bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:34.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.387+0000 7f43d9400640 1 -- 172.21.15.100:0/357936688 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43e40cf280 msgr2=0x7f43e416bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:34.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.387+0000 7f43d9400640 1 --2- 172.21.15.100:0/357936688 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43e40cf280 0x7f43e416bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.387+0000 7f43d9400640 1 -- 172.21.15.100:0/357936688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43e4159350 msgr2=0x7f43e4169ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:34.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.387+0000 7f43d9400640 1 --2- 172.21.15.100:0/357936688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43e4159350 0x7f43e4169ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.387+0000 7f43d9400640 1 -- 172.21.15.100:0/357936688 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d4009390 con 0x7f43e4158f80 2024-08-17T02:45:34.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.388+0000 7f43d9400640 1 --2- 172.21.15.100:0/357936688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43e4158f80 0x7f43e415c080 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009fd0 tx=0x7f43cc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:34.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.388+0000 7f43da000640 1 -- 172.21.15.100:0/357936688 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc00c940 con 0x7f43e4158f80 2024-08-17T02:45:34.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.388+0000 7f43da000640 1 -- 172.21.15.100:0/357936688 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc00caa0 con 0x7f43e4158f80 2024-08-17T02:45:34.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.388+0000 7f43da000640 1 -- 172.21.15.100:0/357936688 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc00ce40 con 0x7f43e4158f80 2024-08-17T02:45:34.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.388+0000 7f43e9200640 1 -- 172.21.15.100:0/357936688 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e40b3ec0 con 0x7f43e4158f80 2024-08-17T02:45:34.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.388+0000 7f43e9200640 1 -- 172.21.15.100:0/357936688 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e40b4480 con 0x7f43e4158f80 2024-08-17T02:45:34.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.389+0000 7f43e9200640 1 -- 172.21.15.100:0/357936688 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e40b49a0 con 0x7f43e4158f80 2024-08-17T02:45:34.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.390+0000 7f43da000640 1 -- 172.21.15.100:0/357936688 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f43cc013680 con 0x7f43e4158f80 2024-08-17T02:45:34.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.391+0000 7f43da000640 1 --2- 172.21.15.100:0/357936688 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f43c00650c0 0x7f43c0067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:34.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.391+0000 7f43da000640 1 -- 172.21.15.100:0/357936688 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f43cc082060 con 0x7f43e4158f80 2024-08-17T02:45:34.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.392+0000 7f43e1e00640 1 --2- 172.21.15.100:0/357936688 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f43c00650c0 0x7f43c0067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:34.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.392+0000 7f43e1e00640 1 --2- 172.21.15.100:0/357936688 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f43c00650c0 0x7f43c0067570 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f43d4034000 tx=0x7f43d4032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:34.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.395+0000 7f43da000640 1 -- 172.21.15.100:0/357936688 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f43e40b49a0 con 0x7f43e4158f80 2024-08-17T02:45:34.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.567+0000 7f43e9200640 1 -- 172.21.15.100:0/357936688 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43e40b49a0 con 0x7f43e4158f80 2024-08-17T02:45:34.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.568+0000 7f43da000640 1 -- 172.21.15.100:0/357936688 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10444 (secure 0 0 0) 0x7f43e40b49a0 con 0x7f43e4158f80 2024-08-17T02:45:34.570 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:34.570 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":14,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:33.704193+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:45:34.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.570+0000 7f43e9200640 1 -- 172.21.15.100:0/357936688 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f43c00650c0 msgr2=0x7f43c0067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:34.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.570+0000 7f43e9200640 1 --2- 172.21.15.100:0/357936688 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f43c00650c0 0x7f43c0067570 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f43d4034000 tx=0x7f43d4032000 comp rx=0 tx=0).stop 2024-08-17T02:45:34.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.570+0000 7f43e9200640 1 -- 172.21.15.100:0/357936688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43e4158f80 msgr2=0x7f43e415c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:34.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.570+0000 7f43e9200640 1 --2- 172.21.15.100:0/357936688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43e4158f80 0x7f43e415c080 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009fd0 tx=0x7f43cc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.570+0000 7f43e9200640 1 -- 172.21.15.100:0/357936688 shutdown_connections 2024-08-17T02:45:34.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.570+0000 7f43e9200640 1 --2- 172.21.15.100:0/357936688 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f43c00650c0 0x7f43c0067570 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.570+0000 7f43e9200640 1 --2- 172.21.15.100:0/357936688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43e4159350 0x7f43e4169ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.570+0000 7f43e9200640 1 --2- 172.21.15.100:0/357936688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43e4158f80 0x7f43e415c080 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.570+0000 7f43e9200640 1 --2- 172.21.15.100:0/357936688 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43e40cf280 0x7f43e416bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.570+0000 7f43e9200640 1 -- 172.21.15.100:0/357936688 >> 172.21.15.100:0/357936688 conn(0x7f43e40cfd90 msgr2=0x7f43e4067ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:34.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.571+0000 7f43e9200640 1 -- 172.21.15.100:0/357936688 shutdown_connections 2024-08-17T02:45:34.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.571+0000 7f43e9200640 1 -- 172.21.15.100:0/357936688 wait complete. 2024-08-17T02:45:34.587 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-08-17T02:45:34.588 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:45:34.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.735+0000 7f51f0a00640 1 Processor -- start 2024-08-17T02:45:34.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.735+0000 7f51f0a00640 1 -- start start 2024-08-17T02:45:34.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.737+0000 7f51f0a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f51ec158ce0 0x7f51ec0c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:34.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.737+0000 7f51f0a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f51ec0cb340 0x7f51ec1590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:34.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.737+0000 7f51f0a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec0cb7c0 con 0x7f51ec0d08d0 2024-08-17T02:45:34.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.737+0000 7f51f0a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec0cf0c0 con 0x7f51ec158ce0 2024-08-17T02:45:34.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.737+0000 7f51f0a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec089000 con 0x7f51ec0cb340 2024-08-17T02:45:34.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.737+0000 7f51e9e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f51ec158ce0 0x7f51ec0c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:34.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.737+0000 7f51e9e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f51ec158ce0 0x7f51ec0c68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56846/0 (socket says 172.21.15.100:56846) 2024-08-17T02:45:34.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.737+0000 7f51e9e00640 1 -- 172.21.15.100:0/3875894870 learned_addr learned my addr 172.21.15.100:0/3875894870 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:34.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.737+0000 7f51ea800640 1 --2- 172.21.15.100:0/3875894870 >> v2:172.21.15.123:3300/0 conn(0x7f51ec0cb340 0x7f51ec1590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:34.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.737+0000 7f51e9e00640 1 -- 172.21.15.100:0/3875894870 >> v2:172.21.15.123:3300/0 conn(0x7f51ec0cb340 msgr2=0x7f51ec1590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:34.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.737+0000 7f51e9e00640 1 --2- 172.21.15.100:0/3875894870 >> v2:172.21.15.123:3300/0 conn(0x7f51ec0cb340 0x7f51ec1590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.737+0000 7f51e9e00640 1 -- 172.21.15.100:0/3875894870 >> v1:172.21.15.123:6789/0 conn(0x7f51ec0d08d0 legacy=0x7f51ec0cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:34.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.737+0000 7f51e9e00640 1 -- 172.21.15.100:0/3875894870 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec0ceb20 con 0x7f51ec158ce0 2024-08-17T02:45:34.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.738+0000 7f51e9e00640 1 --2- 172.21.15.100:0/3875894870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51ec158ce0 0x7f51ec0c68c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0b2900 tx=0x7f51dc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3483e2d4ab330817 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:34.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.739+0000 7f51e9400640 1 -- 172.21.15.100:0/3875894870 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc02ae80 con 0x7f51ec158ce0 2024-08-17T02:45:34.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.739+0000 7f51e9400640 1 -- 172.21.15.100:0/3875894870 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc032440 con 0x7f51ec158ce0 2024-08-17T02:45:34.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.739+0000 7f51e9400640 1 -- 172.21.15.100:0/3875894870 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc032800 con 0x7f51ec158ce0 2024-08-17T02:45:34.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.739+0000 7f51f0a00640 1 -- 172.21.15.100:0/3875894870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51ec158ce0 msgr2=0x7f51ec0c68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:34.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.739+0000 7f51f0a00640 1 --2- 172.21.15.100:0/3875894870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51ec158ce0 0x7f51ec0c68c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0b2900 tx=0x7f51dc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.739+0000 7f51f0a00640 1 -- 172.21.15.100:0/3875894870 shutdown_connections 2024-08-17T02:45:34.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.739+0000 7f51f0a00640 1 --2- 172.21.15.100:0/3875894870 >> v2:172.21.15.123:3300/0 conn(0x7f51ec0cb340 0x7f51ec1590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.739+0000 7f51f0a00640 1 --2- 172.21.15.100:0/3875894870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51ec158ce0 0x7f51ec0c68c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.739+0000 7f51f0a00640 1 -- 172.21.15.100:0/3875894870 >> 172.21.15.100:0/3875894870 conn(0x7f51ec0cfdc0 msgr2=0x7f51ec0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:34.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.739+0000 7f51f0a00640 1 -- 172.21.15.100:0/3875894870 shutdown_connections 2024-08-17T02:45:34.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.739+0000 7f51f0a00640 1 -- 172.21.15.100:0/3875894870 wait complete. 2024-08-17T02:45:34.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.741+0000 7f51f0a00640 1 Processor -- start 2024-08-17T02:45:34.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.741+0000 7f51f0a00640 1 -- start start 2024-08-17T02:45:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.742+0000 7f51f0a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec0cb340 0x7f51ec0c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.742+0000 7f51f0a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51ec0d08d0 0x7f51ec15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.742+0000 7f51f0a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f51ec158ce0 0x7f51ec144660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.742+0000 7f51f0a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0c7450 con 0x7f51ec0d08d0 2024-08-17T02:45:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.742+0000 7f51f0a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0c7730 con 0x7f51ec0cb340 2024-08-17T02:45:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.742+0000 7f51f0a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0c7a10 con 0x7f51ec158ce0 2024-08-17T02:45:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.742+0000 7f51e9e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec0cb340 0x7f51ec0c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.742+0000 7f51e1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51ec0d08d0 0x7f51ec15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.742+0000 7f51e9e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec0cb340 0x7f51ec0c6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:60610/0 (socket says 172.21.15.100:60610) 2024-08-17T02:45:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.742+0000 7f51e1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51ec0d08d0 0x7f51ec15a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56862/0 (socket says 172.21.15.100:56862) 2024-08-17T02:45:34.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.742+0000 7f51ea800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f51ec158ce0 0x7f51ec144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:34.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.742+0000 7f51e1400640 1 -- 172.21.15.100:0/3808799459 learned_addr learned my addr 172.21.15.100:0/3808799459 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:34.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.742+0000 7f51e1400640 1 -- 172.21.15.100:0/3808799459 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f51ec158ce0 msgr2=0x7f51ec144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:34.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.742+0000 7f51e1400640 1 --2- 172.21.15.100:0/3808799459 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f51ec158ce0 0x7f51ec144660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.742+0000 7f51e1400640 1 -- 172.21.15.100:0/3808799459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec0cb340 msgr2=0x7f51ec0c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:34.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.742+0000 7f51e1400640 1 --2- 172.21.15.100:0/3808799459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec0cb340 0x7f51ec0c6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.742+0000 7f51e1400640 1 -- 172.21.15.100:0/3808799459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc009450 con 0x7f51ec0d08d0 2024-08-17T02:45:34.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.743+0000 7f51e1400640 1 --2- 172.21.15.100:0/3808799459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51ec0d08d0 0x7f51ec15a4f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f51d400c560 tx=0x7f51d4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:34.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.743+0000 7f51e2000640 1 -- 172.21.15.100:0/3808799459 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4011590 con 0x7f51ec0d08d0 2024-08-17T02:45:34.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.743+0000 7f51e2000640 1 -- 172.21.15.100:0/3808799459 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d4011710 con 0x7f51ec0d08d0 2024-08-17T02:45:34.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.743+0000 7f51e2000640 1 -- 172.21.15.100:0/3808799459 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4011ad0 con 0x7f51ec0d08d0 2024-08-17T02:45:34.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.743+0000 7f51f0a00640 1 -- 172.21.15.100:0/3808799459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec0c7cf0 con 0x7f51ec0d08d0 2024-08-17T02:45:34.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.743+0000 7f51f0a00640 1 -- 172.21.15.100:0/3808799459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec155620 con 0x7f51ec0d08d0 2024-08-17T02:45:34.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.744+0000 7f51f0a00640 1 -- 172.21.15.100:0/3808799459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec0c81f0 con 0x7f51ec0d08d0 2024-08-17T02:45:34.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.745+0000 7f51e2000640 1 -- 172.21.15.100:0/3808799459 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f51d401b3b0 con 0x7f51ec0d08d0 2024-08-17T02:45:34.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.746+0000 7f51e2000640 1 --2- 172.21.15.100:0/3808799459 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f51c80650c0 0x7f51c8067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:34.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.746+0000 7f51e2000640 1 -- 172.21.15.100:0/3808799459 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f51d4081360 con 0x7f51ec0d08d0 2024-08-17T02:45:34.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.746+0000 7f51e9e00640 1 --2- 172.21.15.100:0/3808799459 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f51c80650c0 0x7f51c8067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:34.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.746+0000 7f51e9e00640 1 --2- 172.21.15.100:0/3808799459 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f51c80650c0 0x7f51c8067570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f51dc034000 tx=0x7f51dc032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:34.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.750+0000 7f51e2000640 1 -- 172.21.15.100:0/3808799459 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f51d404fa80 con 0x7f51ec0d08d0 2024-08-17T02:45:34.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.958+0000 7f51f0a00640 1 -- 172.21.15.100:0/3808799459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51ec064db0 con 0x7f51ec0d08d0 2024-08-17T02:45:34.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.958+0000 7f51e2000640 1 -- 172.21.15.100:0/3808799459 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7f51d4017020 con 0x7f51ec0d08d0 2024-08-17T02:45:34.960 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:34.960 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3043714204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3043714204},{"type":"v1","addr":"172.21.15.100:6835","nonce":3043714204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:45:34.960 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 2 2024-08-17T02:45:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.960+0000 7f51f0a00640 1 -- 172.21.15.100:0/3808799459 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f51c80650c0 msgr2=0x7f51c8067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.960+0000 7f51f0a00640 1 --2- 172.21.15.100:0/3808799459 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f51c80650c0 0x7f51c8067570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f51dc034000 tx=0x7f51dc032000 comp rx=0 tx=0).stop 2024-08-17T02:45:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.960+0000 7f51f0a00640 1 -- 172.21.15.100:0/3808799459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51ec0d08d0 msgr2=0x7f51ec15a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.960+0000 7f51f0a00640 1 --2- 172.21.15.100:0/3808799459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51ec0d08d0 0x7f51ec15a4f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f51d400c560 tx=0x7f51d4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.960+0000 7f51f0a00640 1 -- 172.21.15.100:0/3808799459 shutdown_connections 2024-08-17T02:45:34.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.960+0000 7f51f0a00640 1 --2- 172.21.15.100:0/3808799459 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f51c80650c0 0x7f51c8067570 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.960+0000 7f51f0a00640 1 --2- 172.21.15.100:0/3808799459 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f51ec158ce0 0x7f51ec144660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.960+0000 7f51f0a00640 1 --2- 172.21.15.100:0/3808799459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51ec0d08d0 0x7f51ec15a4f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.960+0000 7f51f0a00640 1 --2- 172.21.15.100:0/3808799459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec0cb340 0x7f51ec0c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:34.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.960+0000 7f51f0a00640 1 -- 172.21.15.100:0/3808799459 >> 172.21.15.100:0/3808799459 conn(0x7f51ec0cfdc0 msgr2=0x7f51ec0c5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:34.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.960+0000 7f51f0a00640 1 -- 172.21.15.100:0/3808799459 shutdown_connections 2024-08-17T02:45:34.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:34.960+0000 7f51f0a00640 1 -- 172.21.15.100:0/3808799459 wait complete. 2024-08-17T02:45:36.978 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:45:37.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.147+0000 7f0933200640 1 Processor -- start 2024-08-17T02:45:37.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.148+0000 7f0933200640 1 -- start start 2024-08-17T02:45:37.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.149+0000 7f0933200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0934159ca0 0x7f09340ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:37.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.149+0000 7f0933200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f09340ccca0 0x7f0934162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:37.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.149+0000 7f0933200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09340cadc0 con 0x7f09340ca8a0 2024-08-17T02:45:37.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.149+0000 7f0933200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09340cd6e0 con 0x7f0934159ca0 2024-08-17T02:45:37.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.149+0000 7f0933200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09340cb060 con 0x7f09340ccca0 2024-08-17T02:45:37.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.149+0000 7f0931e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0934159ca0 0x7f09340ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:37.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.149+0000 7f0931e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0934159ca0 0x7f09340ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40244/0 (socket says 172.21.15.100:40244) 2024-08-17T02:45:37.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.149+0000 7f092be00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f09340ca8a0 0x7f09340cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44848/0 (socket says 172.21.15.100:44848) 2024-08-17T02:45:37.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.149+0000 7f0931e00640 1 -- 172.21.15.100:0/3557954571 learned_addr learned my addr 172.21.15.100:0/3557954571 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:37.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.149+0000 7f0932800640 1 --2- 172.21.15.100:0/3557954571 >> v2:172.21.15.123:3300/0 conn(0x7f09340ccca0 0x7f0934162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:37.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.149+0000 7f0931e00640 1 -- 172.21.15.100:0/3557954571 >> v2:172.21.15.123:3300/0 conn(0x7f09340ccca0 msgr2=0x7f0934162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:37.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.149+0000 7f0931e00640 1 --2- 172.21.15.100:0/3557954571 >> v2:172.21.15.123:3300/0 conn(0x7f09340ccca0 0x7f0934162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.149+0000 7f0931e00640 1 -- 172.21.15.100:0/3557954571 >> v1:172.21.15.100:6789/0 conn(0x7f09340ca8a0 legacy=0x7f09340cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:37.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.149+0000 7f0931e00640 1 -- 172.21.15.100:0/3557954571 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09340cb300 con 0x7f0934159ca0 2024-08-17T02:45:37.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.149+0000 7f0931400640 1 -- 172.21.15.100:0/3557954571 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903820569 0 0) 0x7f09340cadc0 con 0x7f09340ca8a0 2024-08-17T02:45:37.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.150+0000 7f0931e00640 1 --2- 172.21.15.100:0/3557954571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0934159ca0 0x7f09340ca360 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f09340b26e0 tx=0x7f09240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3adc1191a0d05d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:37.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.151+0000 7f0931400640 1 -- 172.21.15.100:0/3557954571 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092402ae80 con 0x7f0934159ca0 2024-08-17T02:45:37.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.151+0000 7f0931400640 1 -- 172.21.15.100:0/3557954571 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0924032440 con 0x7f0934159ca0 2024-08-17T02:45:37.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.151+0000 7f0931400640 1 -- 172.21.15.100:0/3557954571 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09240327c0 con 0x7f0934159ca0 2024-08-17T02:45:37.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.151+0000 7f0933200640 1 -- 172.21.15.100:0/3557954571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0934159ca0 msgr2=0x7f09340ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:37.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.151+0000 7f0933200640 1 --2- 172.21.15.100:0/3557954571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0934159ca0 0x7f09340ca360 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f09340b26e0 tx=0x7f09240091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.151+0000 7f0933200640 1 -- 172.21.15.100:0/3557954571 shutdown_connections 2024-08-17T02:45:37.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.151+0000 7f0933200640 1 --2- 172.21.15.100:0/3557954571 >> v2:172.21.15.123:3300/0 conn(0x7f09340ccca0 0x7f0934162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.151+0000 7f0933200640 1 --2- 172.21.15.100:0/3557954571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0934159ca0 0x7f09340ca360 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.151+0000 7f0933200640 1 -- 172.21.15.100:0/3557954571 >> 172.21.15.100:0/3557954571 conn(0x7f0934098e00 msgr2=0x7f093406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:37.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.151+0000 7f0933200640 1 -- 172.21.15.100:0/3557954571 shutdown_connections 2024-08-17T02:45:37.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.151+0000 7f0933200640 1 -- 172.21.15.100:0/3557954571 wait complete. 2024-08-17T02:45:37.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.153+0000 7f0933200640 1 Processor -- start 2024-08-17T02:45:37.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.153+0000 7f0933200640 1 -- start start 2024-08-17T02:45:37.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.154+0000 7f0933200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09340ca8a0 0x7f09340c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:37.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.154+0000 7f0933200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09340ccca0 0x7f0934158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:37.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.154+0000 7f0933200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0934159ca0 0x7f0934154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:37.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.154+0000 7f0933200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0934169a60 con 0x7f09340ccca0 2024-08-17T02:45:37.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.154+0000 7f0933200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09340c5f00 con 0x7f09340ca8a0 2024-08-17T02:45:37.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.154+0000 7f0933200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09340c55d0 con 0x7f0934159ca0 2024-08-17T02:45:37.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.154+0000 7f092be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09340ccca0 0x7f0934158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:37.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.154+0000 7f092be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09340ccca0 0x7f0934158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40254/0 (socket says 172.21.15.100:40254) 2024-08-17T02:45:37.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.154+0000 7f092be00640 1 -- 172.21.15.100:0/1426117444 learned_addr learned my addr 172.21.15.100:0/1426117444 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:37.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.154+0000 7f0931e00640 1 --2- 172.21.15.100:0/1426117444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09340ca8a0 0x7f09340c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:37.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.154+0000 7f0932800640 1 --2- 172.21.15.100:0/1426117444 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0934159ca0 0x7f0934154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:37.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.155+0000 7f092be00640 1 -- 172.21.15.100:0/1426117444 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0934159ca0 msgr2=0x7f0934154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:37.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.155+0000 7f092be00640 1 --2- 172.21.15.100:0/1426117444 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0934159ca0 0x7f0934154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.155+0000 7f092be00640 1 -- 172.21.15.100:0/1426117444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09340ca8a0 msgr2=0x7f09340c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:37.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.155+0000 7f092be00640 1 --2- 172.21.15.100:0/1426117444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09340ca8a0 0x7f09340c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.155+0000 7f092be00640 1 -- 172.21.15.100:0/1426117444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0924009450 con 0x7f09340ccca0 2024-08-17T02:45:37.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.155+0000 7f0931e00640 1 --2- 172.21.15.100:0/1426117444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09340ca8a0 0x7f09340c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:37.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.155+0000 7f092be00640 1 --2- 172.21.15.100:0/1426117444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09340ccca0 0x7f0934158560 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f091c00c520 tx=0x7f091c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:37.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.155+0000 7f0929600640 1 -- 172.21.15.100:0/1426117444 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c0072e0 con 0x7f09340ccca0 2024-08-17T02:45:37.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.155+0000 7f0929600640 1 -- 172.21.15.100:0/1426117444 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c007460 con 0x7f09340ccca0 2024-08-17T02:45:37.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.155+0000 7f0933200640 1 -- 172.21.15.100:0/1426117444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09340c58b0 con 0x7f09340ccca0 2024-08-17T02:45:37.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.155+0000 7f0929600640 1 -- 172.21.15.100:0/1426117444 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c0057d0 con 0x7f09340ccca0 2024-08-17T02:45:37.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.155+0000 7f0933200640 1 -- 172.21.15.100:0/1426117444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09340c68d0 con 0x7f09340ccca0 2024-08-17T02:45:37.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.156+0000 7f0933200640 1 -- 172.21.15.100:0/1426117444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0934071050 con 0x7f09340ccca0 2024-08-17T02:45:37.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.158+0000 7f0929600640 1 -- 172.21.15.100:0/1426117444 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f091c005b80 con 0x7f09340ccca0 2024-08-17T02:45:37.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.159+0000 7f0929600640 1 --2- 172.21.15.100:0/1426117444 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f09100650c0 0x7f0910067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:37.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.159+0000 7f0929600640 1 -- 172.21.15.100:0/1426117444 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f091c0814d0 con 0x7f09340ccca0 2024-08-17T02:45:37.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.159+0000 7f0931e00640 1 --2- 172.21.15.100:0/1426117444 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f09100650c0 0x7f0910067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:37.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.159+0000 7f0931e00640 1 --2- 172.21.15.100:0/1426117444 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f09100650c0 0x7f0910067570 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0924034000 tx=0x7f0924032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:37.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.163+0000 7f0929600640 1 -- 172.21.15.100:0/1426117444 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f091c04f9d0 con 0x7f09340ccca0 2024-08-17T02:45:37.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.391+0000 7f0933200640 1 -- 172.21.15.100:0/1426117444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0934156060 con 0x7f09340ccca0 2024-08-17T02:45:37.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.392+0000 7f0929600640 1 -- 172.21.15.100:0/1426117444 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3533 (secure 0 0 0) 0x7f091c017020 con 0x7f09340ccca0 2024-08-17T02:45:37.394 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:37.394 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3043714204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3043714204},{"type":"v1","addr":"172.21.15.100:6835","nonce":3043714204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/543049926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":543049926},{"type":"v1","addr":"172.21.15.100:6837","nonce":543049926}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2733092927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2733092927},{"type":"v1","addr":"172.21.15.123:6834","nonce":2733092927}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2872394530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2872394530},{"type":"v1","addr":"172.21.15.123:6835","nonce":2872394530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-08-17T02:45:37.394 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 3 2024-08-17T02:45:37.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.394+0000 7f0933200640 1 -- 172.21.15.100:0/1426117444 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f09100650c0 msgr2=0x7f0910067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:37.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.394+0000 7f0933200640 1 --2- 172.21.15.100:0/1426117444 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f09100650c0 0x7f0910067570 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0924034000 tx=0x7f0924032000 comp rx=0 tx=0).stop 2024-08-17T02:45:37.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.394+0000 7f0933200640 1 -- 172.21.15.100:0/1426117444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09340ccca0 msgr2=0x7f0934158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:37.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.394+0000 7f0933200640 1 --2- 172.21.15.100:0/1426117444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09340ccca0 0x7f0934158560 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f091c00c520 tx=0x7f091c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.394+0000 7f0933200640 1 -- 172.21.15.100:0/1426117444 shutdown_connections 2024-08-17T02:45:37.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.394+0000 7f0933200640 1 --2- 172.21.15.100:0/1426117444 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f09100650c0 0x7f0910067570 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.394+0000 7f0933200640 1 --2- 172.21.15.100:0/1426117444 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0934159ca0 0x7f0934154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.394+0000 7f0933200640 1 --2- 172.21.15.100:0/1426117444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09340ccca0 0x7f0934158560 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.394+0000 7f0933200640 1 --2- 172.21.15.100:0/1426117444 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09340ca8a0 0x7f09340c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.394+0000 7f0933200640 1 -- 172.21.15.100:0/1426117444 >> 172.21.15.100:0/1426117444 conn(0x7f0934098e00 msgr2=0x7f09340ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:37.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.394+0000 7f0933200640 1 -- 172.21.15.100:0/1426117444 shutdown_connections 2024-08-17T02:45:37.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.394+0000 7f0933200640 1 -- 172.21.15.100:0/1426117444 wait complete. 2024-08-17T02:45:37.412 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:45:37.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.562+0000 7f5e4bc00640 1 Processor -- start 2024-08-17T02:45:37.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.562+0000 7f5e4bc00640 1 -- start start 2024-08-17T02:45:37.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.564+0000 7f5e4bc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5e44140580 0x7f5e440c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:37.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.564+0000 7f5e4bc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e440caa80 con 0x7f5e441401b0 2024-08-17T02:45:37.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.564+0000 7f5e4bc00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e440c9e70 con 0x7f5e440b1440 2024-08-17T02:45:37.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.564+0000 7f5e4bc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e440c9c90 con 0x7f5e44140580 2024-08-17T02:45:37.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.564+0000 7f5e49c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5e44140580 0x7f5e440c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:37.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.564+0000 7f5e49200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5e441401b0 0x7f5e440b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44858/0 (socket says 172.21.15.100:44858) 2024-08-17T02:45:37.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.564+0000 7f5e49200640 1 -- 172.21.15.100:0/1645281779 learned_addr learned my addr 172.21.15.100:0/1645281779 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:37.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.564+0000 7f5e49c00640 1 -- 172.21.15.100:0/1645281779 >> v1:172.21.15.123:6789/0 conn(0x7f5e440b1440 legacy=0x7f5e440c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:37.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.564+0000 7f5e49c00640 1 -- 172.21.15.100:0/1645281779 >> v1:172.21.15.100:6789/0 conn(0x7f5e441401b0 legacy=0x7f5e440b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:37.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.564+0000 7f5e49c00640 1 -- 172.21.15.100:0/1645281779 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e440ca150 con 0x7f5e44140580 2024-08-17T02:45:37.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.564+0000 7f5e43e00640 1 -- 172.21.15.100:0/1645281779 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294189827 0 0) 0x7f5e440caa80 con 0x7f5e441401b0 2024-08-17T02:45:37.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.565+0000 7f5e49c00640 1 --2- 172.21.15.100:0/1645281779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e44140580 0x7f5e440c9750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009e60 tx=0x7f5e3c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46c98de59a12424 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:37.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.566+0000 7f5e43e00640 1 -- 172.21.15.100:0/1645281779 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c007550 con 0x7f5e44140580 2024-08-17T02:45:37.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.566+0000 7f5e43e00640 1 -- 172.21.15.100:0/1645281779 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c02d050 con 0x7f5e44140580 2024-08-17T02:45:37.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.566+0000 7f5e43e00640 1 -- 172.21.15.100:0/1645281779 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c007900 con 0x7f5e44140580 2024-08-17T02:45:37.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.566+0000 7f5e4bc00640 1 -- 172.21.15.100:0/1645281779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e44140580 msgr2=0x7f5e440c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:37.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.566+0000 7f5e4bc00640 1 --2- 172.21.15.100:0/1645281779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e44140580 0x7f5e440c9750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009e60 tx=0x7f5e3c009780 comp rx=0 tx=0).stop 2024-08-17T02:45:37.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.566+0000 7f5e4bc00640 1 -- 172.21.15.100:0/1645281779 shutdown_connections 2024-08-17T02:45:37.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.566+0000 7f5e4bc00640 1 --2- 172.21.15.100:0/1645281779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e44140580 0x7f5e440c9750 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.566+0000 7f5e4bc00640 1 -- 172.21.15.100:0/1645281779 >> 172.21.15.100:0/1645281779 conn(0x7f5e440cb9b0 msgr2=0x7f5e440cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:37.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.567+0000 7f5e4bc00640 1 -- 172.21.15.100:0/1645281779 shutdown_connections 2024-08-17T02:45:37.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.567+0000 7f5e4bc00640 1 -- 172.21.15.100:0/1645281779 wait complete. 2024-08-17T02:45:37.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.568+0000 7f5e4bc00640 1 Processor -- start 2024-08-17T02:45:37.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.568+0000 7f5e4bc00640 1 -- start start 2024-08-17T02:45:37.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.569+0000 7f5e4bc00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5e440b1440 0x7f5e440c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:37.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.569+0000 7f5e4bc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e441401b0 0x7f5e44159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:37.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.569+0000 7f5e4bc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e44140580 0x7f5e440c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:37.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.569+0000 7f5e4bc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4413dd30 con 0x7f5e44140580 2024-08-17T02:45:37.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.569+0000 7f5e4bc00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e440c52f0 con 0x7f5e441401b0 2024-08-17T02:45:37.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.569+0000 7f5e4bc00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e440c79c0 con 0x7f5e440b1440 2024-08-17T02:45:37.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.569+0000 7f5e49c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e44140580 0x7f5e440c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:37.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.569+0000 7f5e49c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e44140580 0x7f5e440c5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40270/0 (socket says 172.21.15.100:40270) 2024-08-17T02:45:37.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.569+0000 7f5e49c00640 1 -- 172.21.15.100:0/4176610553 learned_addr learned my addr 172.21.15.100:0/4176610553 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:37.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.569+0000 7f5e49200640 1 --2- 172.21.15.100:0/4176610553 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5e440b1440 0x7f5e440c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:37.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.569+0000 7f5e49c00640 1 -- 172.21.15.100:0/4176610553 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5e440b1440 msgr2=0x7f5e440c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:37.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.569+0000 7f5e3be00640 1 --2- 172.21.15.100:0/4176610553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e441401b0 0x7f5e44159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:37.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.570+0000 7f5e49c00640 1 --2- 172.21.15.100:0/4176610553 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5e440b1440 0x7f5e440c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.570+0000 7f5e49c00640 1 -- 172.21.15.100:0/4176610553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e441401b0 msgr2=0x7f5e44159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:37.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.570+0000 7f5e49c00640 1 --2- 172.21.15.100:0/4176610553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e441401b0 0x7f5e44159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.570+0000 7f5e49c00640 1 -- 172.21.15.100:0/4176610553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c009a20 con 0x7f5e44140580 2024-08-17T02:45:37.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.570+0000 7f5e49200640 1 --2- 172.21.15.100:0/4176610553 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5e440b1440 0x7f5e440c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:45:37.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.570+0000 7f5e3be00640 1 --2- 172.21.15.100:0/4176610553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e441401b0 0x7f5e44159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:45:37.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.570+0000 7f5e49c00640 1 --2- 172.21.15.100:0/4176610553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e44140580 0x7f5e440c5660 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0097c0 tx=0x7f5e3c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:37.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.570+0000 7f5e40c00640 1 -- 172.21.15.100:0/4176610553 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c031cc0 con 0x7f5e44140580 2024-08-17T02:45:37.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.570+0000 7f5e40c00640 1 -- 172.21.15.100:0/4176610553 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c031e40 con 0x7f5e44140580 2024-08-17T02:45:37.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.570+0000 7f5e40c00640 1 -- 172.21.15.100:0/4176610553 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c03c670 con 0x7f5e44140580 2024-08-17T02:45:37.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.570+0000 7f5e4bc00640 1 -- 172.21.15.100:0/4176610553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e440c7ca0 con 0x7f5e44140580 2024-08-17T02:45:37.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.570+0000 7f5e4bc00640 1 -- 172.21.15.100:0/4176610553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4413c390 con 0x7f5e44140580 2024-08-17T02:45:37.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.571+0000 7f5e4bc00640 1 -- 172.21.15.100:0/4176610553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4413c580 con 0x7f5e44140580 2024-08-17T02:45:37.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.572+0000 7f5e40c00640 1 -- 172.21.15.100:0/4176610553 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f5e3c003040 con 0x7f5e44140580 2024-08-17T02:45:37.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.573+0000 7f5e40c00640 1 --2- 172.21.15.100:0/4176610553 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5e200650c0 0x7f5e20067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:37.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.573+0000 7f5e40c00640 1 -- 172.21.15.100:0/4176610553 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5e3c0a36b0 con 0x7f5e44140580 2024-08-17T02:45:37.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.573+0000 7f5e49200640 1 --2- 172.21.15.100:0/4176610553 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5e200650c0 0x7f5e20067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:37.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.574+0000 7f5e49200640 1 --2- 172.21.15.100:0/4176610553 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5e200650c0 0x7f5e20067570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5e34000c00 tx=0x7f5e34009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:37.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.578+0000 7f5e40c00640 1 -- 172.21.15.100:0/4176610553 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5e3c071b00 con 0x7f5e44140580 2024-08-17T02:45:37.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.764+0000 7f5e4bc00640 1 -- 172.21.15.100:0/4176610553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e44064db0 con 0x7f5e44140580 2024-08-17T02:45:37.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.764+0000 7f5e40c00640 1 -- 172.21.15.100:0/4176610553 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12175 (secure 0 0 0) 0x7f5e3c049020 con 0x7f5e44140580 2024-08-17T02:45:37.766 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:37.766 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":18,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:37.715309+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:45:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.766+0000 7f5e4bc00640 1 -- 172.21.15.100:0/4176610553 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5e200650c0 msgr2=0x7f5e20067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.766+0000 7f5e4bc00640 1 --2- 172.21.15.100:0/4176610553 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5e200650c0 0x7f5e20067570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5e34000c00 tx=0x7f5e34009040 comp rx=0 tx=0).stop 2024-08-17T02:45:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.766+0000 7f5e4bc00640 1 -- 172.21.15.100:0/4176610553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e44140580 msgr2=0x7f5e440c5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.766+0000 7f5e4bc00640 1 --2- 172.21.15.100:0/4176610553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e44140580 0x7f5e440c5660 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0097c0 tx=0x7f5e3c037000 comp rx=0 tx=0).stop 2024-08-17T02:45:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.767+0000 7f5e4bc00640 1 -- 172.21.15.100:0/4176610553 shutdown_connections 2024-08-17T02:45:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.767+0000 7f5e4bc00640 1 --2- 172.21.15.100:0/4176610553 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5e200650c0 0x7f5e20067570 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.767+0000 7f5e4bc00640 1 --2- 172.21.15.100:0/4176610553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e44140580 0x7f5e440c5660 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.767+0000 7f5e4bc00640 1 --2- 172.21.15.100:0/4176610553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e441401b0 0x7f5e44159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.767+0000 7f5e4bc00640 1 --2- 172.21.15.100:0/4176610553 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5e440b1440 0x7f5e440c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.767+0000 7f5e4bc00640 1 -- 172.21.15.100:0/4176610553 >> 172.21.15.100:0/4176610553 conn(0x7f5e440cb9b0 msgr2=0x7f5e440af420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:37.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.767+0000 7f5e4bc00640 1 -- 172.21.15.100:0/4176610553 shutdown_connections 2024-08-17T02:45:37.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.767+0000 7f5e4bc00640 1 -- 172.21.15.100:0/4176610553 wait complete. 2024-08-17T02:45:37.786 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:45:35.140990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:45:37.787 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:45:37.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.934+0000 7f44f5a00640 1 Processor -- start 2024-08-17T02:45:37.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.934+0000 7f44f5a00640 1 -- start start 2024-08-17T02:45:37.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.935+0000 7f44f5a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f44f00b2db0 0x7f44f00b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:37.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.935+0000 7f44f5a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f00b2700 con 0x7f44f00b5840 2024-08-17T02:45:37.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.935+0000 7f44f5a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f00b1940 con 0x7f44f00b40d0 2024-08-17T02:45:37.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.935+0000 7f44f5a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f00b5cb0 con 0x7f44f00b2db0 2024-08-17T02:45:37.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.935+0000 7f44ee000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f44f00b5840 0x7f44f00cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44874/0 (socket says 172.21.15.100:44874) 2024-08-17T02:45:37.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.935+0000 7f44ee000640 1 -- 172.21.15.100:0/2455916399 learned_addr learned my addr 172.21.15.100:0/2455916399 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:37.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.935+0000 7f44eea00640 1 --2- 172.21.15.100:0/2455916399 >> v2:172.21.15.123:3300/0 conn(0x7f44f00b2db0 0x7f44f00b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:37.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.936+0000 7f44ed600640 1 -- 172.21.15.100:0/2455916399 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072418949 0 0) 0x7f44f00b2700 con 0x7f44f00b5840 2024-08-17T02:45:37.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.936+0000 7f44ed600640 1 -- 172.21.15.100:0/2455916399 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44d40034e0 con 0x7f44f00b5840 2024-08-17T02:45:37.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.936+0000 7f44eea00640 1 -- 172.21.15.100:0/2455916399 >> v1:172.21.15.123:6789/0 conn(0x7f44f00b40d0 legacy=0x7f44f00aae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:37.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.936+0000 7f44eea00640 1 -- 172.21.15.100:0/2455916399 >> v1:172.21.15.100:6789/0 conn(0x7f44f00b5840 legacy=0x7f44f00cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:37.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.936+0000 7f44eea00640 1 -- 172.21.15.100:0/2455916399 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f00b1c20 con 0x7f44f00b2db0 2024-08-17T02:45:37.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.937+0000 7f44eea00640 1 --2- 172.21.15.100:0/2455916399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f00b2db0 0x7f44f00b3180 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009850 tx=0x7f44e00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=581abed32762c49c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:37.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.937+0000 7f44ed600640 1 -- 172.21.15.100:0/2455916399 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e002ae20 con 0x7f44f00b2db0 2024-08-17T02:45:37.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.937+0000 7f44ed600640 1 -- 172.21.15.100:0/2455916399 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e0032440 con 0x7f44f00b2db0 2024-08-17T02:45:37.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.937+0000 7f44ed600640 1 -- 172.21.15.100:0/2455916399 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e00327c0 con 0x7f44f00b2db0 2024-08-17T02:45:37.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.938+0000 7f44f5a00640 1 -- 172.21.15.100:0/2455916399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f00b2db0 msgr2=0x7f44f00b3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:37.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.938+0000 7f44f5a00640 1 --2- 172.21.15.100:0/2455916399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f00b2db0 0x7f44f00b3180 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009850 tx=0x7f44e00090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.938+0000 7f44f5a00640 1 -- 172.21.15.100:0/2455916399 shutdown_connections 2024-08-17T02:45:37.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.938+0000 7f44f5a00640 1 --2- 172.21.15.100:0/2455916399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f00b2db0 0x7f44f00b3180 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.938+0000 7f44f5a00640 1 -- 172.21.15.100:0/2455916399 >> 172.21.15.100:0/2455916399 conn(0x7f44f00cfdc0 msgr2=0x7f44f00d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:37.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.938+0000 7f44f5a00640 1 -- 172.21.15.100:0/2455916399 shutdown_connections 2024-08-17T02:45:37.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.938+0000 7f44f5a00640 1 -- 172.21.15.100:0/2455916399 wait complete. 2024-08-17T02:45:37.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.939+0000 7f44f5a00640 1 Processor -- start 2024-08-17T02:45:37.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.939+0000 7f44f5a00640 1 -- start start 2024-08-17T02:45:37.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.940+0000 7f44f5a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44f00b2db0 0x7f44f015a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:37.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.940+0000 7f44f5a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f00b40d0 0x7f44f0146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:37.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.940+0000 7f44f5a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44f00b5840 0x7f44f0147220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:37.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.940+0000 7f44f5a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f0147760 con 0x7f44f00b5840 2024-08-17T02:45:37.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.940+0000 7f44f5a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f01537f0 con 0x7f44f00b40d0 2024-08-17T02:45:37.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.940+0000 7f44f5a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f0153d40 con 0x7f44f00b2db0 2024-08-17T02:45:37.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.940+0000 7f44ee000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f00b40d0 0x7f44f0146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:37.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.940+0000 7f44ef400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44f00b5840 0x7f44f0147220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:37.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.940+0000 7f44ee000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f00b40d0 0x7f44f0146ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:50424/0 (socket says 172.21.15.100:50424) 2024-08-17T02:45:37.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.940+0000 7f44eea00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44f00b2db0 0x7f44f015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:37.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.940+0000 7f44ee000640 1 -- 172.21.15.100:0/1473596662 learned_addr learned my addr 172.21.15.100:0/1473596662 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:37.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.941+0000 7f44ef400640 1 -- 172.21.15.100:0/1473596662 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44f00b2db0 msgr2=0x7f44f015a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:37.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.941+0000 7f44ef400640 1 --2- 172.21.15.100:0/1473596662 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44f00b2db0 0x7f44f015a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.941+0000 7f44ef400640 1 -- 172.21.15.100:0/1473596662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f00b40d0 msgr2=0x7f44f0146ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:37.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.941+0000 7f44ef400640 1 --2- 172.21.15.100:0/1473596662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f00b40d0 0x7f44f0146ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:37.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.941+0000 7f44ef400640 1 -- 172.21.15.100:0/1473596662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e0009390 con 0x7f44f00b5840 2024-08-17T02:45:37.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.941+0000 7f44ef400640 1 --2- 172.21.15.100:0/1473596662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44f00b5840 0x7f44f0147220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f44e800c790 tx=0x7f44e8001610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:37.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.942+0000 7f44e6000640 1 -- 172.21.15.100:0/1473596662 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e800a640 con 0x7f44f00b5840 2024-08-17T02:45:37.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.942+0000 7f44e6000640 1 -- 172.21.15.100:0/1473596662 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e800a7a0 con 0x7f44f00b5840 2024-08-17T02:45:37.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.942+0000 7f44e6000640 1 -- 172.21.15.100:0/1473596662 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e800ab60 con 0x7f44f00b5840 2024-08-17T02:45:37.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.942+0000 7f44f5a00640 1 -- 172.21.15.100:0/1473596662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f0153230 con 0x7f44f00b5840 2024-08-17T02:45:37.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.942+0000 7f44f5a00640 1 -- 172.21.15.100:0/1473596662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f0153fe0 con 0x7f44f00b5840 2024-08-17T02:45:37.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.943+0000 7f44f5a00640 1 -- 172.21.15.100:0/1473596662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f0064db0 con 0x7f44f00b5840 2024-08-17T02:45:37.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.944+0000 7f44e6000640 1 -- 172.21.15.100:0/1473596662 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f44e8012420 con 0x7f44f00b5840 2024-08-17T02:45:37.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.945+0000 7f44e6000640 1 --2- 172.21.15.100:0/1473596662 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f44d00650c0 0x7f44d0067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:37.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.945+0000 7f44e6000640 1 -- 172.21.15.100:0/1473596662 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f44e8082180 con 0x7f44f00b5840 2024-08-17T02:45:37.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.945+0000 7f44eea00640 1 --2- 172.21.15.100:0/1473596662 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f44d00650c0 0x7f44d0067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:37.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.946+0000 7f44eea00640 1 --2- 172.21.15.100:0/1473596662 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f44d00650c0 0x7f44d0067570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f44e0034000 tx=0x7f44e0032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:37.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:37.949+0000 7f44e6000640 1 -- 172.21.15.100:0/1473596662 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f44e8050680 con 0x7f44f00b5840 2024-08-17T02:45:38.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.127+0000 7f44f5a00640 1 -- 172.21.15.100:0/1473596662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f44f0067240 con 0x7f44f00b5840 2024-08-17T02:45:38.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.128+0000 7f44e6000640 1 -- 172.21.15.100:0/1473596662 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f44e8053ca0 con 0x7f44f00b5840 2024-08-17T02:45:38.130 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-08-17T02:45:38.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.130+0000 7f44f5a00640 1 -- 172.21.15.100:0/1473596662 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f44d00650c0 msgr2=0x7f44d0067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:38.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.130+0000 7f44f5a00640 1 --2- 172.21.15.100:0/1473596662 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f44d00650c0 0x7f44d0067570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f44e0034000 tx=0x7f44e0032000 comp rx=0 tx=0).stop 2024-08-17T02:45:38.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.130+0000 7f44f5a00640 1 -- 172.21.15.100:0/1473596662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44f00b5840 msgr2=0x7f44f0147220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:38.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.130+0000 7f44f5a00640 1 --2- 172.21.15.100:0/1473596662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44f00b5840 0x7f44f0147220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f44e800c790 tx=0x7f44e8001610 comp rx=0 tx=0).stop 2024-08-17T02:45:38.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.130+0000 7f44f5a00640 1 -- 172.21.15.100:0/1473596662 shutdown_connections 2024-08-17T02:45:38.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.130+0000 7f44f5a00640 1 --2- 172.21.15.100:0/1473596662 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f44d00650c0 0x7f44d0067570 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:38.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.130+0000 7f44f5a00640 1 --2- 172.21.15.100:0/1473596662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44f00b5840 0x7f44f0147220 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:38.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.130+0000 7f44f5a00640 1 --2- 172.21.15.100:0/1473596662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f00b40d0 0x7f44f0146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:38.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.130+0000 7f44f5a00640 1 --2- 172.21.15.100:0/1473596662 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44f00b2db0 0x7f44f015a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:38.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.130+0000 7f44f5a00640 1 -- 172.21.15.100:0/1473596662 >> 172.21.15.100:0/1473596662 conn(0x7f44f00cfdc0 msgr2=0x7f44f0067880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:38.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.130+0000 7f44f5a00640 1 -- 172.21.15.100:0/1473596662 shutdown_connections 2024-08-17T02:45:38.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.130+0000 7f44f5a00640 1 -- 172.21.15.100:0/1473596662 wait complete. 2024-08-17T02:45:38.146 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:45:38.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.291+0000 7f0ade200640 1 Processor -- start 2024-08-17T02:45:38.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.292+0000 7f0ade200640 1 -- start start 2024-08-17T02:45:38.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.293+0000 7f0ade200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ad80ab2b0 0x7f0ad80afe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:38.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.293+0000 7f0ade200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0ad80b03d0 0x7f0ad815c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:38.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.293+0000 7f0ade200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad80ab700 con 0x7f0ad80cc010 2024-08-17T02:45:38.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.293+0000 7f0ade200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad80ab950 con 0x7f0ad80b03d0 2024-08-17T02:45:38.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.293+0000 7f0ade200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad80abc30 con 0x7f0ad80ab2b0 2024-08-17T02:45:38.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.293+0000 7f0adce00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0ad80cc010 0x7f0ad80a98e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44884/0 (socket says 172.21.15.100:44884) 2024-08-17T02:45:38.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.293+0000 7f0adce00640 1 -- 172.21.15.100:0/1427683120 learned_addr learned my addr 172.21.15.100:0/1427683120 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:38.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.293+0000 7f0add800640 1 --2- 172.21.15.100:0/1427683120 >> v2:172.21.15.100:3300/0 conn(0x7f0ad80b03d0 0x7f0ad815c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:38.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.293+0000 7f0ad7e00640 1 --2- 172.21.15.100:0/1427683120 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ad80ab2b0 0x7f0ad80afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:38.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.294+0000 7f0add800640 1 -- 172.21.15.100:0/1427683120 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ad80ab2b0 msgr2=0x7f0ad80afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:38.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.294+0000 7f0add800640 1 --2- 172.21.15.100:0/1427683120 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ad80ab2b0 0x7f0ad80afe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:38.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.294+0000 7f0add800640 1 -- 172.21.15.100:0/1427683120 >> v1:172.21.15.100:6789/0 conn(0x7f0ad80cc010 legacy=0x7f0ad80a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:38.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.294+0000 7f0add800640 1 -- 172.21.15.100:0/1427683120 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad80abf10 con 0x7f0ad80b03d0 2024-08-17T02:45:38.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.294+0000 7f0ad7400640 1 -- 172.21.15.100:0/1427683120 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521524713 0 0) 0x7f0ad80ab700 con 0x7f0ad80cc010 2024-08-17T02:45:38.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.294+0000 7f0add800640 1 --2- 172.21.15.100:0/1427683120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad80b03d0 0x7f0ad815c7c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009e60 tx=0x7f0ad0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79367020e51f111e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:38.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.295+0000 7f0ad7400640 1 -- 172.21.15.100:0/1427683120 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0007550 con 0x7f0ad80b03d0 2024-08-17T02:45:38.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.295+0000 7f0ad7400640 1 -- 172.21.15.100:0/1427683120 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad002d050 con 0x7f0ad80b03d0 2024-08-17T02:45:38.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.295+0000 7f0ad7400640 1 -- 172.21.15.100:0/1427683120 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00078e0 con 0x7f0ad80b03d0 2024-08-17T02:45:38.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.295+0000 7f0ade200640 1 -- 172.21.15.100:0/1427683120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad80b03d0 msgr2=0x7f0ad815c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:38.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.295+0000 7f0ade200640 1 --2- 172.21.15.100:0/1427683120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad80b03d0 0x7f0ad815c7c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009e60 tx=0x7f0ad0009780 comp rx=0 tx=0).stop 2024-08-17T02:45:38.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.295+0000 7f0ade200640 1 -- 172.21.15.100:0/1427683120 shutdown_connections 2024-08-17T02:45:38.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.295+0000 7f0ade200640 1 --2- 172.21.15.100:0/1427683120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad80b03d0 0x7f0ad815c7c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:38.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.295+0000 7f0ade200640 1 --2- 172.21.15.100:0/1427683120 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ad80ab2b0 0x7f0ad80afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:38.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.295+0000 7f0ade200640 1 -- 172.21.15.100:0/1427683120 >> 172.21.15.100:0/1427683120 conn(0x7f0ad8067de0 msgr2=0x7f0ad80681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:38.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.295+0000 7f0ade200640 1 -- 172.21.15.100:0/1427683120 shutdown_connections 2024-08-17T02:45:38.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.295+0000 7f0ade200640 1 -- 172.21.15.100:0/1427683120 wait complete. 2024-08-17T02:45:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.297+0000 7f0ade200640 1 Processor -- start 2024-08-17T02:45:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.297+0000 7f0ade200640 1 -- start start 2024-08-17T02:45:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.298+0000 7f0ade200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ad80ab2b0 0x7f0ad815acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.298+0000 7f0ade200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ad80b03d0 0x7f0ad80c1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.298+0000 7f0ade200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad80cc010 0x7f0ad8154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.298+0000 7f0ade200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad80c1c90 con 0x7f0ad80cc010 2024-08-17T02:45:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.298+0000 7f0ade200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad8168f00 con 0x7f0ad80ab2b0 2024-08-17T02:45:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.298+0000 7f0ade200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad80c1e80 con 0x7f0ad80b03d0 2024-08-17T02:45:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.298+0000 7f0add800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad80cc010 0x7f0ad8154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:38.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.298+0000 7f0add800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad80cc010 0x7f0ad8154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40310/0 (socket says 172.21.15.100:40310) 2024-08-17T02:45:38.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.298+0000 7f0adce00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ad80ab2b0 0x7f0ad815acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:38.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.298+0000 7f0add800640 1 -- 172.21.15.100:0/2843176156 learned_addr learned my addr 172.21.15.100:0/2843176156 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:38.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.298+0000 7f0ad7e00640 1 --2- 172.21.15.100:0/2843176156 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ad80b03d0 0x7f0ad80c1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:38.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.298+0000 7f0add800640 1 -- 172.21.15.100:0/2843176156 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ad80b03d0 msgr2=0x7f0ad80c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:38.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.298+0000 7f0add800640 1 --2- 172.21.15.100:0/2843176156 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ad80b03d0 0x7f0ad80c1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:38.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.298+0000 7f0add800640 1 -- 172.21.15.100:0/2843176156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ad80ab2b0 msgr2=0x7f0ad815acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:38.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.298+0000 7f0add800640 1 --2- 172.21.15.100:0/2843176156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ad80ab2b0 0x7f0ad815acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:38.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.298+0000 7f0add800640 1 -- 172.21.15.100:0/2843176156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad0009a20 con 0x7f0ad80cc010 2024-08-17T02:45:38.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.299+0000 7f0add800640 1 --2- 172.21.15.100:0/2843176156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad80cc010 0x7f0ad8154e80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0ad00099f0 tx=0x7f0ad0037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:38.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.299+0000 7f0acbe00640 1 -- 172.21.15.100:0/2843176156 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00318b0 con 0x7f0ad80cc010 2024-08-17T02:45:38.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.299+0000 7f0acbe00640 1 -- 172.21.15.100:0/2843176156 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad0040070 con 0x7f0ad80cc010 2024-08-17T02:45:38.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.299+0000 7f0acbe00640 1 -- 172.21.15.100:0/2843176156 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0031c60 con 0x7f0ad80cc010 2024-08-17T02:45:38.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.299+0000 7f0ade200640 1 -- 172.21.15.100:0/2843176156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad80c2160 con 0x7f0ad80cc010 2024-08-17T02:45:38.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.299+0000 7f0ade200640 1 -- 172.21.15.100:0/2843176156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad80c2720 con 0x7f0ad80cc010 2024-08-17T02:45:38.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.300+0000 7f0ade200640 1 -- 172.21.15.100:0/2843176156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad8169070 con 0x7f0ad80cc010 2024-08-17T02:45:38.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.301+0000 7f0acbe00640 1 -- 172.21.15.100:0/2843176156 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f0ad0042030 con 0x7f0ad80cc010 2024-08-17T02:45:38.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.302+0000 7f0acbe00640 1 --2- 172.21.15.100:0/2843176156 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0ab80650c0 0x7f0ab8067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:38.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.302+0000 7f0acbe00640 1 -- 172.21.15.100:0/2843176156 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0ad00a38c0 con 0x7f0ad80cc010 2024-08-17T02:45:38.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.302+0000 7f0adce00640 1 --2- 172.21.15.100:0/2843176156 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0ab80650c0 0x7f0ab8067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:38.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.302+0000 7f0adce00640 1 --2- 172.21.15.100:0/2843176156 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0ab80650c0 0x7f0ab8067570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0acc007160 tx=0x7f0acc007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:38.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.306+0000 7f0acbe00640 1 -- 172.21.15.100:0/2843176156 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0ad0071dc0 con 0x7f0ad80cc010 2024-08-17T02:45:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.489+0000 7f0ade200640 1 -- 172.21.15.100:0/2843176156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0ad8071050 con 0x7f0ad80cc010 2024-08-17T02:45:38.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.541+0000 7f0acbe00640 1 -- 172.21.15.100:0/2843176156 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0ad00753e0 con 0x7f0ad80cc010 2024-08-17T02:45:38.544 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:38.544 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-08-17T02:45:38.544 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:45:38.544 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-08-17T02:45:38.544 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2024-08-17T02:45:38.544 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:45:38.544 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-08-17T02:45:38.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.544+0000 7f0ade200640 1 -- 172.21.15.100:0/2843176156 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0ab80650c0 msgr2=0x7f0ab8067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:38.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.544+0000 7f0ade200640 1 --2- 172.21.15.100:0/2843176156 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0ab80650c0 0x7f0ab8067570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0acc007160 tx=0x7f0acc007ec0 comp rx=0 tx=0).stop 2024-08-17T02:45:38.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.544+0000 7f0ade200640 1 -- 172.21.15.100:0/2843176156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad80cc010 msgr2=0x7f0ad8154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:38.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.544+0000 7f0ade200640 1 --2- 172.21.15.100:0/2843176156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad80cc010 0x7f0ad8154e80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0ad00099f0 tx=0x7f0ad0037000 comp rx=0 tx=0).stop 2024-08-17T02:45:38.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.544+0000 7f0ade200640 1 -- 172.21.15.100:0/2843176156 shutdown_connections 2024-08-17T02:45:38.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.544+0000 7f0ade200640 1 --2- 172.21.15.100:0/2843176156 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0ab80650c0 0x7f0ab8067570 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0acc007160 tx=0x7f0acc007ec0 comp rx=0 tx=0).stop 2024-08-17T02:45:38.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.544+0000 7f0ade200640 1 --2- 172.21.15.100:0/2843176156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad80cc010 0x7f0ad8154e80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:38.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.544+0000 7f0ade200640 1 --2- 172.21.15.100:0/2843176156 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ad80b03d0 0x7f0ad80c1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:38.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.544+0000 7f0ade200640 1 --2- 172.21.15.100:0/2843176156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ad80ab2b0 0x7f0ad815acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:38.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.544+0000 7f0ade200640 1 -- 172.21.15.100:0/2843176156 >> 172.21.15.100:0/2843176156 conn(0x7f0ad8067de0 msgr2=0x7f0ad806a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:38.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.544+0000 7f0ade200640 1 -- 172.21.15.100:0/2843176156 shutdown_connections 2024-08-17T02:45:38.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.544+0000 7f0ade200640 1 -- 172.21.15.100:0/2843176156 wait complete. 2024-08-17T02:45:38.561 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:45:38.561 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:45:38.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.712+0000 7fa99e400640 1 Processor -- start 2024-08-17T02:45:38.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.712+0000 7fa99e400640 1 -- start start 2024-08-17T02:45:38.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.714+0000 7fa99e400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa99806df00 0x7fa99806e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:38.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.714+0000 7fa99e400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9980af5f0 con 0x7fa9980ab010 2024-08-17T02:45:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.714+0000 7fa99e400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa998159600 con 0x7fa99815a0e0 2024-08-17T02:45:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.714+0000 7fa99e400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9981598e0 con 0x7fa99806df00 2024-08-17T02:45:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.714+0000 7fa99da00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa9980ab010 0x7fa9980ae8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44892/0 (socket says 172.21.15.100:44892) 2024-08-17T02:45:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.714+0000 7fa99da00640 1 -- 172.21.15.100:0/1331975469 learned_addr learned my addr 172.21.15.100:0/1331975469 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.714+0000 7fa98fe00640 1 --1- 172.21.15.100:0/1331975469 >> v1:172.21.15.123:6789/0 conn(0x7fa99815a0e0 0x7fa9980aa900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.100:57802/0 (socket says 172.21.15.100:57802) 2024-08-17T02:45:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.714+0000 7fa99d000640 1 --2- 172.21.15.100:0/1331975469 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa99806df00 0x7fa99806e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.714+0000 7fa997e00640 1 -- 172.21.15.100:0/1331975469 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065371637 0 0) 0x7fa998159600 con 0x7fa99815a0e0 2024-08-17T02:45:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.714+0000 7fa997e00640 1 -- 172.21.15.100:0/1331975469 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa97c0034e0 con 0x7fa99815a0e0 2024-08-17T02:45:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.714+0000 7fa997e00640 1 -- 172.21.15.100:0/1331975469 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896045855 0 0) 0x7fa9980af5f0 con 0x7fa9980ab010 2024-08-17T02:45:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.714+0000 7fa997e00640 1 -- 172.21.15.100:0/1331975469 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa998159600 con 0x7fa9980ab010 2024-08-17T02:45:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.715+0000 7fa99d000640 1 -- 172.21.15.100:0/1331975469 >> v1:172.21.15.123:6789/0 conn(0x7fa99815a0e0 legacy=0x7fa9980aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:38.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.715+0000 7fa997e00640 1 -- 172.21.15.100:0/1331975469 <== mon.1 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 444361383 0 0) 0x7fa97c0034e0 con 0x7fa99815a0e0 2024-08-17T02:45:38.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.715+0000 7fa99d000640 1 -- 172.21.15.100:0/1331975469 >> v1:172.21.15.100:6789/0 conn(0x7fa9980ab010 legacy=0x7fa9980ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:38.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.715+0000 7fa99d000640 1 -- 172.21.15.100:0/1331975469 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa998159bc0 con 0x7fa99806df00 2024-08-17T02:45:38.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.716+0000 7fa99d000640 1 --2- 172.21.15.100:0/1331975469 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa99806df00 0x7fa99806e2d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa988009800 tx=0x7fa9880090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dacfb0b3878eaec server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:38.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.811+0000 7fa997e00640 1 -- 172.21.15.100:0/1331975469 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9900017f0 con 0x7fa99806df00 2024-08-17T02:45:38.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.811+0000 7fa997e00640 1 -- 172.21.15.100:0/1331975469 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98802a9f0 con 0x7fa99806df00 2024-08-17T02:45:38.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.811+0000 7fa997e00640 1 -- 172.21.15.100:0/1331975469 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980001470 con 0x7fa99806df00 2024-08-17T02:45:38.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.812+0000 7fa99e400640 1 -- 172.21.15.100:0/1331975469 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa99806df00 msgr2=0x7fa99806e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:38.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.812+0000 7fa99e400640 1 --2- 172.21.15.100:0/1331975469 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa99806df00 0x7fa99806e2d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa988009800 tx=0x7fa9880090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:38.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.812+0000 7fa99e400640 1 -- 172.21.15.100:0/1331975469 shutdown_connections 2024-08-17T02:45:38.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.812+0000 7fa99e400640 1 --2- 172.21.15.100:0/1331975469 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa99806df00 0x7fa99806e2d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:38.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.812+0000 7fa99e400640 1 -- 172.21.15.100:0/1331975469 >> 172.21.15.100:0/1331975469 conn(0x7fa998067750 msgr2=0x7fa99806c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:38.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.812+0000 7fa99e400640 1 -- 172.21.15.100:0/1331975469 shutdown_connections 2024-08-17T02:45:38.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.812+0000 7fa99e400640 1 -- 172.21.15.100:0/1331975469 wait complete. 2024-08-17T02:45:38.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.813+0000 7fa99e400640 1 Processor -- start 2024-08-17T02:45:38.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.813+0000 7fa99e400640 1 -- start start 2024-08-17T02:45:38.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.814+0000 7fa99e400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa99806df00 0x7fa99813b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.814+0000 7fa99e400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa9980ab010 0x7fa998069c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.814+0000 7fa99e400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa99815a0e0 0x7fa99806a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.814+0000 7fa99e400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99813acd0 con 0x7fa99815a0e0 2024-08-17T02:45:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.814+0000 7fa99e400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99813b9a0 con 0x7fa99806df00 2024-08-17T02:45:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.814+0000 7fa99e400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa998157560 con 0x7fa9980ab010 2024-08-17T02:45:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.815+0000 7fa99da00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa99815a0e0 0x7fa99806a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.815+0000 7fa99da00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa99815a0e0 0x7fa99806a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40330/0 (socket says 172.21.15.100:40330) 2024-08-17T02:45:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.815+0000 7fa99da00640 1 -- 172.21.15.100:0/306681136 learned_addr learned my addr 172.21.15.100:0/306681136 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.815+0000 7fa99d000640 1 --2- 172.21.15.100:0/306681136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa99806df00 0x7fa99813b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.815+0000 7fa98fe00640 1 --2- 172.21.15.100:0/306681136 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa9980ab010 0x7fa998069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.815+0000 7fa99da00640 1 -- 172.21.15.100:0/306681136 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa9980ab010 msgr2=0x7fa998069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.815+0000 7fa99da00640 1 --2- 172.21.15.100:0/306681136 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa9980ab010 0x7fa998069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:38.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.815+0000 7fa99da00640 1 -- 172.21.15.100:0/306681136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa99806df00 msgr2=0x7fa99813b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:38.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.815+0000 7fa99da00640 1 --2- 172.21.15.100:0/306681136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa99806df00 0x7fa99813b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:38.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.815+0000 7fa99da00640 1 -- 172.21.15.100:0/306681136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa988009390 con 0x7fa99815a0e0 2024-08-17T02:45:38.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.815+0000 7fa99da00640 1 --2- 172.21.15.100:0/306681136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa99815a0e0 0x7fa99806a180 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa99000cd00 tx=0x7fa990007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:38.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.816+0000 7fa994c00640 1 -- 172.21.15.100:0/306681136 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99000ce60 con 0x7fa99815a0e0 2024-08-17T02:45:38.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.816+0000 7fa994c00640 1 -- 172.21.15.100:0/306681136 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa990004d30 con 0x7fa99815a0e0 2024-08-17T02:45:38.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.816+0000 7fa994c00640 1 -- 172.21.15.100:0/306681136 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990004ea0 con 0x7fa99815a0e0 2024-08-17T02:45:38.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.816+0000 7fa99e400640 1 -- 172.21.15.100:0/306681136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa998158be0 con 0x7fa99815a0e0 2024-08-17T02:45:38.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.816+0000 7fa99e400640 1 -- 172.21.15.100:0/306681136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99813a960 con 0x7fa99815a0e0 2024-08-17T02:45:38.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.817+0000 7fa99e400640 1 -- 172.21.15.100:0/306681136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa998071050 con 0x7fa99815a0e0 2024-08-17T02:45:38.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.818+0000 7fa994c00640 1 -- 172.21.15.100:0/306681136 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7fa990007150 con 0x7fa99815a0e0 2024-08-17T02:45:38.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.819+0000 7fa994c00640 1 --2- 172.21.15.100:0/306681136 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa9740650c0 0x7fa974067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:38.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.819+0000 7fa994c00640 1 -- 172.21.15.100:0/306681136 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa990081d60 con 0x7fa99815a0e0 2024-08-17T02:45:38.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.819+0000 7fa99d000640 1 --2- 172.21.15.100:0/306681136 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa9740650c0 0x7fa974067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:38.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.820+0000 7fa99d000640 1 --2- 172.21.15.100:0/306681136 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa9740650c0 0x7fa974067570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa988034000 tx=0x7fa988032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:38.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.824+0000 7fa994c00640 1 -- 172.21.15.100:0/306681136 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa99004ce40 con 0x7fa99815a0e0 2024-08-17T02:45:38.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:38.997+0000 7fa99e400640 1 -- 172.21.15.100:0/306681136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa9980ad9a0 con 0x7fa99815a0e0 2024-08-17T02:45:39.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:39.826+0000 7fa994c00640 1 -- 172.21.15.100:0/306681136 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa990050620 con 0x7fa99815a0e0 2024-08-17T02:45:39.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:39.827+0000 7fa994c00640 1 -- 172.21.15.100:0/306681136 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa99004c0d0 con 0x7fa99815a0e0 2024-08-17T02:45:39.829 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2024-08-17T02:45:39.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:39.831+0000 7fa99e400640 1 -- 172.21.15.100:0/306681136 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa9740650c0 msgr2=0x7fa974067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:39.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:39.831+0000 7fa99e400640 1 --2- 172.21.15.100:0/306681136 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa9740650c0 0x7fa974067570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa988034000 tx=0x7fa988032000 comp rx=0 tx=0).stop 2024-08-17T02:45:39.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:39.831+0000 7fa99e400640 1 -- 172.21.15.100:0/306681136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa99815a0e0 msgr2=0x7fa99806a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:39.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:39.831+0000 7fa99e400640 1 --2- 172.21.15.100:0/306681136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa99815a0e0 0x7fa99806a180 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa99000cd00 tx=0x7fa990007e20 comp rx=0 tx=0).stop 2024-08-17T02:45:39.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:39.831+0000 7fa99e400640 1 -- 172.21.15.100:0/306681136 shutdown_connections 2024-08-17T02:45:39.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:39.831+0000 7fa99e400640 1 --2- 172.21.15.100:0/306681136 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa9740650c0 0x7fa974067570 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:39.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:39.831+0000 7fa99e400640 1 --2- 172.21.15.100:0/306681136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa99815a0e0 0x7fa99806a180 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:39.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:39.831+0000 7fa99e400640 1 --2- 172.21.15.100:0/306681136 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa9980ab010 0x7fa998069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:39.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:39.831+0000 7fa99e400640 1 --2- 172.21.15.100:0/306681136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa99806df00 0x7fa99813b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:39.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:39.831+0000 7fa99e400640 1 -- 172.21.15.100:0/306681136 >> 172.21.15.100:0/306681136 conn(0x7fa998067750 msgr2=0x7fa998068590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:39.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:39.831+0000 7fa99e400640 1 -- 172.21.15.100:0/306681136 shutdown_connections 2024-08-17T02:45:39.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:39.833+0000 7fa99e400640 1 -- 172.21.15.100:0/306681136 wait complete. 2024-08-17T02:45:39.852 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:45:40.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.005+0000 7f4c74e00640 1 Processor -- start 2024-08-17T02:45:40.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.005+0000 7f4c74e00640 1 -- start start 2024-08-17T02:45:40.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.006+0000 7f4c74e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4c70152d80 0x7f4c701561c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:40.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.006+0000 7f4c74e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c700cb040 0x7f4c700aca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:40.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.006+0000 7f4c74e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4c700acfa0 0x7f4c70158d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:40.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.006+0000 7f4c74e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c70156910 con 0x7f4c700acfa0 2024-08-17T02:45:40.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.006+0000 7f4c74e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c700ad3e0 con 0x7f4c70152d80 2024-08-17T02:45:40.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.006+0000 7f4c74e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c70153150 con 0x7f4c700cb040 2024-08-17T02:45:40.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.006+0000 7f4c6e800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4c700acfa0 0x7f4c70158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:40.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.006+0000 7f4c6e800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4c700acfa0 0x7f4c70158d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40346/0 (socket says 172.21.15.100:40346) 2024-08-17T02:45:40.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.006+0000 7f4c6e800640 1 -- 172.21.15.100:0/626395136 learned_addr learned my addr 172.21.15.100:0/626395136 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:40.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.007+0000 7f4c6de00640 1 --2- 172.21.15.100:0/626395136 >> v2:172.21.15.123:3300/0 conn(0x7f4c70152d80 0x7f4c701561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:40.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.007+0000 7f4c6d400640 1 --2- 172.21.15.100:0/626395136 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c700cb040 0x7f4c700aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:40.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.007+0000 7f4c6e800640 1 -- 172.21.15.100:0/626395136 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c700cb040 msgr2=0x7f4c700aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:40.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.007+0000 7f4c6e800640 1 --2- 172.21.15.100:0/626395136 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c700cb040 0x7f4c700aca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:40.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.007+0000 7f4c6e800640 1 -- 172.21.15.100:0/626395136 >> v2:172.21.15.123:3300/0 conn(0x7f4c70152d80 msgr2=0x7f4c701561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:40.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.007+0000 7f4c6e800640 1 --2- 172.21.15.100:0/626395136 >> v2:172.21.15.123:3300/0 conn(0x7f4c70152d80 0x7f4c701561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:40.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.007+0000 7f4c6e800640 1 -- 172.21.15.100:0/626395136 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c70156b60 con 0x7f4c700acfa0 2024-08-17T02:45:40.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.007+0000 7f4c6de00640 1 --2- 172.21.15.100:0/626395136 >> v2:172.21.15.123:3300/0 conn(0x7f4c70152d80 0x7f4c701561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:40.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.008+0000 7f4c6e800640 1 --2- 172.21.15.100:0/626395136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700acfa0 0x7f4c70158d40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4c7006c5c0 tx=0x7f4c68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c26e5296aaddd9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:40.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.008+0000 7f4c6ca00640 1 -- 172.21.15.100:0/626395136 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c68031400 con 0x7f4c700acfa0 2024-08-17T02:45:40.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.008+0000 7f4c6ca00640 1 -- 172.21.15.100:0/626395136 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6802d050 con 0x7f4c700acfa0 2024-08-17T02:45:40.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.008+0000 7f4c6ca00640 1 -- 172.21.15.100:0/626395136 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c680317d0 con 0x7f4c700acfa0 2024-08-17T02:45:40.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.008+0000 7f4c74e00640 1 -- 172.21.15.100:0/626395136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700acfa0 msgr2=0x7f4c70158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:40.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.008+0000 7f4c74e00640 1 --2- 172.21.15.100:0/626395136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700acfa0 0x7f4c70158d40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4c7006c5c0 tx=0x7f4c68009840 comp rx=0 tx=0).stop 2024-08-17T02:45:40.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.009+0000 7f4c74e00640 1 -- 172.21.15.100:0/626395136 shutdown_connections 2024-08-17T02:45:40.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.009+0000 7f4c74e00640 1 --2- 172.21.15.100:0/626395136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700acfa0 0x7f4c70158d40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:40.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.009+0000 7f4c74e00640 1 --2- 172.21.15.100:0/626395136 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c700cb040 0x7f4c700aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:40.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.009+0000 7f4c74e00640 1 --2- 172.21.15.100:0/626395136 >> v2:172.21.15.123:3300/0 conn(0x7f4c70152d80 0x7f4c701561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:40.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.009+0000 7f4c74e00640 1 -- 172.21.15.100:0/626395136 >> 172.21.15.100:0/626395136 conn(0x7f4c70067750 msgr2=0x7f4c7006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:40.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.009+0000 7f4c74e00640 1 -- 172.21.15.100:0/626395136 shutdown_connections 2024-08-17T02:45:40.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.009+0000 7f4c74e00640 1 -- 172.21.15.100:0/626395136 wait complete. 2024-08-17T02:45:40.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.010+0000 7f4c74e00640 1 Processor -- start 2024-08-17T02:45:40.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.010+0000 7f4c74e00640 1 -- start start 2024-08-17T02:45:40.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.011+0000 7f4c74e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700acfa0 0x7f4c7014bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:40.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.011+0000 7f4c74e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c700cb040 0x7f4c7006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:40.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.011+0000 7f4c74e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c70152d80 0x7f4c70150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:40.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.011+0000 7f4c74e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c700ab6a0 con 0x7f4c700acfa0 2024-08-17T02:45:40.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.011+0000 7f4c74e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c700aab00 con 0x7f4c70152d80 2024-08-17T02:45:40.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.011+0000 7f4c74e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7014c520 con 0x7f4c700cb040 2024-08-17T02:45:40.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.011+0000 7f4c6de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700acfa0 0x7f4c7014bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:40.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.011+0000 7f4c6de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700acfa0 0x7f4c7014bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40358/0 (socket says 172.21.15.100:40358) 2024-08-17T02:45:40.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.011+0000 7f4c6de00640 1 -- 172.21.15.100:0/1580145245 learned_addr learned my addr 172.21.15.100:0/1580145245 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:40.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.011+0000 7f4c6d400640 1 --2- 172.21.15.100:0/1580145245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c700cb040 0x7f4c7006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:40.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.011+0000 7f4c6e800640 1 --2- 172.21.15.100:0/1580145245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c70152d80 0x7f4c70150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:40.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.012+0000 7f4c6de00640 1 -- 172.21.15.100:0/1580145245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c700cb040 msgr2=0x7f4c7006d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:40.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.012+0000 7f4c6de00640 1 --2- 172.21.15.100:0/1580145245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c700cb040 0x7f4c7006d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:40.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.012+0000 7f4c6de00640 1 -- 172.21.15.100:0/1580145245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c70152d80 msgr2=0x7f4c70150550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:40.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.012+0000 7f4c6de00640 1 --2- 172.21.15.100:0/1580145245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c70152d80 0x7f4c70150550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:40.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.012+0000 7f4c6de00640 1 -- 172.21.15.100:0/1580145245 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c68009ae0 con 0x7f4c700acfa0 2024-08-17T02:45:40.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.012+0000 7f4c6de00640 1 --2- 172.21.15.100:0/1580145245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700acfa0 0x7f4c7014bfe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000d8c0 tx=0x7f4c60008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:40.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.012+0000 7f4c65600640 1 -- 172.21.15.100:0/1580145245 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000deb0 con 0x7f4c700acfa0 2024-08-17T02:45:40.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.012+0000 7f4c65600640 1 -- 172.21.15.100:0/1580145245 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6000b8d0 con 0x7f4c700acfa0 2024-08-17T02:45:40.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.012+0000 7f4c65600640 1 -- 172.21.15.100:0/1580145245 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000bc90 con 0x7f4c700acfa0 2024-08-17T02:45:40.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.012+0000 7f4c74e00640 1 -- 172.21.15.100:0/1580145245 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c700abb30 con 0x7f4c700acfa0 2024-08-17T02:45:40.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.012+0000 7f4c74e00640 1 -- 172.21.15.100:0/1580145245 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c700ab050 con 0x7f4c700acfa0 2024-08-17T02:45:40.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.014+0000 7f4c74e00640 1 -- 172.21.15.100:0/1580145245 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7016a5b0 con 0x7f4c700acfa0 2024-08-17T02:45:40.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.014+0000 7f4c65600640 1 -- 172.21.15.100:0/1580145245 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4c6001e460 con 0x7f4c700acfa0 2024-08-17T02:45:40.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.015+0000 7f4c65600640 1 --2- 172.21.15.100:0/1580145245 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4c50065180 0x7f4c50067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:40.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.015+0000 7f4c65600640 1 -- 172.21.15.100:0/1580145245 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f4c60082830 con 0x7f4c700acfa0 2024-08-17T02:45:40.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.015+0000 7f4c6d400640 1 --2- 172.21.15.100:0/1580145245 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4c50065180 0x7f4c50067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:40.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.016+0000 7f4c6d400640 1 --2- 172.21.15.100:0/1580145245 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4c50065180 0x7f4c50067630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4c7006d4a0 tx=0x7f4c5c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:40.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.020+0000 7f4c65600640 1 -- 172.21.15.100:0/1580145245 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4c60054570 con 0x7f4c700acfa0 2024-08-17T02:45:40.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.193+0000 7f4c74e00640 1 -- 172.21.15.100:0/1580145245 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4c700710c0 con 0x7f4c700acfa0 2024-08-17T02:45:40.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.826+0000 7f4c65600640 1 -- 172.21.15.100:0/1580145245 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4c60054100 con 0x7f4c700acfa0 2024-08-17T02:45:40.829 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2024-08-17T02:45:40.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.831+0000 7f4c74e00640 1 -- 172.21.15.100:0/1580145245 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4c50065180 msgr2=0x7f4c50067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:40.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.831+0000 7f4c74e00640 1 --2- 172.21.15.100:0/1580145245 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4c50065180 0x7f4c50067630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4c7006d4a0 tx=0x7f4c5c008040 comp rx=0 tx=0).stop 2024-08-17T02:45:40.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.831+0000 7f4c74e00640 1 -- 172.21.15.100:0/1580145245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700acfa0 msgr2=0x7f4c7014bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:40.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.831+0000 7f4c74e00640 1 --2- 172.21.15.100:0/1580145245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700acfa0 0x7f4c7014bfe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000d8c0 tx=0x7f4c60008040 comp rx=0 tx=0).stop 2024-08-17T02:45:40.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.832+0000 7f4c74e00640 1 -- 172.21.15.100:0/1580145245 shutdown_connections 2024-08-17T02:45:40.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.832+0000 7f4c74e00640 1 --2- 172.21.15.100:0/1580145245 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4c50065180 0x7f4c50067630 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:40.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.832+0000 7f4c74e00640 1 --2- 172.21.15.100:0/1580145245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c70152d80 0x7f4c70150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:40.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.832+0000 7f4c74e00640 1 --2- 172.21.15.100:0/1580145245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c700cb040 0x7f4c7006d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:40.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.832+0000 7f4c74e00640 1 --2- 172.21.15.100:0/1580145245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700acfa0 0x7f4c7014bfe0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:40.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.832+0000 7f4c74e00640 1 -- 172.21.15.100:0/1580145245 >> 172.21.15.100:0/1580145245 conn(0x7f4c70067750 msgr2=0x7f4c700c8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:40.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.832+0000 7f4c74e00640 1 -- 172.21.15.100:0/1580145245 shutdown_connections 2024-08-17T02:45:40.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:40.832+0000 7f4c74e00640 1 -- 172.21.15.100:0/1580145245 wait complete. 2024-08-17T02:45:40.860 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:45:41.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.011+0000 7f6f2f000640 1 Processor -- start 2024-08-17T02:45:41.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.011+0000 7f6f2f000640 1 -- start start 2024-08-17T02:45:41.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.011+0000 7f6f2f000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6f28069e30 0x7f6f280c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:41.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.011+0000 7f6f2f000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2806d470 con 0x7f6f28069a60 2024-08-17T02:45:41.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.011+0000 7f6f2f000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f280aec60 con 0x7f6f28155550 2024-08-17T02:45:41.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.011+0000 7f6f2f000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f2806a230 con 0x7f6f28069e30 2024-08-17T02:45:41.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.011+0000 7f6f27e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6f28069a60 0x7f6f28154e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44908/0 (socket says 172.21.15.100:44908) 2024-08-17T02:45:41.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.011+0000 7f6f27e00640 1 -- 172.21.15.100:0/563050119 learned_addr learned my addr 172.21.15.100:0/563050119 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:41.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.011+0000 7f6f2d000640 1 --2- 172.21.15.100:0/563050119 >> v2:172.21.15.100:3300/0 conn(0x7f6f28069e30 0x7f6f280c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:41.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.012+0000 7f6f27400640 1 -- 172.21.15.100:0/563050119 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358996308 0 0) 0x7f6f2806d470 con 0x7f6f28069a60 2024-08-17T02:45:41.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.012+0000 7f6f27400640 1 -- 172.21.15.100:0/563050119 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f0c0034e0 con 0x7f6f28069a60 2024-08-17T02:45:41.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.012+0000 7f6f2d000640 1 -- 172.21.15.100:0/563050119 >> v1:172.21.15.123:6789/0 conn(0x7f6f28155550 legacy=0x7f6f2806d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:41.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.012+0000 7f6f2d000640 1 -- 172.21.15.100:0/563050119 >> v1:172.21.15.100:6789/0 conn(0x7f6f28069a60 legacy=0x7f6f28154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:41.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.012+0000 7f6f2d000640 1 -- 172.21.15.100:0/563050119 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2806c860 con 0x7f6f28069e30 2024-08-17T02:45:41.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.013+0000 7f6f2d000640 1 --2- 172.21.15.100:0/563050119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f28069e30 0x7f6f280c7e50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6f20009850 tx=0x7f6f200090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e91ee336336a7e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:41.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.013+0000 7f6f27400640 1 -- 172.21.15.100:0/563050119 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2002ae20 con 0x7f6f28069e30 2024-08-17T02:45:41.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.013+0000 7f6f27400640 1 -- 172.21.15.100:0/563050119 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f20032440 con 0x7f6f28069e30 2024-08-17T02:45:41.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.013+0000 7f6f27400640 1 -- 172.21.15.100:0/563050119 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f200327e0 con 0x7f6f28069e30 2024-08-17T02:45:41.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.014+0000 7f6f2f000640 1 -- 172.21.15.100:0/563050119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f28069e30 msgr2=0x7f6f280c7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:41.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.014+0000 7f6f2f000640 1 --2- 172.21.15.100:0/563050119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f28069e30 0x7f6f280c7e50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6f20009850 tx=0x7f6f200090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:41.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.014+0000 7f6f2f000640 1 -- 172.21.15.100:0/563050119 shutdown_connections 2024-08-17T02:45:41.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.014+0000 7f6f2f000640 1 --2- 172.21.15.100:0/563050119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f28069e30 0x7f6f280c7e50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:41.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.014+0000 7f6f2f000640 1 -- 172.21.15.100:0/563050119 >> 172.21.15.100:0/563050119 conn(0x7f6f28067750 msgr2=0x7f6f280c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:41.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.014+0000 7f6f2f000640 1 -- 172.21.15.100:0/563050119 shutdown_connections 2024-08-17T02:45:41.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.014+0000 7f6f2f000640 1 -- 172.21.15.100:0/563050119 wait complete. 2024-08-17T02:45:41.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.015+0000 7f6f2f000640 1 Processor -- start 2024-08-17T02:45:41.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.015+0000 7f6f2f000640 1 -- start start 2024-08-17T02:45:41.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.016+0000 7f6f2f000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f28069a60 0x7f6f281699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:41.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.016+0000 7f6f2f000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6f28069e30 0x7f6f280a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:41.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.016+0000 7f6f2f000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f28155550 0x7f6f280aa050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:41.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.016+0000 7f6f2f000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f280aa6d0 con 0x7f6f28155550 2024-08-17T02:45:41.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.016+0000 7f6f2f000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f280aa9b0 con 0x7f6f28069a60 2024-08-17T02:45:41.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.016+0000 7f6f2f000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f280aac90 con 0x7f6f28069e30 2024-08-17T02:45:41.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.016+0000 7f6f2d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f28155550 0x7f6f280aa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:41.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.016+0000 7f6f2d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f28155550 0x7f6f280aa050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40364/0 (socket says 172.21.15.100:40364) 2024-08-17T02:45:41.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.016+0000 7f6f2d000640 1 -- 172.21.15.100:0/2073356401 learned_addr learned my addr 172.21.15.100:0/2073356401 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:41.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.017+0000 7f6f27e00640 1 --2- 172.21.15.100:0/2073356401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f28069a60 0x7f6f281699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:41.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.017+0000 7f6f1f400640 1 --2- 172.21.15.100:0/2073356401 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6f28069e30 0x7f6f280a9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:41.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.017+0000 7f6f2d000640 1 -- 172.21.15.100:0/2073356401 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6f28069e30 msgr2=0x7f6f280a9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:41.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.017+0000 7f6f2d000640 1 --2- 172.21.15.100:0/2073356401 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6f28069e30 0x7f6f280a9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:41.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.017+0000 7f6f2d000640 1 -- 172.21.15.100:0/2073356401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f28069a60 msgr2=0x7f6f281699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:41.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.017+0000 7f6f2d000640 1 --2- 172.21.15.100:0/2073356401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f28069a60 0x7f6f281699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:41.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.017+0000 7f6f2d000640 1 -- 172.21.15.100:0/2073356401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f20009390 con 0x7f6f28155550 2024-08-17T02:45:41.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.017+0000 7f6f27e00640 1 --2- 172.21.15.100:0/2073356401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f28069a60 0x7f6f281699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:41.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.017+0000 7f6f2d000640 1 --2- 172.21.15.100:0/2073356401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f28155550 0x7f6f280aa050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6f20009850 tx=0x7f6f20032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:41.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.017+0000 7f6f1fe00640 1 -- 172.21.15.100:0/2073356401 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2003d420 con 0x7f6f28155550 2024-08-17T02:45:41.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.018+0000 7f6f1fe00640 1 -- 172.21.15.100:0/2073356401 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2003d580 con 0x7f6f28155550 2024-08-17T02:45:41.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.018+0000 7f6f2f000640 1 -- 172.21.15.100:0/2073356401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f280aaf70 con 0x7f6f28155550 2024-08-17T02:45:41.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.018+0000 7f6f1fe00640 1 -- 172.21.15.100:0/2073356401 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2003d920 con 0x7f6f28155550 2024-08-17T02:45:41.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.018+0000 7f6f2f000640 1 -- 172.21.15.100:0/2073356401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f28168de0 con 0x7f6f28155550 2024-08-17T02:45:41.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.019+0000 7f6f2f000640 1 -- 172.21.15.100:0/2073356401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f280ab3f0 con 0x7f6f28155550 2024-08-17T02:45:41.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.020+0000 7f6f1fe00640 1 -- 172.21.15.100:0/2073356401 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6f2003dd50 con 0x7f6f28155550 2024-08-17T02:45:41.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.020+0000 7f6f1fe00640 1 --2- 172.21.15.100:0/2073356401 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6f04065150 0x7f6f04067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:41.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.020+0000 7f6f1fe00640 1 -- 172.21.15.100:0/2073356401 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f6f200a2b40 con 0x7f6f28155550 2024-08-17T02:45:41.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.021+0000 7f6f27e00640 1 --2- 172.21.15.100:0/2073356401 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6f04065150 0x7f6f04067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:41.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.021+0000 7f6f27e00640 1 --2- 172.21.15.100:0/2073356401 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6f04065150 0x7f6f04067600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f18005bc0 tx=0x7f6f18009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:41.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.025+0000 7f6f1fe00640 1 -- 172.21.15.100:0/2073356401 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6f20070c70 con 0x7f6f28155550 2024-08-17T02:45:41.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.234+0000 7f6f2f000640 1 -- 172.21.15.100:0/2073356401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6f28071050 con 0x7f6f28155550 2024-08-17T02:45:41.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.849+0000 7f6f1fe00640 1 -- 172.21.15.100:0/2073356401 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6f20074290 con 0x7f6f28155550 2024-08-17T02:45:41.851 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 2 and data pool 3 2024-08-17T02:45:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.853+0000 7f6f2f000640 1 -- 172.21.15.100:0/2073356401 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6f04065150 msgr2=0x7f6f04067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.853+0000 7f6f2f000640 1 --2- 172.21.15.100:0/2073356401 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6f04065150 0x7f6f04067600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f18005bc0 tx=0x7f6f18009040 comp rx=0 tx=0).stop 2024-08-17T02:45:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.853+0000 7f6f2f000640 1 -- 172.21.15.100:0/2073356401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f28155550 msgr2=0x7f6f280aa050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.853+0000 7f6f2f000640 1 --2- 172.21.15.100:0/2073356401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f28155550 0x7f6f280aa050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6f20009850 tx=0x7f6f20032000 comp rx=0 tx=0).stop 2024-08-17T02:45:41.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.853+0000 7f6f2f000640 1 -- 172.21.15.100:0/2073356401 shutdown_connections 2024-08-17T02:45:41.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.853+0000 7f6f2f000640 1 --2- 172.21.15.100:0/2073356401 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6f04065150 0x7f6f04067600 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:41.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.854+0000 7f6f2f000640 1 --2- 172.21.15.100:0/2073356401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f28155550 0x7f6f280aa050 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:41.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.854+0000 7f6f2f000640 1 --2- 172.21.15.100:0/2073356401 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6f28069e30 0x7f6f280a9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:41.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.854+0000 7f6f2f000640 1 --2- 172.21.15.100:0/2073356401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f28069a60 0x7f6f281699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:41.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.854+0000 7f6f2f000640 1 -- 172.21.15.100:0/2073356401 >> 172.21.15.100:0/2073356401 conn(0x7f6f28067750 msgr2=0x7f6f280ab7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:41.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.854+0000 7f6f2f000640 1 -- 172.21.15.100:0/2073356401 shutdown_connections 2024-08-17T02:45:41.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:41.854+0000 7f6f2f000640 1 -- 172.21.15.100:0/2073356401 wait complete. 2024-08-17T02:45:41.885 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:45:42.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.031+0000 7f1713e00640 1 Processor -- start 2024-08-17T02:45:42.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.031+0000 7f1713e00640 1 -- start start 2024-08-17T02:45:42.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.033+0000 7f1713e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1714155900 0x7f1714155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:42.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.033+0000 7f1713e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f17140b0270 0x7f1714156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:42.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.033+0000 7f1713e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1714157b20 0x7f1714157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:42.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.033+0000 7f1713e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1714157690 con 0x7f1714155900 2024-08-17T02:45:42.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.033+0000 7f1713e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1714156a80 con 0x7f1714157b20 2024-08-17T02:45:42.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.033+0000 7f1713e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1714156d60 con 0x7f17140b0270 2024-08-17T02:45:42.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.033+0000 7f1712a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1714155900 0x7f1714155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:42.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.033+0000 7f1712a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1714155900 0x7f1714155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40376/0 (socket says 172.21.15.100:40376) 2024-08-17T02:45:42.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.033+0000 7f1712a00640 1 -- 172.21.15.100:0/3562720954 learned_addr learned my addr 172.21.15.100:0/3562720954 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:42.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.033+0000 7f1712a00640 1 -- 172.21.15.100:0/3562720954 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f17140b0270 msgr2=0x7f1714156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:42.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.033+0000 7f1712000640 1 --2- 172.21.15.100:0/3562720954 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f17140b0270 0x7f1714156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:42.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.033+0000 7f1713400640 1 --2- 172.21.15.100:0/3562720954 >> v2:172.21.15.123:3300/0 conn(0x7f1714157b20 0x7f1714157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:42.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.033+0000 7f1712a00640 1 --2- 172.21.15.100:0/3562720954 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f17140b0270 0x7f1714156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.033+0000 7f1712a00640 1 -- 172.21.15.100:0/3562720954 >> v2:172.21.15.123:3300/0 conn(0x7f1714157b20 msgr2=0x7f1714157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:42.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.033+0000 7f1712a00640 1 --2- 172.21.15.100:0/3562720954 >> v2:172.21.15.123:3300/0 conn(0x7f1714157b20 0x7f1714157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.033+0000 7f1712a00640 1 -- 172.21.15.100:0/3562720954 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1714157040 con 0x7f1714155900 2024-08-17T02:45:42.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.033+0000 7f1712000640 1 --2- 172.21.15.100:0/3562720954 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f17140b0270 0x7f1714156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:45:42.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.033+0000 7f1713400640 1 --2- 172.21.15.100:0/3562720954 >> v2:172.21.15.123:3300/0 conn(0x7f1714157b20 0x7f1714157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:45:42.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.034+0000 7f1712a00640 1 --2- 172.21.15.100:0/3562720954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1714155900 0x7f1714155cd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f17140cc860 tx=0x7f17040091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d259c368bcf5a64 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:42.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.034+0000 7f1711600640 1 -- 172.21.15.100:0/3562720954 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170402ad20 con 0x7f1714155900 2024-08-17T02:45:42.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.035+0000 7f1711600640 1 -- 172.21.15.100:0/3562720954 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170402ae80 con 0x7f1714155900 2024-08-17T02:45:42.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.035+0000 7f1711600640 1 -- 172.21.15.100:0/3562720954 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1704032670 con 0x7f1714155900 2024-08-17T02:45:42.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.035+0000 7f1713e00640 1 -- 172.21.15.100:0/3562720954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1714155900 msgr2=0x7f1714155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:42.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.035+0000 7f1713e00640 1 --2- 172.21.15.100:0/3562720954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1714155900 0x7f1714155cd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f17140cc860 tx=0x7f17040091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.035+0000 7f1713e00640 1 -- 172.21.15.100:0/3562720954 shutdown_connections 2024-08-17T02:45:42.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.035+0000 7f1713e00640 1 --2- 172.21.15.100:0/3562720954 >> v2:172.21.15.123:3300/0 conn(0x7f1714157b20 0x7f1714157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.035+0000 7f1713e00640 1 --2- 172.21.15.100:0/3562720954 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f17140b0270 0x7f1714156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.035+0000 7f1713e00640 1 --2- 172.21.15.100:0/3562720954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1714155900 0x7f1714155cd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.035+0000 7f1713e00640 1 -- 172.21.15.100:0/3562720954 >> 172.21.15.100:0/3562720954 conn(0x7f1714067750 msgr2=0x7f17140cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:42.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.035+0000 7f1713e00640 1 -- 172.21.15.100:0/3562720954 shutdown_connections 2024-08-17T02:45:42.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.035+0000 7f1713e00640 1 -- 172.21.15.100:0/3562720954 wait complete. 2024-08-17T02:45:42.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.036+0000 7f1713e00640 1 Processor -- start 2024-08-17T02:45:42.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.037+0000 7f1713e00640 1 -- start start 2024-08-17T02:45:42.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.037+0000 7f1713e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17140b0270 0x7f171413e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:42.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.037+0000 7f1713e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1714155900 0x7f171413ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:42.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.037+0000 7f1713e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1714157b20 0x7f17141520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:42.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.037+0000 7f1713e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1714142af0 con 0x7f1714157b20 2024-08-17T02:45:42.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.037+0000 7f1713e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171413f850 con 0x7f17140b0270 2024-08-17T02:45:42.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.037+0000 7f1713e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17141424a0 con 0x7f1714155900 2024-08-17T02:45:42.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.038+0000 7f1713400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1714157b20 0x7f17141520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:42.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.038+0000 7f1713400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1714157b20 0x7f17141520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40392/0 (socket says 172.21.15.100:40392) 2024-08-17T02:45:42.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.038+0000 7f1712a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17140b0270 0x7f171413e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:42.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.038+0000 7f1713400640 1 -- 172.21.15.100:0/2300707020 learned_addr learned my addr 172.21.15.100:0/2300707020 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:42.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.038+0000 7f1712000640 1 --2- 172.21.15.100:0/2300707020 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1714155900 0x7f171413ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:42.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.038+0000 7f1713400640 1 -- 172.21.15.100:0/2300707020 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1714155900 msgr2=0x7f171413ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:42.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.038+0000 7f1713400640 1 --2- 172.21.15.100:0/2300707020 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1714155900 0x7f171413ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.038+0000 7f1713400640 1 -- 172.21.15.100:0/2300707020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17140b0270 msgr2=0x7f171413e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:42.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.038+0000 7f1713400640 1 --2- 172.21.15.100:0/2300707020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17140b0270 0x7f171413e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.038+0000 7f1713400640 1 -- 172.21.15.100:0/2300707020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1704009450 con 0x7f1714157b20 2024-08-17T02:45:42.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.038+0000 7f1713400640 1 --2- 172.21.15.100:0/2300707020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1714157b20 0x7f17141520d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f170c00cef0 tx=0x7f170c007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:42.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.039+0000 7f170a000640 1 -- 172.21.15.100:0/2300707020 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c016420 con 0x7f1714157b20 2024-08-17T02:45:42.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.039+0000 7f170a000640 1 -- 172.21.15.100:0/2300707020 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170c0165a0 con 0x7f1714157b20 2024-08-17T02:45:42.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.039+0000 7f170a000640 1 -- 172.21.15.100:0/2300707020 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c016960 con 0x7f1714157b20 2024-08-17T02:45:42.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.039+0000 7f1713e00640 1 -- 172.21.15.100:0/2300707020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1714142780 con 0x7f1714157b20 2024-08-17T02:45:42.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.039+0000 7f1713e00640 1 -- 172.21.15.100:0/2300707020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1714142020 con 0x7f1714157b20 2024-08-17T02:45:42.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.040+0000 7f1713e00640 1 -- 172.21.15.100:0/2300707020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1714142ca0 con 0x7f1714157b20 2024-08-17T02:45:42.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.040+0000 7f170a000640 1 -- 172.21.15.100:0/2300707020 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f170c00e3f0 con 0x7f1714157b20 2024-08-17T02:45:42.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.041+0000 7f170a000640 1 --2- 172.21.15.100:0/2300707020 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f16f4065150 0x7f16f4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:42.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.041+0000 7f170a000640 1 -- 172.21.15.100:0/2300707020 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f170c012070 con 0x7f1714157b20 2024-08-17T02:45:42.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.041+0000 7f1712a00640 1 --2- 172.21.15.100:0/2300707020 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f16f4065150 0x7f16f4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:42.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.042+0000 7f1712a00640 1 --2- 172.21.15.100:0/2300707020 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f16f4065150 0x7f16f4067600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1704034000 tx=0x7f1704032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:42.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.046+0000 7f170a000640 1 -- 172.21.15.100:0/2300707020 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f170c04ee40 con 0x7f1714157b20 2024-08-17T02:45:42.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.220+0000 7f1713e00640 1 -- 172.21.15.100:0/2300707020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1714071050 con 0x7f1714157b20 2024-08-17T02:45:42.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.221+0000 7f170a000640 1 -- 172.21.15.100:0/2300707020 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f1714142ca0 con 0x7f1714157b20 2024-08-17T02:45:42.222 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:42.222 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":21,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:41.236635+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:45:39.036964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:45:40.232954+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:45:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.223+0000 7f1713e00640 1 -- 172.21.15.100:0/2300707020 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f16f4065150 msgr2=0x7f16f4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.223+0000 7f1713e00640 1 --2- 172.21.15.100:0/2300707020 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f16f4065150 0x7f16f4067600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1704034000 tx=0x7f1704032000 comp rx=0 tx=0).stop 2024-08-17T02:45:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.223+0000 7f1713e00640 1 -- 172.21.15.100:0/2300707020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1714157b20 msgr2=0x7f17141520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.223+0000 7f1713e00640 1 --2- 172.21.15.100:0/2300707020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1714157b20 0x7f17141520d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f170c00cef0 tx=0x7f170c007860 comp rx=0 tx=0).stop 2024-08-17T02:45:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.223+0000 7f1713e00640 1 -- 172.21.15.100:0/2300707020 shutdown_connections 2024-08-17T02:45:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.223+0000 7f1713e00640 1 --2- 172.21.15.100:0/2300707020 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f16f4065150 0x7f16f4067600 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.223+0000 7f1713e00640 1 --2- 172.21.15.100:0/2300707020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1714157b20 0x7f17141520d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.223+0000 7f1713e00640 1 --2- 172.21.15.100:0/2300707020 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1714155900 0x7f171413ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.223+0000 7f1713e00640 1 --2- 172.21.15.100:0/2300707020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17140b0270 0x7f171413e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.223+0000 7f1713e00640 1 -- 172.21.15.100:0/2300707020 >> 172.21.15.100:0/2300707020 conn(0x7f1714067750 msgr2=0x7f171406dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.223+0000 7f1713e00640 1 -- 172.21.15.100:0/2300707020 shutdown_connections 2024-08-17T02:45:42.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.223+0000 7f1713e00640 1 -- 172.21.15.100:0/2300707020 wait complete. 2024-08-17T02:45:42.238 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:45:42.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.386+0000 7f3660e00640 1 Processor -- start 2024-08-17T02:45:42.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.386+0000 7f3660e00640 1 -- start start 2024-08-17T02:45:42.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.387+0000 7f3660e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f365c069710 0x7f365c0ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:42.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.387+0000 7f3660e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f365c0ac540 0x7f365c0af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:42.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.387+0000 7f3660e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365c0aec20 con 0x7f365c158bd0 2024-08-17T02:45:42.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.387+0000 7f3660e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365c0ae330 con 0x7f365c0ac540 2024-08-17T02:45:42.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.387+0000 7f3660e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0acd30 con 0x7f365c069710 2024-08-17T02:45:42.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.387+0000 7f365be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f365c0ac540 0x7f365c0af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:42.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.387+0000 7f365be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f365c0ac540 0x7f365c0af0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40396/0 (socket says 172.21.15.100:40396) 2024-08-17T02:45:42.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.387+0000 7f365be00640 1 -- 172.21.15.100:0/421240577 learned_addr learned my addr 172.21.15.100:0/421240577 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:42.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.387+0000 7f365be00640 1 -- 172.21.15.100:0/421240577 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f365c069710 msgr2=0x7f365c0ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:42.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.387+0000 7f365be00640 1 --2- 172.21.15.100:0/421240577 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f365c069710 0x7f365c0ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.387+0000 7f365be00640 1 -- 172.21.15.100:0/421240577 >> v1:172.21.15.123:6789/0 conn(0x7f365c158bd0 legacy=0x7f365c069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:42.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.388+0000 7f365be00640 1 -- 172.21.15.100:0/421240577 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c0ae5d0 con 0x7f365c0ac540 2024-08-17T02:45:42.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.388+0000 7f365be00640 1 --2- 172.21.15.100:0/421240577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f365c0ac540 0x7f365c0af0b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3654009f20 tx=0x7f3654009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde87f859e79e2d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:42.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.389+0000 7f365aa00640 1 -- 172.21.15.100:0/421240577 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3654031400 con 0x7f365c0ac540 2024-08-17T02:45:42.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.389+0000 7f365aa00640 1 -- 172.21.15.100:0/421240577 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365402d050 con 0x7f365c0ac540 2024-08-17T02:45:42.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.389+0000 7f365aa00640 1 -- 172.21.15.100:0/421240577 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36540317d0 con 0x7f365c0ac540 2024-08-17T02:45:42.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.389+0000 7f3660e00640 1 -- 172.21.15.100:0/421240577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f365c0ac540 msgr2=0x7f365c0af0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:42.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.389+0000 7f3660e00640 1 --2- 172.21.15.100:0/421240577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f365c0ac540 0x7f365c0af0b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3654009f20 tx=0x7f3654009840 comp rx=0 tx=0).stop 2024-08-17T02:45:42.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.389+0000 7f3660e00640 1 -- 172.21.15.100:0/421240577 shutdown_connections 2024-08-17T02:45:42.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.389+0000 7f3660e00640 1 --2- 172.21.15.100:0/421240577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f365c0ac540 0x7f365c0af0b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.389+0000 7f3660e00640 1 --2- 172.21.15.100:0/421240577 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f365c069710 0x7f365c0ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.389+0000 7f3660e00640 1 -- 172.21.15.100:0/421240577 >> 172.21.15.100:0/421240577 conn(0x7f365c096a70 msgr2=0x7f365c0cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:42.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.389+0000 7f3660e00640 1 -- 172.21.15.100:0/421240577 shutdown_connections 2024-08-17T02:45:42.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.389+0000 7f3660e00640 1 -- 172.21.15.100:0/421240577 wait complete. 2024-08-17T02:45:42.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.391+0000 7f3660e00640 1 Processor -- start 2024-08-17T02:45:42.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.391+0000 7f3660e00640 1 -- start start 2024-08-17T02:45:42.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.392+0000 7f3660e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f365c069710 0x7f365c151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:42.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.392+0000 7f3660e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f365c0ac540 0x7f365c0aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:42.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.392+0000 7f3660e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f365c158bd0 0x7f365c0aab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:42.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.392+0000 7f3660e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0b15c0 con 0x7f365c158bd0 2024-08-17T02:45:42.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.392+0000 7f3660e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0b0800 con 0x7f365c0ac540 2024-08-17T02:45:42.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.392+0000 7f3660e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0b0ae0 con 0x7f365c069710 2024-08-17T02:45:42.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.392+0000 7f365be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f365c158bd0 0x7f365c0aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:42.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.392+0000 7f365be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f365c158bd0 0x7f365c0aab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40408/0 (socket says 172.21.15.100:40408) 2024-08-17T02:45:42.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.392+0000 7f365be00640 1 -- 172.21.15.100:0/941652262 learned_addr learned my addr 172.21.15.100:0/941652262 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:42.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.392+0000 7f365be00640 1 -- 172.21.15.100:0/941652262 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f365c069710 msgr2=0x7f365c151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:42.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.392+0000 7f365be00640 1 --2- 172.21.15.100:0/941652262 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f365c069710 0x7f365c151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.392+0000 7f365be00640 1 -- 172.21.15.100:0/941652262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f365c0ac540 msgr2=0x7f365c0aa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:42.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.392+0000 7f365be00640 1 --2- 172.21.15.100:0/941652262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f365c0ac540 0x7f365c0aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.392+0000 7f365be00640 1 -- 172.21.15.100:0/941652262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3654009ae0 con 0x7f365c158bd0 2024-08-17T02:45:42.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.393+0000 7f365be00640 1 --2- 172.21.15.100:0/941652262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f365c158bd0 0x7f365c0aab20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3654009f20 tx=0x7f3654036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:42.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.393+0000 7f3653400640 1 -- 172.21.15.100:0/941652262 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3654007790 con 0x7f365c158bd0 2024-08-17T02:45:42.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.393+0000 7f3653400640 1 -- 172.21.15.100:0/941652262 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36540078f0 con 0x7f365c158bd0 2024-08-17T02:45:42.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.393+0000 7f3653400640 1 -- 172.21.15.100:0/941652262 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3654007cb0 con 0x7f365c158bd0 2024-08-17T02:45:42.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.393+0000 7f3660e00640 1 -- 172.21.15.100:0/941652262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365c0b0dc0 con 0x7f365c158bd0 2024-08-17T02:45:42.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.393+0000 7f3660e00640 1 -- 172.21.15.100:0/941652262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365c0b2e00 con 0x7f365c158bd0 2024-08-17T02:45:42.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.394+0000 7f3660e00640 1 -- 172.21.15.100:0/941652262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f365c0b12c0 con 0x7f365c158bd0 2024-08-17T02:45:42.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.395+0000 7f3653400640 1 -- 172.21.15.100:0/941652262 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f365403c630 con 0x7f365c158bd0 2024-08-17T02:45:42.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.395+0000 7f3653400640 1 --2- 172.21.15.100:0/941652262 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3638065150 0x7f3638067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:42.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.395+0000 7f3653400640 1 -- 172.21.15.100:0/941652262 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f36540a3350 con 0x7f365c158bd0 2024-08-17T02:45:42.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.396+0000 7f365b400640 1 --2- 172.21.15.100:0/941652262 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3638065150 0x7f3638067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:42.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.396+0000 7f365b400640 1 --2- 172.21.15.100:0/941652262 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3638065150 0x7f3638067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f364c007fd0 tx=0x7f364c007a90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:42.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.400+0000 7f3653400640 1 -- 172.21.15.100:0/941652262 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3654071370 con 0x7f365c158bd0 2024-08-17T02:45:42.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.574+0000 7f3660e00640 1 -- 172.21.15.100:0/941652262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f365c071050 con 0x7f365c158bd0 2024-08-17T02:45:42.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.575+0000 7f3653400640 1 -- 172.21.15.100:0/941652262 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f3654074990 con 0x7f365c158bd0 2024-08-17T02:45:42.576 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:42.577 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":21,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:41.236635+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:45:39.036964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:45:40.232954+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:45:42.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.577+0000 7f3660e00640 1 -- 172.21.15.100:0/941652262 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3638065150 msgr2=0x7f3638067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:42.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.577+0000 7f3660e00640 1 --2- 172.21.15.100:0/941652262 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3638065150 0x7f3638067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f364c007fd0 tx=0x7f364c007a90 comp rx=0 tx=0).stop 2024-08-17T02:45:42.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.577+0000 7f3660e00640 1 -- 172.21.15.100:0/941652262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f365c158bd0 msgr2=0x7f365c0aab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:42.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.577+0000 7f3660e00640 1 --2- 172.21.15.100:0/941652262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f365c158bd0 0x7f365c0aab20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3654009f20 tx=0x7f3654036000 comp rx=0 tx=0).stop 2024-08-17T02:45:42.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.578+0000 7f3660e00640 1 -- 172.21.15.100:0/941652262 shutdown_connections 2024-08-17T02:45:42.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.578+0000 7f3660e00640 1 --2- 172.21.15.100:0/941652262 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3638065150 0x7f3638067600 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.578+0000 7f3660e00640 1 --2- 172.21.15.100:0/941652262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f365c158bd0 0x7f365c0aab20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.578+0000 7f3660e00640 1 --2- 172.21.15.100:0/941652262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f365c0ac540 0x7f365c0aa5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.578+0000 7f3660e00640 1 --2- 172.21.15.100:0/941652262 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f365c069710 0x7f365c151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.578+0000 7f3660e00640 1 -- 172.21.15.100:0/941652262 >> 172.21.15.100:0/941652262 conn(0x7f365c096a70 msgr2=0x7f365c154d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:42.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.578+0000 7f3660e00640 1 -- 172.21.15.100:0/941652262 shutdown_connections 2024-08-17T02:45:42.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.578+0000 7f3660e00640 1 -- 172.21.15.100:0/941652262 wait complete. 2024-08-17T02:45:42.593 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:45:42.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.742+0000 7f0a6d800640 1 Processor -- start 2024-08-17T02:45:42.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.743+0000 7f0a6d800640 1 -- start start 2024-08-17T02:45:42.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.744+0000 7f0a6d800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0a68155660 0x7f0a680c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:42.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.744+0000 7f0a6d800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a68155a30 0x7f0a6806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:42.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.744+0000 7f0a6d800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a680afc40 con 0x7f0a680adfb0 2024-08-17T02:45:42.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.744+0000 7f0a6d800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a680af030 con 0x7f0a68155660 2024-08-17T02:45:42.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.744+0000 7f0a6d800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680af310 con 0x7f0a68155a30 2024-08-17T02:45:42.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.744+0000 7f0a67e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0a68155660 0x7f0a680c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:42.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.744+0000 7f0a6ce00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a68155a30 0x7f0a6806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:42.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.744+0000 7f0a67e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0a68155660 0x7f0a680c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:50532/0 (socket says 172.21.15.100:50532) 2024-08-17T02:45:42.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.744+0000 7f0a67e00640 1 -- 172.21.15.100:0/429839863 learned_addr learned my addr 172.21.15.100:0/429839863 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:42.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.745+0000 7f0a67e00640 1 -- 172.21.15.100:0/429839863 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a68155a30 msgr2=0x7f0a6806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:42.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.745+0000 7f0a67e00640 1 --2- 172.21.15.100:0/429839863 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a68155a30 0x7f0a6806dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.745+0000 7f0a67e00640 1 -- 172.21.15.100:0/429839863 >> v1:172.21.15.123:6789/0 conn(0x7f0a680adfb0 legacy=0x7f0a680ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:42.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.745+0000 7f0a67e00640 1 -- 172.21.15.100:0/429839863 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a680af5f0 con 0x7f0a68155660 2024-08-17T02:45:42.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.746+0000 7f0a67e00640 1 --2- 172.21.15.100:0/429839863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a68155660 0x7f0a680c7fe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009910 tx=0x7f0a580091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67832619086980a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:42.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.746+0000 7f0a67400640 1 -- 172.21.15.100:0/429839863 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5802ae40 con 0x7f0a68155660 2024-08-17T02:45:42.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.746+0000 7f0a67400640 1 -- 172.21.15.100:0/429839863 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a58032440 con 0x7f0a68155660 2024-08-17T02:45:42.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.746+0000 7f0a67400640 1 -- 172.21.15.100:0/429839863 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a58032820 con 0x7f0a68155660 2024-08-17T02:45:42.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.747+0000 7f0a6d800640 1 -- 172.21.15.100:0/429839863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a68155660 msgr2=0x7f0a680c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:42.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.747+0000 7f0a6d800640 1 --2- 172.21.15.100:0/429839863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a68155660 0x7f0a680c7fe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009910 tx=0x7f0a580091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.747+0000 7f0a6d800640 1 -- 172.21.15.100:0/429839863 shutdown_connections 2024-08-17T02:45:42.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.747+0000 7f0a6d800640 1 --2- 172.21.15.100:0/429839863 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a68155a30 0x7f0a6806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.747+0000 7f0a6d800640 1 --2- 172.21.15.100:0/429839863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a68155660 0x7f0a680c7fe0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.747+0000 7f0a6d800640 1 -- 172.21.15.100:0/429839863 >> 172.21.15.100:0/429839863 conn(0x7f0a68066cd0 msgr2=0x7f0a680670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:42.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.747+0000 7f0a6d800640 1 -- 172.21.15.100:0/429839863 shutdown_connections 2024-08-17T02:45:42.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.747+0000 7f0a6d800640 1 -- 172.21.15.100:0/429839863 wait complete. 2024-08-17T02:45:42.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.748+0000 7f0a6d800640 1 Processor -- start 2024-08-17T02:45:42.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.748+0000 7f0a6d800640 1 -- start start 2024-08-17T02:45:42.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.749+0000 7f0a6d800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a680adfb0 0x7f0a6814f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:42.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.749+0000 7f0a6d800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a68155660 0x7f0a68153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:42.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.749+0000 7f0a6d800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a68155a30 0x7f0a680aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:42.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.749+0000 7f0a6d800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680aa590 con 0x7f0a680adfb0 2024-08-17T02:45:42.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.749+0000 7f0a6d800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680a9980 con 0x7f0a68155a30 2024-08-17T02:45:42.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.749+0000 7f0a6d800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680a9c60 con 0x7f0a68155660 2024-08-17T02:45:42.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.749+0000 7f0a67e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a680adfb0 0x7f0a6814f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:42.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.749+0000 7f0a67e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a680adfb0 0x7f0a6814f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40418/0 (socket says 172.21.15.100:40418) 2024-08-17T02:45:42.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.749+0000 7f0a67e00640 1 -- 172.21.15.100:0/3427189420 learned_addr learned my addr 172.21.15.100:0/3427189420 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:42.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.750+0000 7f0a5f400640 1 --2- 172.21.15.100:0/3427189420 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a68155660 0x7f0a68153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:42.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.750+0000 7f0a6ce00640 1 --2- 172.21.15.100:0/3427189420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a68155a30 0x7f0a680aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:42.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.750+0000 7f0a67e00640 1 -- 172.21.15.100:0/3427189420 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a68155660 msgr2=0x7f0a68153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:42.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.750+0000 7f0a67e00640 1 --2- 172.21.15.100:0/3427189420 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a68155660 0x7f0a68153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.750+0000 7f0a67e00640 1 -- 172.21.15.100:0/3427189420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a68155a30 msgr2=0x7f0a680aaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:42.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.750+0000 7f0a67e00640 1 --2- 172.21.15.100:0/3427189420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a68155a30 0x7f0a680aaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:42.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.750+0000 7f0a67e00640 1 -- 172.21.15.100:0/3427189420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a58009450 con 0x7f0a680adfb0 2024-08-17T02:45:42.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.750+0000 7f0a67e00640 1 --2- 172.21.15.100:0/3427189420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a680adfb0 0x7f0a6814f600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0a58035040 tx=0x7f0a58032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:42.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.750+0000 7f0a5fe00640 1 -- 172.21.15.100:0/3427189420 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a58031bb0 con 0x7f0a680adfb0 2024-08-17T02:45:42.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.750+0000 7f0a5fe00640 1 -- 172.21.15.100:0/3427189420 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a58031d70 con 0x7f0a680adfb0 2024-08-17T02:45:42.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.750+0000 7f0a5fe00640 1 -- 172.21.15.100:0/3427189420 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5803d670 con 0x7f0a680adfb0 2024-08-17T02:45:42.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.750+0000 7f0a6d800640 1 -- 172.21.15.100:0/3427189420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a680a9f40 con 0x7f0a680adfb0 2024-08-17T02:45:42.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.751+0000 7f0a6d800640 1 -- 172.21.15.100:0/3427189420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6814fb40 con 0x7f0a680adfb0 2024-08-17T02:45:42.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.752+0000 7f0a6d800640 1 -- 172.21.15.100:0/3427189420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a68154eb0 con 0x7f0a680adfb0 2024-08-17T02:45:42.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.752+0000 7f0a5fe00640 1 -- 172.21.15.100:0/3427189420 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0a58039040 con 0x7f0a680adfb0 2024-08-17T02:45:42.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.753+0000 7f0a5fe00640 1 --2- 172.21.15.100:0/3427189420 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0a44065180 0x7f0a44067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:42.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.753+0000 7f0a5fe00640 1 -- 172.21.15.100:0/3427189420 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a5802ae40 con 0x7f0a680adfb0 2024-08-17T02:45:42.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.753+0000 7f0a5f400640 1 --2- 172.21.15.100:0/3427189420 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0a44065180 0x7f0a44067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:42.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.754+0000 7f0a5f400640 1 --2- 172.21.15.100:0/3427189420 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0a44065180 0x7f0a44067630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0a680acac0 tx=0x7f0a50007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:42.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.758+0000 7f0a5fe00640 1 -- 172.21.15.100:0/3427189420 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0a580d3e40 con 0x7f0a680adfb0 2024-08-17T02:45:42.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:42.969+0000 7f0a6d800640 1 -- 172.21.15.100:0/3427189420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0a68071050 con 0x7f0a680adfb0 2024-08-17T02:45:43.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:43.863+0000 7f0a5fe00640 1 -- 172.21.15.100:0/3427189420 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0a58070310 con 0x7f0a680adfb0 2024-08-17T02:45:43.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:43.866+0000 7f0a6d800640 1 -- 172.21.15.100:0/3427189420 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0a44065180 msgr2=0x7f0a44067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:43.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:43.866+0000 7f0a6d800640 1 --2- 172.21.15.100:0/3427189420 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0a44065180 0x7f0a44067630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0a680acac0 tx=0x7f0a50007e30 comp rx=0 tx=0).stop 2024-08-17T02:45:43.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:43.866+0000 7f0a6d800640 1 -- 172.21.15.100:0/3427189420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a680adfb0 msgr2=0x7f0a6814f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:43.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:43.866+0000 7f0a6d800640 1 --2- 172.21.15.100:0/3427189420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a680adfb0 0x7f0a6814f600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0a58035040 tx=0x7f0a58032000 comp rx=0 tx=0).stop 2024-08-17T02:45:43.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:43.866+0000 7f0a6d800640 1 -- 172.21.15.100:0/3427189420 shutdown_connections 2024-08-17T02:45:43.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:43.866+0000 7f0a6d800640 1 --2- 172.21.15.100:0/3427189420 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0a44065180 0x7f0a44067630 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:43.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:43.866+0000 7f0a6d800640 1 --2- 172.21.15.100:0/3427189420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a68155a30 0x7f0a680aaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:43.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:43.866+0000 7f0a6d800640 1 --2- 172.21.15.100:0/3427189420 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a68155660 0x7f0a68153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:43.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:43.866+0000 7f0a6d800640 1 --2- 172.21.15.100:0/3427189420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a680adfb0 0x7f0a6814f600 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:43.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:43.866+0000 7f0a6d800640 1 -- 172.21.15.100:0/3427189420 >> 172.21.15.100:0/3427189420 conn(0x7f0a68066cd0 msgr2=0x7f0a680c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:43.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:43.866+0000 7f0a6d800640 1 -- 172.21.15.100:0/3427189420 shutdown_connections 2024-08-17T02:45:43.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:43.866+0000 7f0a6d800640 1 -- 172.21.15.100:0/3427189420 wait complete. 2024-08-17T02:45:43.884 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:45:44.021 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:45:44.025 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:45:44.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.039+0000 7f0750c00640 1 Processor -- start 2024-08-17T02:45:44.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.039+0000 7f0750c00640 1 -- start start 2024-08-17T02:45:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.040+0000 7f0750c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f074c15c2f0 0x7f074c0af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.041+0000 7f0750c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f074c0d0890 0x7f074c0b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.041+0000 7f0750c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074c0b11b0 con 0x7f074c0b0d50 2024-08-17T02:45:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.041+0000 7f0750c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074c0b1e10 con 0x7f074c15c2f0 2024-08-17T02:45:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.041+0000 7f0750c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074c0af910 con 0x7f074c0d0890 2024-08-17T02:45:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.041+0000 7f0749e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f074c15c2f0 0x7f074c0af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.041+0000 7f0749e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f074c15c2f0 0x7f074c0af3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40420/0 (socket says 172.21.15.100:40420) 2024-08-17T02:45:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.041+0000 7f0749e00640 1 -- 172.21.15.100:0/3124986379 learned_addr learned my addr 172.21.15.100:0/3124986379 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.041+0000 7f0749400640 1 --2- 172.21.15.100:0/3124986379 >> v2:172.21.15.123:3300/0 conn(0x7f074c0d0890 0x7f074c0b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:44.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.041+0000 7f0749e00640 1 -- 172.21.15.100:0/3124986379 >> v2:172.21.15.123:3300/0 conn(0x7f074c0d0890 msgr2=0x7f074c0b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:44.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.041+0000 7f0749e00640 1 --2- 172.21.15.100:0/3124986379 >> v2:172.21.15.123:3300/0 conn(0x7f074c0d0890 0x7f074c0b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:44.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.041+0000 7f0749e00640 1 -- 172.21.15.100:0/3124986379 >> v1:172.21.15.123:6789/0 conn(0x7f074c0b0d50 legacy=0x7f074c0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:44.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.041+0000 7f0749e00640 1 -- 172.21.15.100:0/3124986379 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c0afbb0 con 0x7f074c15c2f0 2024-08-17T02:45:44.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.042+0000 7f0749e00640 1 --2- 172.21.15.100:0/3124986379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f074c15c2f0 0x7f074c0af3d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f074c05eb90 tx=0x7f073c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a5152cf9907db7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:44.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.043+0000 7f0748a00640 1 -- 172.21.15.100:0/3124986379 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c02ae80 con 0x7f074c15c2f0 2024-08-17T02:45:44.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.043+0000 7f0748a00640 1 -- 172.21.15.100:0/3124986379 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c032440 con 0x7f074c15c2f0 2024-08-17T02:45:44.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.043+0000 7f0748a00640 1 -- 172.21.15.100:0/3124986379 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c032800 con 0x7f074c15c2f0 2024-08-17T02:45:44.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.043+0000 7f0750c00640 1 -- 172.21.15.100:0/3124986379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f074c15c2f0 msgr2=0x7f074c0af3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:44.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.043+0000 7f0750c00640 1 --2- 172.21.15.100:0/3124986379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f074c15c2f0 0x7f074c0af3d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f074c05eb90 tx=0x7f073c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:44.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.043+0000 7f0750c00640 1 -- 172.21.15.100:0/3124986379 shutdown_connections 2024-08-17T02:45:44.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.043+0000 7f0750c00640 1 --2- 172.21.15.100:0/3124986379 >> v2:172.21.15.123:3300/0 conn(0x7f074c0d0890 0x7f074c0b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:44.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.043+0000 7f0750c00640 1 --2- 172.21.15.100:0/3124986379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f074c15c2f0 0x7f074c0af3d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:44.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.043+0000 7f0750c00640 1 -- 172.21.15.100:0/3124986379 >> 172.21.15.100:0/3124986379 conn(0x7f074c0cfdb0 msgr2=0x7f074c0d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:44.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.043+0000 7f0750c00640 1 -- 172.21.15.100:0/3124986379 shutdown_connections 2024-08-17T02:45:44.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.043+0000 7f0750c00640 1 -- 172.21.15.100:0/3124986379 wait complete. 2024-08-17T02:45:44.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.045+0000 7f0750c00640 1 Processor -- start 2024-08-17T02:45:44.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.045+0000 7f0750c00640 1 -- start start 2024-08-17T02:45:44.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.046+0000 7f0750c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f074c0b0d50 0x7f074c09d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:44.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.046+0000 7f0750c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f074c0d0890 0x7f074c14b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:44.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.046+0000 7f0750c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f074c15c2f0 0x7f074c0ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:44.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.046+0000 7f0750c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c09b290 con 0x7f074c15c2f0 2024-08-17T02:45:44.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.046+0000 7f0750c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c14be30 con 0x7f074c0b0d50 2024-08-17T02:45:44.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.046+0000 7f0750c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c09d2a0 con 0x7f074c0d0890 2024-08-17T02:45:44.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.046+0000 7f0749e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f074c0b0d50 0x7f074c09d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:44.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.046+0000 7f0749e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f074c0b0d50 0x7f074c09d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:50564/0 (socket says 172.21.15.100:50564) 2024-08-17T02:45:44.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.046+0000 7f0749e00640 1 -- 172.21.15.100:0/1778868355 learned_addr learned my addr 172.21.15.100:0/1778868355 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:44.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.046+0000 7f0749400640 1 --2- 172.21.15.100:0/1778868355 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f074c0d0890 0x7f074c14b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:44.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.046+0000 7f074a800640 1 --2- 172.21.15.100:0/1778868355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f074c15c2f0 0x7f074c0ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:44.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.046+0000 7f0749e00640 1 -- 172.21.15.100:0/1778868355 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f074c0d0890 msgr2=0x7f074c14b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:44.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.046+0000 7f0749e00640 1 --2- 172.21.15.100:0/1778868355 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f074c0d0890 0x7f074c14b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:44.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.046+0000 7f0749e00640 1 -- 172.21.15.100:0/1778868355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f074c15c2f0 msgr2=0x7f074c0ad970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:44.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.046+0000 7f0749e00640 1 --2- 172.21.15.100:0/1778868355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f074c15c2f0 0x7f074c0ad970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:44.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.047+0000 7f0749e00640 1 -- 172.21.15.100:0/1778868355 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c009450 con 0x7f074c0b0d50 2024-08-17T02:45:44.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.047+0000 7f0749e00640 1 --2- 172.21.15.100:0/1778868355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f074c0b0d50 0x7f074c09d730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f073c009210 tx=0x7f073c032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:44.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.047+0000 7f0741600640 1 -- 172.21.15.100:0/1778868355 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c031bb0 con 0x7f074c0b0d50 2024-08-17T02:45:44.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.047+0000 7f0741600640 1 -- 172.21.15.100:0/1778868355 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c031d30 con 0x7f074c0b0d50 2024-08-17T02:45:44.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.047+0000 7f0741600640 1 -- 172.21.15.100:0/1778868355 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c031ea0 con 0x7f074c0b0d50 2024-08-17T02:45:44.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.047+0000 7f0750c00640 1 -- 172.21.15.100:0/1778868355 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074c09c970 con 0x7f074c0b0d50 2024-08-17T02:45:44.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.047+0000 7f0750c00640 1 -- 172.21.15.100:0/1778868355 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074c09cf30 con 0x7f074c0b0d50 2024-08-17T02:45:44.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.048+0000 7f0750c00640 1 -- 172.21.15.100:0/1778868355 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074c071050 con 0x7f074c0b0d50 2024-08-17T02:45:44.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.049+0000 7f0741600640 1 -- 172.21.15.100:0/1778868355 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f073c039040 con 0x7f074c0b0d50 2024-08-17T02:45:44.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.050+0000 7f0741600640 1 --2- 172.21.15.100:0/1778868355 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f072c065150 0x7f072c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:44.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.050+0000 7f0741600640 1 -- 172.21.15.100:0/1778868355 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f073c0a2610 con 0x7f074c0b0d50 2024-08-17T02:45:44.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.050+0000 7f0749400640 1 --2- 172.21.15.100:0/1778868355 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f072c065150 0x7f072c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:44.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.051+0000 7f0749400640 1 --2- 172.21.15.100:0/1778868355 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f072c065150 0x7f072c067600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f074c16c2b0 tx=0x7f07380090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:44.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.055+0000 7f0741600640 1 -- 172.21.15.100:0/1778868355 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f073c0706e0 con 0x7f074c0b0d50 2024-08-17T02:45:44.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.269+0000 7f0750c00640 1 -- 172.21.15.100:0/1778868355 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f074c155ec0 con 0x7f074c0b0d50 2024-08-17T02:45:44.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.869+0000 7f0741600640 1 -- 172.21.15.100:0/1778868355 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f073c073d00 con 0x7f074c0b0d50 2024-08-17T02:45:44.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.872+0000 7f0750c00640 1 -- 172.21.15.100:0/1778868355 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f072c065150 msgr2=0x7f072c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:44.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.872+0000 7f0750c00640 1 --2- 172.21.15.100:0/1778868355 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f072c065150 0x7f072c067600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f074c16c2b0 tx=0x7f07380090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:44.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.872+0000 7f0750c00640 1 -- 172.21.15.100:0/1778868355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f074c0b0d50 msgr2=0x7f074c09d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:44.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.872+0000 7f0750c00640 1 --2- 172.21.15.100:0/1778868355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f074c0b0d50 0x7f074c09d730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f073c009210 tx=0x7f073c032000 comp rx=0 tx=0).stop 2024-08-17T02:45:44.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.872+0000 7f0750c00640 1 -- 172.21.15.100:0/1778868355 shutdown_connections 2024-08-17T02:45:44.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.872+0000 7f0750c00640 1 --2- 172.21.15.100:0/1778868355 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f072c065150 0x7f072c067600 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:44.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.872+0000 7f0750c00640 1 --2- 172.21.15.100:0/1778868355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f074c15c2f0 0x7f074c0ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:44.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.872+0000 7f0750c00640 1 --2- 172.21.15.100:0/1778868355 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f074c0d0890 0x7f074c14b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:44.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.872+0000 7f0750c00640 1 --2- 172.21.15.100:0/1778868355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f074c0b0d50 0x7f074c09d730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:44.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.872+0000 7f0750c00640 1 -- 172.21.15.100:0/1778868355 >> 172.21.15.100:0/1778868355 conn(0x7f074c0cfdb0 msgr2=0x7f074c0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:44.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.872+0000 7f0750c00640 1 -- 172.21.15.100:0/1778868355 shutdown_connections 2024-08-17T02:45:44.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:44.872+0000 7f0750c00640 1 -- 172.21.15.100:0/1778868355 wait complete. 2024-08-17T02:45:44.888 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:45:45.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.035+0000 7f89efe00640 1 Processor -- start 2024-08-17T02:45:45.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.036+0000 7f89efe00640 1 -- start start 2024-08-17T02:45:45.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.037+0000 7f89efe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f89f00c8060 0x7f89f00addf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:45.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.037+0000 7f89efe00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f00ae6b0 con 0x7f89f0159c40 2024-08-17T02:45:45.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.037+0000 7f89efe00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f00af230 con 0x7f89f00ada20 2024-08-17T02:45:45.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.037+0000 7f89efe00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f00c8450 con 0x7f89f00c8060 2024-08-17T02:45:45.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.037+0000 7f89e6000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f89f0159c40 0x7f89f0154e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44924/0 (socket says 172.21.15.100:44924) 2024-08-17T02:45:45.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.037+0000 7f89e6000640 1 -- 172.21.15.100:0/4029958576 learned_addr learned my addr 172.21.15.100:0/4029958576 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:45.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.037+0000 7f89ef400640 1 --2- 172.21.15.100:0/4029958576 >> v2:172.21.15.123:3300/0 conn(0x7f89f00c8060 0x7f89f00addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:45.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.038+0000 7f89ee000640 1 -- 172.21.15.100:0/4029958576 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493448649 0 0) 0x7f89f00ae6b0 con 0x7f89f0159c40 2024-08-17T02:45:45.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.038+0000 7f89ee000640 1 -- 172.21.15.100:0/4029958576 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89d40045f0 con 0x7f89f0159c40 2024-08-17T02:45:45.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.038+0000 7f89ef400640 1 -- 172.21.15.100:0/4029958576 >> v1:172.21.15.123:6789/0 conn(0x7f89f00ada20 legacy=0x7f89f00cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:45.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.038+0000 7f89ee000640 1 -- 172.21.15.100:0/4029958576 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1362687035 0 0) 0x7f89d40045f0 con 0x7f89f0159c40 2024-08-17T02:45:45.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.038+0000 7f89ef400640 1 -- 172.21.15.100:0/4029958576 >> v1:172.21.15.100:6789/0 conn(0x7f89f0159c40 legacy=0x7f89f0154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:45.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.038+0000 7f89ef400640 1 -- 172.21.15.100:0/4029958576 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f00ae900 con 0x7f89f00c8060 2024-08-17T02:45:45.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.039+0000 7f89ef400640 1 --2- 172.21.15.100:0/4029958576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89f00c8060 0x7f89f00addf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009e60 tx=0x7f89e8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77deed3339d3ae97 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:45.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.039+0000 7f89ee000640 1 -- 172.21.15.100:0/4029958576 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8001470 con 0x7f89f00c8060 2024-08-17T02:45:45.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.039+0000 7f89ee000640 1 -- 172.21.15.100:0/4029958576 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e802d050 con 0x7f89f00c8060 2024-08-17T02:45:45.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.039+0000 7f89ee000640 1 -- 172.21.15.100:0/4029958576 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8031610 con 0x7f89f00c8060 2024-08-17T02:45:45.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.040+0000 7f89efe00640 1 -- 172.21.15.100:0/4029958576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89f00c8060 msgr2=0x7f89f00addf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:45.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.040+0000 7f89efe00640 1 --2- 172.21.15.100:0/4029958576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89f00c8060 0x7f89f00addf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009e60 tx=0x7f89e8009780 comp rx=0 tx=0).stop 2024-08-17T02:45:45.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.040+0000 7f89efe00640 1 -- 172.21.15.100:0/4029958576 shutdown_connections 2024-08-17T02:45:45.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.040+0000 7f89efe00640 1 --2- 172.21.15.100:0/4029958576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89f00c8060 0x7f89f00addf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.040+0000 7f89efe00640 1 -- 172.21.15.100:0/4029958576 >> 172.21.15.100:0/4029958576 conn(0x7f89f0067750 msgr2=0x7f89f00cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:45.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.040+0000 7f89efe00640 1 -- 172.21.15.100:0/4029958576 shutdown_connections 2024-08-17T02:45:45.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.040+0000 7f89efe00640 1 -- 172.21.15.100:0/4029958576 wait complete. 2024-08-17T02:45:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.041+0000 7f89efe00640 1 Processor -- start 2024-08-17T02:45:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.041+0000 7f89efe00640 1 -- start start 2024-08-17T02:45:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.042+0000 7f89efe00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f89f00ada20 0x7f89f0169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.042+0000 7f89efe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89f00c8060 0x7f89f0158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.042+0000 7f89efe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89f0159c40 0x7f89f01592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.042+0000 7f89efe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f00a64c0 con 0x7f89f0159c40 2024-08-17T02:45:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.042+0000 7f89efe00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f016a020 con 0x7f89f00c8060 2024-08-17T02:45:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.042+0000 7f89efe00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f00a58b0 con 0x7f89f00ada20 2024-08-17T02:45:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.042+0000 7f89ef400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89f0159c40 0x7f89f01592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.043+0000 7f89ef400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89f0159c40 0x7f89f01592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40440/0 (socket says 172.21.15.100:40440) 2024-08-17T02:45:45.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.043+0000 7f89ef400640 1 -- 172.21.15.100:0/2494156538 learned_addr learned my addr 172.21.15.100:0/2494156538 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:45.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.043+0000 7f89e6000640 1 --2- 172.21.15.100:0/2494156538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89f00c8060 0x7f89f0158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:45.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.043+0000 7f89eea00640 1 --2- 172.21.15.100:0/2494156538 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f89f00ada20 0x7f89f0169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:45.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.043+0000 7f89ef400640 1 -- 172.21.15.100:0/2494156538 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f89f00ada20 msgr2=0x7f89f0169ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:45.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.043+0000 7f89ef400640 1 --2- 172.21.15.100:0/2494156538 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f89f00ada20 0x7f89f0169ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.043+0000 7f89ef400640 1 -- 172.21.15.100:0/2494156538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89f00c8060 msgr2=0x7f89f0158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:45.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.043+0000 7f89ef400640 1 --2- 172.21.15.100:0/2494156538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89f00c8060 0x7f89f0158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.043+0000 7f89ef400640 1 -- 172.21.15.100:0/2494156538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e8009a20 con 0x7f89f0159c40 2024-08-17T02:45:45.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.043+0000 7f89ef400640 1 --2- 172.21.15.100:0/2494156538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89f0159c40 0x7f89f01592b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009e60 tx=0x7f89e8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:45.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.043+0000 7f89e6a00640 1 -- 172.21.15.100:0/2494156538 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e803ba70 con 0x7f89f0159c40 2024-08-17T02:45:45.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.044+0000 7f89e6a00640 1 -- 172.21.15.100:0/2494156538 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e8040070 con 0x7f89f0159c40 2024-08-17T02:45:45.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.044+0000 7f89e6a00640 1 -- 172.21.15.100:0/2494156538 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e803be40 con 0x7f89f0159c40 2024-08-17T02:45:45.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.044+0000 7f89efe00640 1 -- 172.21.15.100:0/2494156538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f00a5b90 con 0x7f89f0159c40 2024-08-17T02:45:45.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.044+0000 7f89efe00640 1 -- 172.21.15.100:0/2494156538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f00a6150 con 0x7f89f0159c40 2024-08-17T02:45:45.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.045+0000 7f89efe00640 1 -- 172.21.15.100:0/2494156538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f0167dd0 con 0x7f89f0159c40 2024-08-17T02:45:45.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.045+0000 7f89e6a00640 1 -- 172.21.15.100:0/2494156538 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f89e8003030 con 0x7f89f0159c40 2024-08-17T02:45:45.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.046+0000 7f89e6a00640 1 --2- 172.21.15.100:0/2494156538 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f89cc065180 0x7f89cc067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:45.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.046+0000 7f89e6a00640 1 -- 172.21.15.100:0/2494156538 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f89e8042070 con 0x7f89f0159c40 2024-08-17T02:45:45.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.046+0000 7f89eea00640 1 --2- 172.21.15.100:0/2494156538 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f89cc065180 0x7f89cc067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:45.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.047+0000 7f89eea00640 1 --2- 172.21.15.100:0/2494156538 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f89cc065180 0x7f89cc067630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f89e0007fd0 tx=0x7f89e0007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:45.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.050+0000 7f89e6a00640 1 -- 172.21.15.100:0/2494156538 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f89f0167dd0 con 0x7f89f0159c40 2024-08-17T02:45:45.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.262+0000 7f89efe00640 1 -- 172.21.15.100:0/2494156538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89f0167db0 con 0x7f89f0159c40 2024-08-17T02:45:45.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.262+0000 7f89e6a00640 1 -- 172.21.15.100:0/2494156538 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f89e8071500 con 0x7f89f0159c40 2024-08-17T02:45:45.263 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:45.263 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3043714204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3043714204},{"type":"v1","addr":"172.21.15.100:6835","nonce":3043714204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/543049926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":543049926},{"type":"v1","addr":"172.21.15.100:6837","nonce":543049926}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2733092927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2733092927},{"type":"v1","addr":"172.21.15.123:6834","nonce":2733092927}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:45:41.237121+0000","modified":"2024-08-17T02:45:44.862501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/2872394530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2872394530},{"type":"v1","addr":"172.21.15.123:6835","nonce":2872394530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:45:45.264 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-08-17T02:45:45.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.264+0000 7f89efe00640 1 -- 172.21.15.100:0/2494156538 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f89cc065180 msgr2=0x7f89cc067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:45.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.264+0000 7f89efe00640 1 --2- 172.21.15.100:0/2494156538 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f89cc065180 0x7f89cc067630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f89e0007fd0 tx=0x7f89e0007e30 comp rx=0 tx=0).stop 2024-08-17T02:45:45.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.264+0000 7f89efe00640 1 -- 172.21.15.100:0/2494156538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89f0159c40 msgr2=0x7f89f01592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:45.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.264+0000 7f89efe00640 1 --2- 172.21.15.100:0/2494156538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89f0159c40 0x7f89f01592b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009e60 tx=0x7f89e8037000 comp rx=0 tx=0).stop 2024-08-17T02:45:45.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.265+0000 7f89efe00640 1 -- 172.21.15.100:0/2494156538 shutdown_connections 2024-08-17T02:45:45.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.265+0000 7f89efe00640 1 --2- 172.21.15.100:0/2494156538 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f89cc065180 0x7f89cc067630 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.265+0000 7f89efe00640 1 --2- 172.21.15.100:0/2494156538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89f0159c40 0x7f89f01592b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.265+0000 7f89efe00640 1 --2- 172.21.15.100:0/2494156538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89f00c8060 0x7f89f0158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.265+0000 7f89efe00640 1 --2- 172.21.15.100:0/2494156538 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f89f00ada20 0x7f89f0169ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.265+0000 7f89efe00640 1 -- 172.21.15.100:0/2494156538 >> 172.21.15.100:0/2494156538 conn(0x7f89f0067750 msgr2=0x7f89f00ab7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:45.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.265+0000 7f89efe00640 1 -- 172.21.15.100:0/2494156538 shutdown_connections 2024-08-17T02:45:45.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.265+0000 7f89efe00640 1 -- 172.21.15.100:0/2494156538 wait complete. 2024-08-17T02:45:45.280 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:45:45.358 INFO:tasks.ceph.mds.b.smithi123.stderr:2024-08-17T02:45:45.358+0000 7f958d200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:45:45.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.426+0000 7fa4dd400640 1 Processor -- start 2024-08-17T02:45:45.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.426+0000 7fa4dd400640 1 -- start start 2024-08-17T02:45:45.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.427+0000 7fa4dd400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa4d8159ca0 0x7fa4d80ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:45.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.427+0000 7fa4dd400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4d80ca8a0 0x7fa4d80cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:45.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.427+0000 7fa4dd400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d80cadc0 con 0x7fa4d80ccad0 2024-08-17T02:45:45.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.427+0000 7fa4dd400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d80cd6e0 con 0x7fa4d8159ca0 2024-08-17T02:45:45.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.427+0000 7fa4dd400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80ccf70 con 0x7fa4d80ca8a0 2024-08-17T02:45:45.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.427+0000 7fa4d7e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa4d8159ca0 0x7fa4d80ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:45.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.427+0000 7fa4d7e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa4d8159ca0 0x7fa4d80ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40454/0 (socket says 172.21.15.100:40454) 2024-08-17T02:45:45.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.427+0000 7fa4d7e00640 1 -- 172.21.15.100:0/1984770748 learned_addr learned my addr 172.21.15.100:0/1984770748 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:45.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.427+0000 7fa4dca00640 1 --1- 172.21.15.100:0/1984770748 >> v1:172.21.15.100:6789/0 conn(0x7fa4d80ccad0 0x7fa4d80cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44932/0 (socket says 172.21.15.100:44932) 2024-08-17T02:45:45.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.428+0000 7fa4cf400640 1 --2- 172.21.15.100:0/1984770748 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4d80ca8a0 0x7fa4d80cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:45.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.428+0000 7fa4d7e00640 1 -- 172.21.15.100:0/1984770748 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4d80ca8a0 msgr2=0x7fa4d80cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:45.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.428+0000 7fa4d7e00640 1 --2- 172.21.15.100:0/1984770748 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4d80ca8a0 0x7fa4d80cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.428+0000 7fa4d7e00640 1 -- 172.21.15.100:0/1984770748 >> v1:172.21.15.100:6789/0 conn(0x7fa4d80ccad0 legacy=0x7fa4d80cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:45.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.428+0000 7fa4d7e00640 1 -- 172.21.15.100:0/1984770748 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d80cb060 con 0x7fa4d8159ca0 2024-08-17T02:45:45.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.429+0000 7fa4d7e00640 1 --2- 172.21.15.100:0/1984770748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4d8159ca0 0x7fa4d80ca360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009910 tx=0x7fa4c80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01826c1c2d4843 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:45.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.429+0000 7fa4d7400640 1 -- 172.21.15.100:0/1984770748 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c802ae40 con 0x7fa4d8159ca0 2024-08-17T02:45:45.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.429+0000 7fa4d7400640 1 -- 172.21.15.100:0/1984770748 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c8032440 con 0x7fa4d8159ca0 2024-08-17T02:45:45.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.429+0000 7fa4d7400640 1 -- 172.21.15.100:0/1984770748 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8032820 con 0x7fa4d8159ca0 2024-08-17T02:45:45.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.430+0000 7fa4dd400640 1 -- 172.21.15.100:0/1984770748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4d8159ca0 msgr2=0x7fa4d80ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:45.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.430+0000 7fa4dd400640 1 --2- 172.21.15.100:0/1984770748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4d8159ca0 0x7fa4d80ca360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009910 tx=0x7fa4c80091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.430+0000 7fa4dd400640 1 -- 172.21.15.100:0/1984770748 shutdown_connections 2024-08-17T02:45:45.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.430+0000 7fa4dd400640 1 --2- 172.21.15.100:0/1984770748 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4d80ca8a0 0x7fa4d80cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.430+0000 7fa4dd400640 1 --2- 172.21.15.100:0/1984770748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4d8159ca0 0x7fa4d80ca360 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.430+0000 7fa4dd400640 1 -- 172.21.15.100:0/1984770748 >> 172.21.15.100:0/1984770748 conn(0x7fa4d8098e00 msgr2=0x7fa4d806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:45.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.430+0000 7fa4dd400640 1 -- 172.21.15.100:0/1984770748 shutdown_connections 2024-08-17T02:45:45.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.430+0000 7fa4dd400640 1 -- 172.21.15.100:0/1984770748 wait complete. 2024-08-17T02:45:45.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.431+0000 7fa4dd400640 1 Processor -- start 2024-08-17T02:45:45.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.431+0000 7fa4dd400640 1 -- start start 2024-08-17T02:45:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.432+0000 7fa4dd400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4d80ca8a0 0x7fa4d815c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.432+0000 7fa4dd400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4d80ccad0 0x7fa4d80c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.432+0000 7fa4dd400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4d8159ca0 0x7fa4d8155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.432+0000 7fa4dd400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d815c9f0 con 0x7fa4d8159ca0 2024-08-17T02:45:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.432+0000 7fa4dd400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d815ccd0 con 0x7fa4d80ca8a0 2024-08-17T02:45:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.432+0000 7fa4dd400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d815cfb0 con 0x7fa4d80ccad0 2024-08-17T02:45:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.432+0000 7fa4dca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4d8159ca0 0x7fa4d8155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.432+0000 7fa4dca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4d8159ca0 0x7fa4d8155f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40466/0 (socket says 172.21.15.100:40466) 2024-08-17T02:45:45.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.432+0000 7fa4dca00640 1 -- 172.21.15.100:0/2669129372 learned_addr learned my addr 172.21.15.100:0/2669129372 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:45.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.432+0000 7fa4d7e00640 1 --2- 172.21.15.100:0/2669129372 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4d80ca8a0 0x7fa4d815c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:45.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.432+0000 7fa4cf400640 1 --2- 172.21.15.100:0/2669129372 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4d80ccad0 0x7fa4d80c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:45.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.433+0000 7fa4dca00640 1 -- 172.21.15.100:0/2669129372 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4d80ccad0 msgr2=0x7fa4d80c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:45.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.433+0000 7fa4dca00640 1 --2- 172.21.15.100:0/2669129372 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4d80ccad0 0x7fa4d80c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.433+0000 7fa4dca00640 1 -- 172.21.15.100:0/2669129372 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4d80ca8a0 msgr2=0x7fa4d815c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:45.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.433+0000 7fa4dca00640 1 --2- 172.21.15.100:0/2669129372 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4d80ca8a0 0x7fa4d815c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.433+0000 7fa4dca00640 1 -- 172.21.15.100:0/2669129372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c8009450 con 0x7fa4d8159ca0 2024-08-17T02:45:45.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.433+0000 7fa4cf400640 1 --2- 172.21.15.100:0/2669129372 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4d80ccad0 0x7fa4d80c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:45.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.433+0000 7fa4dca00640 1 --2- 172.21.15.100:0/2669129372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4d8159ca0 0x7fa4d8155f60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000c910 tx=0x7fa4d0001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:45.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.433+0000 7fa4cfe00640 1 -- 172.21.15.100:0/2669129372 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d000cea0 con 0x7fa4d8159ca0 2024-08-17T02:45:45.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.433+0000 7fa4cfe00640 1 -- 172.21.15.100:0/2669129372 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d0005d60 con 0x7fa4d8159ca0 2024-08-17T02:45:45.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.433+0000 7fa4dd400640 1 -- 172.21.15.100:0/2669129372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d815d290 con 0x7fa4d8159ca0 2024-08-17T02:45:45.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.433+0000 7fa4cfe00640 1 -- 172.21.15.100:0/2669129372 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d000a870 con 0x7fa4d8159ca0 2024-08-17T02:45:45.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.433+0000 7fa4dd400640 1 -- 172.21.15.100:0/2669129372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d81564a0 con 0x7fa4d8159ca0 2024-08-17T02:45:45.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.434+0000 7fa4dd400640 1 -- 172.21.15.100:0/2669129372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d8071050 con 0x7fa4d8159ca0 2024-08-17T02:45:45.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.435+0000 7fa4cfe00640 1 -- 172.21.15.100:0/2669129372 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa4d000aca0 con 0x7fa4d8159ca0 2024-08-17T02:45:45.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.436+0000 7fa4cfe00640 1 --2- 172.21.15.100:0/2669129372 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa4b4065150 0x7fa4b4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:45.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.436+0000 7fa4cfe00640 1 -- 172.21.15.100:0/2669129372 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4d0082130 con 0x7fa4d8159ca0 2024-08-17T02:45:45.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.436+0000 7fa4d7e00640 1 --2- 172.21.15.100:0/2669129372 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa4b4065150 0x7fa4b4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:45.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.437+0000 7fa4d7e00640 1 --2- 172.21.15.100:0/2669129372 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa4b4065150 0x7fa4b4067600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8034000 tx=0x7fa4c8032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:45.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.440+0000 7fa4cfe00640 1 -- 172.21.15.100:0/2669129372 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa4d00501d0 con 0x7fa4d8159ca0 2024-08-17T02:45:45.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.611+0000 7fa4dd400640 1 -- 172.21.15.100:0/2669129372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4d80cc6c0 con 0x7fa4d8159ca0 2024-08-17T02:45:45.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.612+0000 7fa4cfe00640 1 -- 172.21.15.100:0/2669129372 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fa4d00537f0 con 0x7fa4d8159ca0 2024-08-17T02:45:45.613 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:45.613 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:42.845503+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:45:39.036964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:45:40.232954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:45:45.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.614+0000 7fa4dd400640 1 -- 172.21.15.100:0/2669129372 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa4b4065150 msgr2=0x7fa4b4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:45.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.614+0000 7fa4dd400640 1 --2- 172.21.15.100:0/2669129372 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa4b4065150 0x7fa4b4067600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8034000 tx=0x7fa4c8032000 comp rx=0 tx=0).stop 2024-08-17T02:45:45.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.614+0000 7fa4dd400640 1 -- 172.21.15.100:0/2669129372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4d8159ca0 msgr2=0x7fa4d8155f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:45.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.614+0000 7fa4dd400640 1 --2- 172.21.15.100:0/2669129372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4d8159ca0 0x7fa4d8155f60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000c910 tx=0x7fa4d0001690 comp rx=0 tx=0).stop 2024-08-17T02:45:45.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.614+0000 7fa4dd400640 1 -- 172.21.15.100:0/2669129372 shutdown_connections 2024-08-17T02:45:45.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.614+0000 7fa4dd400640 1 --2- 172.21.15.100:0/2669129372 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa4b4065150 0x7fa4b4067600 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.614+0000 7fa4dd400640 1 --2- 172.21.15.100:0/2669129372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4d8159ca0 0x7fa4d8155f60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.614+0000 7fa4dd400640 1 --2- 172.21.15.100:0/2669129372 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4d80ccad0 0x7fa4d80c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.614+0000 7fa4dd400640 1 --2- 172.21.15.100:0/2669129372 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4d80ca8a0 0x7fa4d815c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.614+0000 7fa4dd400640 1 -- 172.21.15.100:0/2669129372 >> 172.21.15.100:0/2669129372 conn(0x7fa4d8098e00 msgr2=0x7fa4d80ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:45.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.614+0000 7fa4dd400640 1 -- 172.21.15.100:0/2669129372 shutdown_connections 2024-08-17T02:45:45.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.614+0000 7fa4dd400640 1 -- 172.21.15.100:0/2669129372 wait complete. 2024-08-17T02:45:45.630 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:45:45.631 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:45:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.778+0000 7f7f9d200640 1 Processor -- start 2024-08-17T02:45:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.778+0000 7f7f9d200640 1 -- start start 2024-08-17T02:45:45.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.779+0000 7f7f9d200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7f98155a20 0x7f7f980adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:45.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.779+0000 7f7f9d200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f98156670 con 0x7f7f98155df0 2024-08-17T02:45:45.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.779+0000 7f7f9d200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f9806e5e0 con 0x7f7f9806df00 2024-08-17T02:45:45.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.779+0000 7f7f9d200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f980b0350 con 0x7f7f98155a20 2024-08-17T02:45:45.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.779+0000 7f7f95e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7f98155a20 0x7f7f980adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:45.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.779+0000 7f7f95400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7f98155df0 0x7f7f9806d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44934/0 (socket says 172.21.15.100:44934) 2024-08-17T02:45:45.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.779+0000 7f7f95400640 1 -- 172.21.15.100:0/3369337551 learned_addr learned my addr 172.21.15.100:0/3369337551 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:45.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.779+0000 7f7f95e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7f98155a20 0x7f7f980adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40480/0 (socket says 172.21.15.100:40480) 2024-08-17T02:45:45.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.780+0000 7f7f95e00640 1 -- 172.21.15.100:0/3369337551 >> v1:172.21.15.123:6789/0 conn(0x7f7f9806df00 legacy=0x7f7f98156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:45.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.780+0000 7f7f95e00640 1 -- 172.21.15.100:0/3369337551 >> v1:172.21.15.100:6789/0 conn(0x7f7f98155df0 legacy=0x7f7f9806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:45.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.780+0000 7f7f95e00640 1 -- 172.21.15.100:0/3369337551 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9806e8c0 con 0x7f7f98155a20 2024-08-17T02:45:45.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.780+0000 7f7f94a00640 1 -- 172.21.15.100:0/3369337551 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 272489473 0 0) 0x7f7f98156670 con 0x7f7f98155df0 2024-08-17T02:45:45.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.781+0000 7f7f95e00640 1 --2- 172.21.15.100:0/3369337551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f98155a20 0x7f7f980adf10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800baf0 tx=0x7f7f8800b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee276124fe4075e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:45.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.781+0000 7f7f94a00640 1 -- 172.21.15.100:0/3369337551 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f880325f0 con 0x7f7f98155a20 2024-08-17T02:45:45.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.781+0000 7f7f94a00640 1 -- 172.21.15.100:0/3369337551 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f88032750 con 0x7f7f98155a20 2024-08-17T02:45:45.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.781+0000 7f7f94a00640 1 -- 172.21.15.100:0/3369337551 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88032af0 con 0x7f7f98155a20 2024-08-17T02:45:45.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.782+0000 7f7f9d200640 1 -- 172.21.15.100:0/3369337551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f98155a20 msgr2=0x7f7f980adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:45.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.782+0000 7f7f9d200640 1 --2- 172.21.15.100:0/3369337551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f98155a20 0x7f7f980adf10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800baf0 tx=0x7f7f8800b3b0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.782+0000 7f7f9d200640 1 -- 172.21.15.100:0/3369337551 shutdown_connections 2024-08-17T02:45:45.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.782+0000 7f7f9d200640 1 --2- 172.21.15.100:0/3369337551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f98155a20 0x7f7f980adf10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.782+0000 7f7f9d200640 1 -- 172.21.15.100:0/3369337551 >> 172.21.15.100:0/3369337551 conn(0x7f7f980cb9b0 msgr2=0x7f7f980cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.782+0000 7f7f9d200640 1 -- 172.21.15.100:0/3369337551 shutdown_connections 2024-08-17T02:45:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.782+0000 7f7f9d200640 1 -- 172.21.15.100:0/3369337551 wait complete. 2024-08-17T02:45:45.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.783+0000 7f7f9d200640 1 Processor -- start 2024-08-17T02:45:45.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.783+0000 7f7f9d200640 1 -- start start 2024-08-17T02:45:45.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.784+0000 7f7f9d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9806df00 0x7f7f980c09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:45.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.784+0000 7f7f9d200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7f98155a20 0x7f7f9814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:45.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.784+0000 7f7f9d200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f98155df0 0x7f7f980ac520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:45.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.784+0000 7f7f9d200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f98169210 con 0x7f7f9806df00 2024-08-17T02:45:45.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.784+0000 7f7f9d200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9816a030 con 0x7f7f98155df0 2024-08-17T02:45:45.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.784+0000 7f7f9d200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9814fb20 con 0x7f7f98155a20 2024-08-17T02:45:45.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.784+0000 7f7f95e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9806df00 0x7f7f980c09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.784+0000 7f7f95e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9806df00 0x7f7f980c09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40488/0 (socket says 172.21.15.100:40488) 2024-08-17T02:45:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.784+0000 7f7f95e00640 1 -- 172.21.15.100:0/2069841937 learned_addr learned my addr 172.21.15.100:0/2069841937 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.784+0000 7f7f96800640 1 --2- 172.21.15.100:0/2069841937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f98155df0 0x7f7f980ac520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.784+0000 7f7f95400640 1 --2- 172.21.15.100:0/2069841937 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7f98155a20 0x7f7f9814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.785+0000 7f7f95e00640 1 -- 172.21.15.100:0/2069841937 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7f98155a20 msgr2=0x7f7f9814f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.785+0000 7f7f95e00640 1 --2- 172.21.15.100:0/2069841937 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7f98155a20 0x7f7f9814f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.785+0000 7f7f95e00640 1 -- 172.21.15.100:0/2069841937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f98155df0 msgr2=0x7f7f980ac520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.785+0000 7f7f95e00640 1 --2- 172.21.15.100:0/2069841937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f98155df0 0x7f7f980ac520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.785+0000 7f7f95e00640 1 -- 172.21.15.100:0/2069841937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8800b630 con 0x7f7f9806df00 2024-08-17T02:45:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.785+0000 7f7f95e00640 1 --2- 172.21.15.100:0/2069841937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9806df00 0x7f7f980c09a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800baf0 tx=0x7f7f8803a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.785+0000 7f7f8d600640 1 -- 172.21.15.100:0/2069841937 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f880339e0 con 0x7f7f9806df00 2024-08-17T02:45:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.785+0000 7f7f8d600640 1 -- 172.21.15.100:0/2069841937 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f88033b60 con 0x7f7f9806df00 2024-08-17T02:45:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.785+0000 7f7f8d600640 1 -- 172.21.15.100:0/2069841937 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8803c400 con 0x7f7f9806df00 2024-08-17T02:45:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.785+0000 7f7f9d200640 1 -- 172.21.15.100:0/2069841937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f98169420 con 0x7f7f9806df00 2024-08-17T02:45:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.786+0000 7f7f9d200640 1 -- 172.21.15.100:0/2069841937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f981699e0 con 0x7f7f9806df00 2024-08-17T02:45:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.787+0000 7f7f9d200640 1 -- 172.21.15.100:0/2069841937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f98064db0 con 0x7f7f9806df00 2024-08-17T02:45:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.787+0000 7f7f8d600640 1 -- 172.21.15.100:0/2069841937 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7f8803c830 con 0x7f7f9806df00 2024-08-17T02:45:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.788+0000 7f7f8d600640 1 --2- 172.21.15.100:0/2069841937 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7f78065150 0x7f7f78067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.788+0000 7f7f8d600640 1 -- 172.21.15.100:0/2069841937 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7f880a2ff0 con 0x7f7f9806df00 2024-08-17T02:45:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.789+0000 7f7f95400640 1 --2- 172.21.15.100:0/2069841937 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7f78065150 0x7f7f78067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.789+0000 7f7f95400640 1 --2- 172.21.15.100:0/2069841937 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7f78065150 0x7f7f78067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7f980c2280 tx=0x7f7f84007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:45.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.792+0000 7f7f8d600640 1 -- 172.21.15.100:0/2069841937 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7f88071120 con 0x7f7f9806df00 2024-08-17T02:45:45.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.964+0000 7f7f9d200640 1 -- 172.21.15.100:0/2069841937 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7f9806dac0 con 0x7f7f78065150 2024-08-17T02:45:45.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.972+0000 7f7f8d600640 1 -- 172.21.15.100:0/2069841937 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264590 (secure 0 0 0) 0x7f7f9806dac0 con 0x7f7f78065150 2024-08-17T02:45:45.976 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:45.978 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-08-17T02:45:45.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.976+0000 7f7f9d200640 1 -- 172.21.15.100:0/2069841937 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7f78065150 msgr2=0x7f7f78067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:45.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.976+0000 7f7f9d200640 1 --2- 172.21.15.100:0/2069841937 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7f78065150 0x7f7f78067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7f980c2280 tx=0x7f7f84007ea0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.976+0000 7f7f9d200640 1 -- 172.21.15.100:0/2069841937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9806df00 msgr2=0x7f7f980c09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:45.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.976+0000 7f7f9d200640 1 --2- 172.21.15.100:0/2069841937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9806df00 0x7f7f980c09a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800baf0 tx=0x7f7f8803a000 comp rx=0 tx=0).stop 2024-08-17T02:45:45.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.976+0000 7f7f9d200640 1 -- 172.21.15.100:0/2069841937 shutdown_connections 2024-08-17T02:45:45.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.976+0000 7f7f9d200640 1 --2- 172.21.15.100:0/2069841937 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7f78065150 0x7f7f78067600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.976+0000 7f7f9d200640 1 --2- 172.21.15.100:0/2069841937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f98155df0 0x7f7f980ac520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.976+0000 7f7f9d200640 1 --2- 172.21.15.100:0/2069841937 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7f98155a20 0x7f7f9814f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.976+0000 7f7f9d200640 1 --2- 172.21.15.100:0/2069841937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9806df00 0x7f7f980c09a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:45.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.976+0000 7f7f9d200640 1 -- 172.21.15.100:0/2069841937 >> 172.21.15.100:0/2069841937 conn(0x7f7f980cb9b0 msgr2=0x7f7f981504b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:45.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.976+0000 7f7f9d200640 1 -- 172.21.15.100:0/2069841937 shutdown_connections 2024-08-17T02:45:45.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:45.976+0000 7f7f9d200640 1 -- 172.21.15.100:0/2069841937 wait complete. 2024-08-17T02:45:45.991 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-08-17T02:45:45.089902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381984,"kb_used_data":2924,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592736,"statfs":{"total":773094113280,"available":770654961664,"internally_reserved":0,"allocated":2994176,"data_stored":1782148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.268781"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.879971+0000","last_change":"2024-08-17T02:45:41.879971+0000","last_active":"2024-08-17T02:45:41.879971+0000","last_peered":"2024-08-17T02:45:41.879971+0000","last_clean":"2024-08-17T02:45:41.879971+0000","last_became_active":"2024-08-17T02:45:41.879691+0000","last_became_peered":"2024-08-17T02:45:41.879691+0000","last_unstale":"2024-08-17T02:45:41.879971+0000","last_undegraded":"2024-08-17T02:45:41.879971+0000","last_fullsized":"2024-08-17T02:45:41.879971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:02:08.258895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.869545+0000","last_change":"2024-08-17T02:45:41.863383+0000","last_active":"2024-08-17T02:45:41.869545+0000","last_peered":"2024-08-17T02:45:41.869545+0000","last_clean":"2024-08-17T02:45:41.869545+0000","last_became_active":"2024-08-17T02:45:41.863151+0000","last_became_peered":"2024-08-17T02:45:41.863151+0000","last_unstale":"2024-08-17T02:45:41.869545+0000","last_undegraded":"2024-08-17T02:45:41.869545+0000","last_fullsized":"2024-08-17T02:45:41.869545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:09.195225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.859813+0000","last_change":"2024-08-17T02:45:41.859813+0000","last_active":"2024-08-17T02:45:41.859813+0000","last_peered":"2024-08-17T02:45:41.859813+0000","last_clean":"2024-08-17T02:45:41.859813+0000","last_became_active":"2024-08-17T02:45:41.859526+0000","last_became_peered":"2024-08-17T02:45:41.859526+0000","last_unstale":"2024-08-17T02:45:41.859813+0000","last_undegraded":"2024-08-17T02:45:41.859813+0000","last_fullsized":"2024-08-17T02:45:41.859813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:07.343258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.855298+0000","last_change":"2024-08-17T02:45:41.855298+0000","last_active":"2024-08-17T02:45:41.855298+0000","last_peered":"2024-08-17T02:45:41.855298+0000","last_clean":"2024-08-17T02:45:41.855298+0000","last_became_active":"2024-08-17T02:45:41.854637+0000","last_became_peered":"2024-08-17T02:45:41.854637+0000","last_unstale":"2024-08-17T02:45:41.855298+0000","last_undegraded":"2024-08-17T02:45:41.855298+0000","last_fullsized":"2024-08-17T02:45:41.855298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:02.143166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.867785+0000","last_change":"2024-08-17T02:45:41.867785+0000","last_active":"2024-08-17T02:45:41.867785+0000","last_peered":"2024-08-17T02:45:41.867785+0000","last_clean":"2024-08-17T02:45:41.867785+0000","last_became_active":"2024-08-17T02:45:41.866024+0000","last_became_peered":"2024-08-17T02:45:41.866024+0000","last_unstale":"2024-08-17T02:45:41.867785+0000","last_undegraded":"2024-08-17T02:45:41.867785+0000","last_fullsized":"2024-08-17T02:45:41.867785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:27.873599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.855424+0000","last_change":"2024-08-17T02:45:41.855424+0000","last_active":"2024-08-17T02:45:41.855424+0000","last_peered":"2024-08-17T02:45:41.855424+0000","last_clean":"2024-08-17T02:45:41.855424+0000","last_became_active":"2024-08-17T02:45:41.854196+0000","last_became_peered":"2024-08-17T02:45:41.854196+0000","last_unstale":"2024-08-17T02:45:41.855424+0000","last_undegraded":"2024-08-17T02:45:41.855424+0000","last_fullsized":"2024-08-17T02:45:41.855424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:01.344799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.875455+0000","last_change":"2024-08-17T02:45:41.875455+0000","last_active":"2024-08-17T02:45:41.875455+0000","last_peered":"2024-08-17T02:45:41.875455+0000","last_clean":"2024-08-17T02:45:41.875455+0000","last_became_active":"2024-08-17T02:45:41.874847+0000","last_became_peered":"2024-08-17T02:45:41.874847+0000","last_unstale":"2024-08-17T02:45:41.875455+0000","last_undegraded":"2024-08-17T02:45:41.875455+0000","last_fullsized":"2024-08-17T02:45:41.875455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:51.387674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.849358+0000","last_change":"2024-08-17T02:45:41.845108+0000","last_active":"2024-08-17T02:45:41.849358+0000","last_peered":"2024-08-17T02:45:41.849358+0000","last_clean":"2024-08-17T02:45:41.849358+0000","last_became_active":"2024-08-17T02:45:41.844922+0000","last_became_peered":"2024-08-17T02:45:41.844922+0000","last_unstale":"2024-08-17T02:45:41.849358+0000","last_undegraded":"2024-08-17T02:45:41.849358+0000","last_fullsized":"2024-08-17T02:45:41.849358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:13.016129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.879469+0000","last_change":"2024-08-17T02:45:41.879469+0000","last_active":"2024-08-17T02:45:41.879469+0000","last_peered":"2024-08-17T02:45:41.879469+0000","last_clean":"2024-08-17T02:45:41.879469+0000","last_became_active":"2024-08-17T02:45:41.879191+0000","last_became_peered":"2024-08-17T02:45:41.879191+0000","last_unstale":"2024-08-17T02:45:41.879469+0000","last_undegraded":"2024-08-17T02:45:41.879469+0000","last_fullsized":"2024-08-17T02:45:41.879469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:36.351108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.869635+0000","last_change":"2024-08-17T02:45:41.865511+0000","last_active":"2024-08-17T02:45:41.869635+0000","last_peered":"2024-08-17T02:45:41.869635+0000","last_clean":"2024-08-17T02:45:41.869635+0000","last_became_active":"2024-08-17T02:45:41.865229+0000","last_became_peered":"2024-08-17T02:45:41.865229+0000","last_unstale":"2024-08-17T02:45:41.869635+0000","last_undegraded":"2024-08-17T02:45:41.869635+0000","last_fullsized":"2024-08-17T02:45:41.869635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:24.850532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.869380+0000","last_change":"2024-08-17T02:45:41.867609+0000","last_active":"2024-08-17T02:45:41.869380+0000","last_peered":"2024-08-17T02:45:41.869380+0000","last_clean":"2024-08-17T02:45:41.869380+0000","last_became_active":"2024-08-17T02:45:41.867267+0000","last_became_peered":"2024-08-17T02:45:41.867267+0000","last_unstale":"2024-08-17T02:45:41.869380+0000","last_undegraded":"2024-08-17T02:45:41.869380+0000","last_fullsized":"2024-08-17T02:45:41.869380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:36:25.246538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.878878+0000","last_change":"2024-08-17T02:45:41.878878+0000","last_active":"2024-08-17T02:45:41.878878+0000","last_peered":"2024-08-17T02:45:41.878878+0000","last_clean":"2024-08-17T02:45:41.878878+0000","last_became_active":"2024-08-17T02:45:41.876755+0000","last_became_peered":"2024-08-17T02:45:41.876755+0000","last_unstale":"2024-08-17T02:45:41.878878+0000","last_undegraded":"2024-08-17T02:45:41.878878+0000","last_fullsized":"2024-08-17T02:45:41.878878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:15.533277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.875157+0000","last_change":"2024-08-17T02:45:41.870345+0000","last_active":"2024-08-17T02:45:41.875157+0000","last_peered":"2024-08-17T02:45:41.875157+0000","last_clean":"2024-08-17T02:45:41.875157+0000","last_became_active":"2024-08-17T02:45:41.869995+0000","last_became_peered":"2024-08-17T02:45:41.869995+0000","last_unstale":"2024-08-17T02:45:41.875157+0000","last_undegraded":"2024-08-17T02:45:41.875157+0000","last_fullsized":"2024-08-17T02:45:41.875157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:27.590592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.865428+0000","last_change":"2024-08-17T02:45:41.865428+0000","last_active":"2024-08-17T02:45:41.865428+0000","last_peered":"2024-08-17T02:45:41.865428+0000","last_clean":"2024-08-17T02:45:41.865428+0000","last_became_active":"2024-08-17T02:45:41.865184+0000","last_became_peered":"2024-08-17T02:45:41.865184+0000","last_unstale":"2024-08-17T02:45:41.865428+0000","last_undegraded":"2024-08-17T02:45:41.865428+0000","last_fullsized":"2024-08-17T02:45:41.865428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:00.504734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.867141+0000","last_change":"2024-08-17T02:45:41.862050+0000","last_active":"2024-08-17T02:45:41.867141+0000","last_peered":"2024-08-17T02:45:41.867141+0000","last_clean":"2024-08-17T02:45:41.867141+0000","last_became_active":"2024-08-17T02:45:41.861754+0000","last_became_peered":"2024-08-17T02:45:41.861754+0000","last_unstale":"2024-08-17T02:45:41.867141+0000","last_undegraded":"2024-08-17T02:45:41.867141+0000","last_fullsized":"2024-08-17T02:45:41.867141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:31:57.128164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.861246+0000","last_change":"2024-08-17T02:45:41.861246+0000","last_active":"2024-08-17T02:45:41.861246+0000","last_peered":"2024-08-17T02:45:41.861246+0000","last_clean":"2024-08-17T02:45:41.861246+0000","last_became_active":"2024-08-17T02:45:41.860955+0000","last_became_peered":"2024-08-17T02:45:41.860955+0000","last_unstale":"2024-08-17T02:45:41.861246+0000","last_undegraded":"2024-08-17T02:45:41.861246+0000","last_fullsized":"2024-08-17T02:45:41.861246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:13.016129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.863642+0000","last_change":"2024-08-17T02:45:41.863642+0000","last_active":"2024-08-17T02:45:41.863642+0000","last_peered":"2024-08-17T02:45:41.863642+0000","last_clean":"2024-08-17T02:45:41.863642+0000","last_became_active":"2024-08-17T02:45:41.863379+0000","last_became_peered":"2024-08-17T02:45:41.863379+0000","last_unstale":"2024-08-17T02:45:41.863642+0000","last_undegraded":"2024-08-17T02:45:41.863642+0000","last_fullsized":"2024-08-17T02:45:41.863642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:26.094951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.877544+0000","last_change":"2024-08-17T02:45:41.872075+0000","last_active":"2024-08-17T02:45:41.877544+0000","last_peered":"2024-08-17T02:45:41.877544+0000","last_clean":"2024-08-17T02:45:41.877544+0000","last_became_active":"2024-08-17T02:45:41.871439+0000","last_became_peered":"2024-08-17T02:45:41.871439+0000","last_unstale":"2024-08-17T02:45:41.877544+0000","last_undegraded":"2024-08-17T02:45:41.877544+0000","last_fullsized":"2024-08-17T02:45:41.877544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:15.533277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.866609+0000","last_change":"2024-08-17T02:45:41.866609+0000","last_active":"2024-08-17T02:45:41.866609+0000","last_peered":"2024-08-17T02:45:41.866609+0000","last_clean":"2024-08-17T02:45:41.866609+0000","last_became_active":"2024-08-17T02:45:41.866323+0000","last_became_peered":"2024-08-17T02:45:41.866323+0000","last_unstale":"2024-08-17T02:45:41.866609+0000","last_undegraded":"2024-08-17T02:45:41.866609+0000","last_fullsized":"2024-08-17T02:45:41.866609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:52.201878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.884941+0000","last_change":"2024-08-17T02:45:41.881550+0000","last_active":"2024-08-17T02:45:41.884941+0000","last_peered":"2024-08-17T02:45:41.884941+0000","last_clean":"2024-08-17T02:45:41.884941+0000","last_became_active":"2024-08-17T02:45:41.881022+0000","last_became_peered":"2024-08-17T02:45:41.881022+0000","last_unstale":"2024-08-17T02:45:41.884941+0000","last_undegraded":"2024-08-17T02:45:41.884941+0000","last_fullsized":"2024-08-17T02:45:41.884941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:50:11.095464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.868514+0000","last_change":"2024-08-17T02:45:41.868514+0000","last_active":"2024-08-17T02:45:41.868514+0000","last_peered":"2024-08-17T02:45:41.868514+0000","last_clean":"2024-08-17T02:45:41.868514+0000","last_became_active":"2024-08-17T02:45:41.868230+0000","last_became_peered":"2024-08-17T02:45:41.868230+0000","last_unstale":"2024-08-17T02:45:41.868514+0000","last_undegraded":"2024-08-17T02:45:41.868514+0000","last_fullsized":"2024-08-17T02:45:41.868514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:31:57.128164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.860030+0000","last_change":"2024-08-17T02:45:41.860030+0000","last_active":"2024-08-17T02:45:41.860030+0000","last_peered":"2024-08-17T02:45:41.860030+0000","last_clean":"2024-08-17T02:45:41.860030+0000","last_became_active":"2024-08-17T02:45:41.859373+0000","last_became_peered":"2024-08-17T02:45:41.859373+0000","last_unstale":"2024-08-17T02:45:41.860030+0000","last_undegraded":"2024-08-17T02:45:41.860030+0000","last_fullsized":"2024-08-17T02:45:41.860030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:44:02.932481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.867355+0000","last_change":"2024-08-17T02:45:41.862826+0000","last_active":"2024-08-17T02:45:41.867355+0000","last_peered":"2024-08-17T02:45:41.867355+0000","last_clean":"2024-08-17T02:45:41.867355+0000","last_became_active":"2024-08-17T02:45:41.862601+0000","last_became_peered":"2024-08-17T02:45:41.862601+0000","last_unstale":"2024-08-17T02:45:41.867355+0000","last_undegraded":"2024-08-17T02:45:41.867355+0000","last_fullsized":"2024-08-17T02:45:41.867355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:31:57.128164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.853293+0000","last_change":"2024-08-17T02:45:41.853293+0000","last_active":"2024-08-17T02:45:41.853293+0000","last_peered":"2024-08-17T02:45:41.853293+0000","last_clean":"2024-08-17T02:45:41.853293+0000","last_became_active":"2024-08-17T02:45:41.853030+0000","last_became_peered":"2024-08-17T02:45:41.853030+0000","last_unstale":"2024-08-17T02:45:41.853293+0000","last_undegraded":"2024-08-17T02:45:41.853293+0000","last_fullsized":"2024-08-17T02:45:41.853293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:10:57.188283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.863593+0000","last_change":"2024-08-17T02:45:41.858360+0000","last_active":"2024-08-17T02:45:41.863593+0000","last_peered":"2024-08-17T02:45:41.863593+0000","last_clean":"2024-08-17T02:45:41.863593+0000","last_became_active":"2024-08-17T02:45:41.858129+0000","last_became_peered":"2024-08-17T02:45:41.858129+0000","last_unstale":"2024-08-17T02:45:41.863593+0000","last_undegraded":"2024-08-17T02:45:41.863593+0000","last_fullsized":"2024-08-17T02:45:41.863593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:00.504734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886048+0000","last_change":"2024-08-17T02:45:41.882941+0000","last_active":"2024-08-17T02:45:41.886048+0000","last_peered":"2024-08-17T02:45:41.886048+0000","last_clean":"2024-08-17T02:45:41.886048+0000","last_became_active":"2024-08-17T02:45:41.880910+0000","last_became_peered":"2024-08-17T02:45:41.880910+0000","last_unstale":"2024-08-17T02:45:41.886048+0000","last_undegraded":"2024-08-17T02:45:41.886048+0000","last_fullsized":"2024-08-17T02:45:41.886048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:35.831054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.859157+0000","last_change":"2024-08-17T02:45:41.855434+0000","last_active":"2024-08-17T02:45:41.859157+0000","last_peered":"2024-08-17T02:45:41.859157+0000","last_clean":"2024-08-17T02:45:41.859157+0000","last_became_active":"2024-08-17T02:45:41.855036+0000","last_became_peered":"2024-08-17T02:45:41.855036+0000","last_unstale":"2024-08-17T02:45:41.859157+0000","last_undegraded":"2024-08-17T02:45:41.859157+0000","last_fullsized":"2024-08-17T02:45:41.859157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:06.130481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.878219+0000","last_change":"2024-08-17T02:45:41.875037+0000","last_active":"2024-08-17T02:45:41.878219+0000","last_peered":"2024-08-17T02:45:41.878219+0000","last_clean":"2024-08-17T02:45:41.878219+0000","last_became_active":"2024-08-17T02:45:41.874745+0000","last_became_peered":"2024-08-17T02:45:41.874745+0000","last_unstale":"2024-08-17T02:45:41.878219+0000","last_undegraded":"2024-08-17T02:45:41.878219+0000","last_fullsized":"2024-08-17T02:45:41.878219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:07.343258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.860577+0000","last_change":"2024-08-17T02:45:41.860577+0000","last_active":"2024-08-17T02:45:41.860577+0000","last_peered":"2024-08-17T02:45:41.860577+0000","last_clean":"2024-08-17T02:45:41.860577+0000","last_became_active":"2024-08-17T02:45:41.857944+0000","last_became_peered":"2024-08-17T02:45:41.857944+0000","last_unstale":"2024-08-17T02:45:41.860577+0000","last_undegraded":"2024-08-17T02:45:41.860577+0000","last_fullsized":"2024-08-17T02:45:41.860577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:06.130481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.852863+0000","last_change":"2024-08-17T02:45:41.852863+0000","last_active":"2024-08-17T02:45:41.852863+0000","last_peered":"2024-08-17T02:45:41.852863+0000","last_clean":"2024-08-17T02:45:41.852863+0000","last_became_active":"2024-08-17T02:45:41.852578+0000","last_became_peered":"2024-08-17T02:45:41.852578+0000","last_unstale":"2024-08-17T02:45:41.852863+0000","last_undegraded":"2024-08-17T02:45:41.852863+0000","last_fullsized":"2024-08-17T02:45:41.852863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:27.590592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.851184+0000","last_change":"2024-08-17T02:45:41.846025+0000","last_active":"2024-08-17T02:45:41.851184+0000","last_peered":"2024-08-17T02:45:41.851184+0000","last_clean":"2024-08-17T02:45:41.851184+0000","last_became_active":"2024-08-17T02:45:41.845713+0000","last_became_peered":"2024-08-17T02:45:41.845713+0000","last_unstale":"2024-08-17T02:45:41.851184+0000","last_undegraded":"2024-08-17T02:45:41.851184+0000","last_fullsized":"2024-08-17T02:45:41.851184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:21.073718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.874435+0000","last_change":"2024-08-17T02:45:41.870783+0000","last_active":"2024-08-17T02:45:41.874435+0000","last_peered":"2024-08-17T02:45:41.874435+0000","last_clean":"2024-08-17T02:45:41.874435+0000","last_became_active":"2024-08-17T02:45:41.870550+0000","last_became_peered":"2024-08-17T02:45:41.870550+0000","last_unstale":"2024-08-17T02:45:41.874435+0000","last_undegraded":"2024-08-17T02:45:41.874435+0000","last_fullsized":"2024-08-17T02:45:41.874435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:55:47.666421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.860580+0000","last_change":"2024-08-17T02:45:41.860580+0000","last_active":"2024-08-17T02:45:41.860580+0000","last_peered":"2024-08-17T02:45:41.860580+0000","last_clean":"2024-08-17T02:45:41.860580+0000","last_became_active":"2024-08-17T02:45:41.860364+0000","last_became_peered":"2024-08-17T02:45:41.860364+0000","last_unstale":"2024-08-17T02:45:41.860580+0000","last_undegraded":"2024-08-17T02:45:41.860580+0000","last_fullsized":"2024-08-17T02:45:41.860580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:44.911480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.878927+0000","last_change":"2024-08-17T02:45:40.856192+0000","last_active":"2024-08-17T02:45:41.878927+0000","last_peered":"2024-08-17T02:45:41.878927+0000","last_clean":"2024-08-17T02:45:41.878927+0000","last_became_active":"2024-08-17T02:45:40.856008+0000","last_became_peered":"2024-08-17T02:45:40.856008+0000","last_unstale":"2024-08-17T02:45:41.878927+0000","last_undegraded":"2024-08-17T02:45:41.878927+0000","last_fullsized":"2024-08-17T02:45:41.878927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:03.324359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.860685+0000","last_change":"2024-08-17T02:45:41.860685+0000","last_active":"2024-08-17T02:45:41.860685+0000","last_peered":"2024-08-17T02:45:41.860685+0000","last_clean":"2024-08-17T02:45:41.860685+0000","last_became_active":"2024-08-17T02:45:41.858422+0000","last_became_peered":"2024-08-17T02:45:41.858422+0000","last_unstale":"2024-08-17T02:45:41.860685+0000","last_undegraded":"2024-08-17T02:45:41.860685+0000","last_fullsized":"2024-08-17T02:45:41.860685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:25.446485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.883276+0000","last_change":"2024-08-17T02:45:40.850702+0000","last_active":"2024-08-17T02:45:41.883276+0000","last_peered":"2024-08-17T02:45:41.883276+0000","last_clean":"2024-08-17T02:45:41.883276+0000","last_became_active":"2024-08-17T02:45:40.850384+0000","last_became_peered":"2024-08-17T02:45:40.850384+0000","last_unstale":"2024-08-17T02:45:41.883276+0000","last_undegraded":"2024-08-17T02:45:41.883276+0000","last_fullsized":"2024-08-17T02:45:41.883276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:38:15.702366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.840461+0000","last_change":"2024-08-17T02:45:40.847576+0000","last_active":"2024-08-17T02:45:41.840461+0000","last_peered":"2024-08-17T02:45:41.840461+0000","last_clean":"2024-08-17T02:45:41.840461+0000","last_became_active":"2024-08-17T02:45:40.847319+0000","last_became_peered":"2024-08-17T02:45:40.847319+0000","last_unstale":"2024-08-17T02:45:41.840461+0000","last_undegraded":"2024-08-17T02:45:41.840461+0000","last_fullsized":"2024-08-17T02:45:41.840461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:19.561224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.863488+0000","last_change":"2024-08-17T02:45:41.857865+0000","last_active":"2024-08-17T02:45:41.863488+0000","last_peered":"2024-08-17T02:45:41.863488+0000","last_clean":"2024-08-17T02:45:41.863488+0000","last_became_active":"2024-08-17T02:45:41.857585+0000","last_became_peered":"2024-08-17T02:45:41.857585+0000","last_unstale":"2024-08-17T02:45:41.863488+0000","last_undegraded":"2024-08-17T02:45:41.863488+0000","last_fullsized":"2024-08-17T02:45:41.863488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:10:57.188283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:45:40.857373+0000","last_change":"2024-08-17T02:45:40.853724+0000","last_active":"2024-08-17T02:45:40.857373+0000","last_peered":"2024-08-17T02:45:40.857373+0000","last_clean":"2024-08-17T02:45:40.857373+0000","last_became_active":"2024-08-17T02:45:40.848438+0000","last_became_peered":"2024-08-17T02:45:40.848438+0000","last_unstale":"2024-08-17T02:45:40.857373+0000","last_undegraded":"2024-08-17T02:45:40.857373+0000","last_fullsized":"2024-08-17T02:45:40.857373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:52:22.103135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.859791+0000","last_change":"2024-08-17T02:45:41.856281+0000","last_active":"2024-08-17T02:45:41.859791+0000","last_peered":"2024-08-17T02:45:41.859791+0000","last_clean":"2024-08-17T02:45:41.859791+0000","last_became_active":"2024-08-17T02:45:41.855982+0000","last_became_peered":"2024-08-17T02:45:41.855982+0000","last_unstale":"2024-08-17T02:45:41.859791+0000","last_undegraded":"2024-08-17T02:45:41.859791+0000","last_fullsized":"2024-08-17T02:45:41.859791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:10:57.188283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.865649+0000","last_change":"2024-08-17T02:45:40.856916+0000","last_active":"2024-08-17T02:45:41.865649+0000","last_peered":"2024-08-17T02:45:41.865649+0000","last_clean":"2024-08-17T02:45:41.865649+0000","last_became_active":"2024-08-17T02:45:40.856729+0000","last_became_peered":"2024-08-17T02:45:40.856729+0000","last_unstale":"2024-08-17T02:45:41.865649+0000","last_undegraded":"2024-08-17T02:45:41.865649+0000","last_fullsized":"2024-08-17T02:45:41.865649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:27.561597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.876111+0000","last_change":"2024-08-17T02:45:41.876111+0000","last_active":"2024-08-17T02:45:41.876111+0000","last_peered":"2024-08-17T02:45:41.876111+0000","last_clean":"2024-08-17T02:45:41.876111+0000","last_became_active":"2024-08-17T02:45:41.872909+0000","last_became_peered":"2024-08-17T02:45:41.872909+0000","last_unstale":"2024-08-17T02:45:41.876111+0000","last_undegraded":"2024-08-17T02:45:41.876111+0000","last_fullsized":"2024-08-17T02:45:41.876111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:37.395022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:45:40.862923+0000","last_change":"2024-08-17T02:45:40.861062+0000","last_active":"2024-08-17T02:45:40.862923+0000","last_peered":"2024-08-17T02:45:40.862923+0000","last_clean":"2024-08-17T02:45:40.862923+0000","last_became_active":"2024-08-17T02:45:40.860760+0000","last_became_peered":"2024-08-17T02:45:40.860760+0000","last_unstale":"2024-08-17T02:45:40.862923+0000","last_undegraded":"2024-08-17T02:45:40.862923+0000","last_fullsized":"2024-08-17T02:45:40.862923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:19.561224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.863001+0000","last_change":"2024-08-17T02:45:41.863001+0000","last_active":"2024-08-17T02:45:41.863001+0000","last_peered":"2024-08-17T02:45:41.863001+0000","last_clean":"2024-08-17T02:45:41.863001+0000","last_became_active":"2024-08-17T02:45:41.862662+0000","last_became_peered":"2024-08-17T02:45:41.862662+0000","last_unstale":"2024-08-17T02:45:41.863001+0000","last_undegraded":"2024-08-17T02:45:41.863001+0000","last_fullsized":"2024-08-17T02:45:41.863001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:10:57.188283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.889508+0000","last_change":"2024-08-17T02:45:40.853331+0000","last_active":"2024-08-17T02:45:41.889508+0000","last_peered":"2024-08-17T02:45:41.889508+0000","last_clean":"2024-08-17T02:45:41.889508+0000","last_became_active":"2024-08-17T02:45:40.853029+0000","last_became_peered":"2024-08-17T02:45:40.853029+0000","last_unstale":"2024-08-17T02:45:41.889508+0000","last_undegraded":"2024-08-17T02:45:41.889508+0000","last_fullsized":"2024-08-17T02:45:41.889508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:43.905610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.872156+0000","last_change":"2024-08-17T02:45:41.872156+0000","last_active":"2024-08-17T02:45:41.872156+0000","last_peered":"2024-08-17T02:45:41.872156+0000","last_clean":"2024-08-17T02:45:41.872156+0000","last_became_active":"2024-08-17T02:45:41.867463+0000","last_became_peered":"2024-08-17T02:45:41.867463+0000","last_unstale":"2024-08-17T02:45:41.872156+0000","last_undegraded":"2024-08-17T02:45:41.872156+0000","last_fullsized":"2024-08-17T02:45:41.872156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:21.073718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886214+0000","last_change":"2024-08-17T02:45:40.843999+0000","last_active":"2024-08-17T02:45:41.886214+0000","last_peered":"2024-08-17T02:45:41.886214+0000","last_clean":"2024-08-17T02:45:41.886214+0000","last_became_active":"2024-08-17T02:45:40.843713+0000","last_became_peered":"2024-08-17T02:45:40.843713+0000","last_unstale":"2024-08-17T02:45:41.886214+0000","last_undegraded":"2024-08-17T02:45:41.886214+0000","last_fullsized":"2024-08-17T02:45:41.886214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:11.722334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.866615+0000","last_change":"2024-08-17T02:45:41.866615+0000","last_active":"2024-08-17T02:45:41.866615+0000","last_peered":"2024-08-17T02:45:41.866615+0000","last_clean":"2024-08-17T02:45:41.866615+0000","last_became_active":"2024-08-17T02:45:41.865961+0000","last_became_peered":"2024-08-17T02:45:41.865961+0000","last_unstale":"2024-08-17T02:45:41.866615+0000","last_undegraded":"2024-08-17T02:45:41.866615+0000","last_fullsized":"2024-08-17T02:45:41.866615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:05.492164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.883278+0000","last_change":"2024-08-17T02:45:40.847584+0000","last_active":"2024-08-17T02:45:41.883278+0000","last_peered":"2024-08-17T02:45:41.883278+0000","last_clean":"2024-08-17T02:45:41.883278+0000","last_became_active":"2024-08-17T02:45:40.847259+0000","last_became_peered":"2024-08-17T02:45:40.847259+0000","last_unstale":"2024-08-17T02:45:41.883278+0000","last_undegraded":"2024-08-17T02:45:41.883278+0000","last_fullsized":"2024-08-17T02:45:41.883278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:00:43.864087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.864969+0000","last_change":"2024-08-17T02:45:41.864969+0000","last_active":"2024-08-17T02:45:41.864969+0000","last_peered":"2024-08-17T02:45:41.864969+0000","last_clean":"2024-08-17T02:45:41.864969+0000","last_became_active":"2024-08-17T02:45:41.860538+0000","last_became_peered":"2024-08-17T02:45:41.860538+0000","last_unstale":"2024-08-17T02:45:41.864969+0000","last_undegraded":"2024-08-17T02:45:41.864969+0000","last_fullsized":"2024-08-17T02:45:41.864969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:16:34.733391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:45:40.857432+0000","last_change":"2024-08-17T02:45:40.853949+0000","last_active":"2024-08-17T02:45:40.857432+0000","last_peered":"2024-08-17T02:45:40.857432+0000","last_clean":"2024-08-17T02:45:40.857432+0000","last_became_active":"2024-08-17T02:45:40.852638+0000","last_became_peered":"2024-08-17T02:45:40.852638+0000","last_unstale":"2024-08-17T02:45:40.857432+0000","last_undegraded":"2024-08-17T02:45:40.857432+0000","last_fullsized":"2024-08-17T02:45:40.857432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:03.324359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.876365+0000","last_change":"2024-08-17T02:45:41.876365+0000","last_active":"2024-08-17T02:45:41.876365+0000","last_peered":"2024-08-17T02:45:41.876365+0000","last_clean":"2024-08-17T02:45:41.876365+0000","last_became_active":"2024-08-17T02:45:41.876110+0000","last_became_peered":"2024-08-17T02:45:41.876110+0000","last_unstale":"2024-08-17T02:45:41.876365+0000","last_undegraded":"2024-08-17T02:45:41.876365+0000","last_fullsized":"2024-08-17T02:45:41.876365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:52.363743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.851754+0000","last_change":"2024-08-17T02:45:40.845008+0000","last_active":"2024-08-17T02:45:41.851754+0000","last_peered":"2024-08-17T02:45:41.851754+0000","last_clean":"2024-08-17T02:45:41.851754+0000","last_became_active":"2024-08-17T02:45:40.842289+0000","last_became_peered":"2024-08-17T02:45:40.842289+0000","last_unstale":"2024-08-17T02:45:41.851754+0000","last_undegraded":"2024-08-17T02:45:41.851754+0000","last_fullsized":"2024-08-17T02:45:41.851754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:48.334950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.870954+0000","last_change":"2024-08-17T02:45:41.864016+0000","last_active":"2024-08-17T02:45:41.870954+0000","last_peered":"2024-08-17T02:45:41.870954+0000","last_clean":"2024-08-17T02:45:41.870954+0000","last_became_active":"2024-08-17T02:45:41.863757+0000","last_became_peered":"2024-08-17T02:45:41.863757+0000","last_unstale":"2024-08-17T02:45:41.870954+0000","last_undegraded":"2024-08-17T02:45:41.870954+0000","last_fullsized":"2024-08-17T02:45:41.870954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:03.754114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.878538+0000","last_change":"2024-08-17T02:45:40.835613+0000","last_active":"2024-08-17T02:45:41.878538+0000","last_peered":"2024-08-17T02:45:41.878538+0000","last_clean":"2024-08-17T02:45:41.878538+0000","last_became_active":"2024-08-17T02:45:40.835051+0000","last_became_peered":"2024-08-17T02:45:40.835051+0000","last_unstale":"2024-08-17T02:45:41.878538+0000","last_undegraded":"2024-08-17T02:45:41.878538+0000","last_fullsized":"2024-08-17T02:45:41.878538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:13.885252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.876204+0000","last_change":"2024-08-17T02:45:41.876204+0000","last_active":"2024-08-17T02:45:41.876204+0000","last_peered":"2024-08-17T02:45:41.876204+0000","last_clean":"2024-08-17T02:45:41.876204+0000","last_became_active":"2024-08-17T02:45:41.875536+0000","last_became_peered":"2024-08-17T02:45:41.875536+0000","last_unstale":"2024-08-17T02:45:41.876204+0000","last_undegraded":"2024-08-17T02:45:41.876204+0000","last_fullsized":"2024-08-17T02:45:41.876204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:47:30.233998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.852138+0000","last_change":"2024-08-17T02:45:40.852072+0000","last_active":"2024-08-17T02:45:41.852138+0000","last_peered":"2024-08-17T02:45:41.852138+0000","last_clean":"2024-08-17T02:45:41.852138+0000","last_became_active":"2024-08-17T02:45:40.851346+0000","last_became_peered":"2024-08-17T02:45:40.851346+0000","last_unstale":"2024-08-17T02:45:41.852138+0000","last_undegraded":"2024-08-17T02:45:41.852138+0000","last_fullsized":"2024-08-17T02:45:41.852138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:26:40.603861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.884514+0000","last_change":"2024-08-17T02:45:41.884514+0000","last_active":"2024-08-17T02:45:41.884514+0000","last_peered":"2024-08-17T02:45:41.884514+0000","last_clean":"2024-08-17T02:45:41.884514+0000","last_became_active":"2024-08-17T02:45:41.883843+0000","last_became_peered":"2024-08-17T02:45:41.883843+0000","last_unstale":"2024-08-17T02:45:41.884514+0000","last_undegraded":"2024-08-17T02:45:41.884514+0000","last_fullsized":"2024-08-17T02:45:41.884514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:08:27.775215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.873328+0000","last_change":"2024-08-17T02:45:40.842420+0000","last_active":"2024-08-17T02:45:41.873328+0000","last_peered":"2024-08-17T02:45:41.873328+0000","last_clean":"2024-08-17T02:45:41.873328+0000","last_became_active":"2024-08-17T02:45:40.842134+0000","last_became_peered":"2024-08-17T02:45:40.842134+0000","last_unstale":"2024-08-17T02:45:41.873328+0000","last_undegraded":"2024-08-17T02:45:41.873328+0000","last_fullsized":"2024-08-17T02:45:41.873328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:19.561224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.885453+0000","last_change":"2024-08-17T02:45:41.885453+0000","last_active":"2024-08-17T02:45:41.885453+0000","last_peered":"2024-08-17T02:45:41.885453+0000","last_clean":"2024-08-17T02:45:41.885453+0000","last_became_active":"2024-08-17T02:45:41.885194+0000","last_became_peered":"2024-08-17T02:45:41.885194+0000","last_unstale":"2024-08-17T02:45:41.885453+0000","last_undegraded":"2024-08-17T02:45:41.885453+0000","last_fullsized":"2024-08-17T02:45:41.885453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:41:42.486969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886577+0000","last_change":"2024-08-17T02:45:40.843903+0000","last_active":"2024-08-17T02:45:41.886577+0000","last_peered":"2024-08-17T02:45:41.886577+0000","last_clean":"2024-08-17T02:45:41.886577+0000","last_became_active":"2024-08-17T02:45:40.841473+0000","last_became_peered":"2024-08-17T02:45:40.841473+0000","last_unstale":"2024-08-17T02:45:41.886577+0000","last_undegraded":"2024-08-17T02:45:41.886577+0000","last_fullsized":"2024-08-17T02:45:41.886577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:20.067847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.849797+0000","last_change":"2024-08-17T02:45:41.849797+0000","last_active":"2024-08-17T02:45:41.849797+0000","last_peered":"2024-08-17T02:45:41.849797+0000","last_clean":"2024-08-17T02:45:41.849797+0000","last_became_active":"2024-08-17T02:45:41.849495+0000","last_became_peered":"2024-08-17T02:45:41.849495+0000","last_unstale":"2024-08-17T02:45:41.849797+0000","last_undegraded":"2024-08-17T02:45:41.849797+0000","last_fullsized":"2024-08-17T02:45:41.849797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:44.220882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.841551+0000","last_change":"2024-08-17T02:45:40.858186+0000","last_active":"2024-08-17T02:45:41.841551+0000","last_peered":"2024-08-17T02:45:41.841551+0000","last_clean":"2024-08-17T02:45:41.841551+0000","last_became_active":"2024-08-17T02:45:40.857956+0000","last_became_peered":"2024-08-17T02:45:40.857956+0000","last_unstale":"2024-08-17T02:45:41.841551+0000","last_undegraded":"2024-08-17T02:45:41.841551+0000","last_fullsized":"2024-08-17T02:45:41.841551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:52:22.103135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.866120+0000","last_change":"2024-08-17T02:45:41.866120+0000","last_active":"2024-08-17T02:45:41.866120+0000","last_peered":"2024-08-17T02:45:41.866120+0000","last_clean":"2024-08-17T02:45:41.866120+0000","last_became_active":"2024-08-17T02:45:41.865856+0000","last_became_peered":"2024-08-17T02:45:41.865856+0000","last_unstale":"2024-08-17T02:45:41.866120+0000","last_undegraded":"2024-08-17T02:45:41.866120+0000","last_fullsized":"2024-08-17T02:45:41.866120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:50:37.265026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":162,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:45:40.845914+0000","last_change":"2024-08-17T02:45:37.011679+0000","last_active":"2024-08-17T02:45:40.845914+0000","last_peered":"2024-08-17T02:45:40.845914+0000","last_clean":"2024-08-17T02:45:40.845914+0000","last_became_active":"2024-08-17T02:45:37.010559+0000","last_became_peered":"2024-08-17T02:45:37.010559+0000","last_unstale":"2024-08-17T02:45:40.845914+0000","last_undegraded":"2024-08-17T02:45:40.845914+0000","last_fullsized":"2024-08-17T02:45:40.845914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:35.708391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:35.708391+0000","last_clean_scrub_stamp":"2024-08-17T02:45:35.708391+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:11.380093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:45:40.856272+0000","last_change":"2024-08-17T02:45:40.848763+0000","last_active":"2024-08-17T02:45:40.856272+0000","last_peered":"2024-08-17T02:45:40.856272+0000","last_clean":"2024-08-17T02:45:40.856272+0000","last_became_active":"2024-08-17T02:45:40.847935+0000","last_became_peered":"2024-08-17T02:45:40.847935+0000","last_unstale":"2024-08-17T02:45:40.856272+0000","last_undegraded":"2024-08-17T02:45:40.856272+0000","last_fullsized":"2024-08-17T02:45:40.856272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:15.864750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.851312+0000","last_change":"2024-08-17T02:45:41.846412+0000","last_active":"2024-08-17T02:45:41.851312+0000","last_peered":"2024-08-17T02:45:41.851312+0000","last_clean":"2024-08-17T02:45:41.851312+0000","last_became_active":"2024-08-17T02:45:41.846136+0000","last_became_peered":"2024-08-17T02:45:41.846136+0000","last_unstale":"2024-08-17T02:45:41.851312+0000","last_undegraded":"2024-08-17T02:45:41.851312+0000","last_fullsized":"2024-08-17T02:45:41.851312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:06.130481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:45:40.862708+0000","last_change":"2024-08-17T02:45:40.858420+0000","last_active":"2024-08-17T02:45:40.862708+0000","last_peered":"2024-08-17T02:45:40.862708+0000","last_clean":"2024-08-17T02:45:40.862708+0000","last_became_active":"2024-08-17T02:45:40.858149+0000","last_became_peered":"2024-08-17T02:45:40.858149+0000","last_unstale":"2024-08-17T02:45:40.862708+0000","last_undegraded":"2024-08-17T02:45:40.862708+0000","last_fullsized":"2024-08-17T02:45:40.862708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:48.334950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.864808+0000","last_change":"2024-08-17T02:45:41.864808+0000","last_active":"2024-08-17T02:45:41.864808+0000","last_peered":"2024-08-17T02:45:41.864808+0000","last_clean":"2024-08-17T02:45:41.864808+0000","last_became_active":"2024-08-17T02:45:41.864397+0000","last_became_peered":"2024-08-17T02:45:41.864397+0000","last_unstale":"2024-08-17T02:45:41.864808+0000","last_undegraded":"2024-08-17T02:45:41.864808+0000","last_fullsized":"2024-08-17T02:45:41.864808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:44.425401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.842270+0000","last_change":"2024-08-17T02:45:40.843284+0000","last_active":"2024-08-17T02:45:41.842270+0000","last_peered":"2024-08-17T02:45:41.842270+0000","last_clean":"2024-08-17T02:45:41.842270+0000","last_became_active":"2024-08-17T02:45:40.842914+0000","last_became_peered":"2024-08-17T02:45:40.842914+0000","last_unstale":"2024-08-17T02:45:41.842270+0000","last_undegraded":"2024-08-17T02:45:41.842270+0000","last_fullsized":"2024-08-17T02:45:41.842270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:03.324359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.859058+0000","last_change":"2024-08-17T02:45:41.855267+0000","last_active":"2024-08-17T02:45:41.859058+0000","last_peered":"2024-08-17T02:45:41.859058+0000","last_clean":"2024-08-17T02:45:41.859058+0000","last_became_active":"2024-08-17T02:45:41.854987+0000","last_became_peered":"2024-08-17T02:45:41.854987+0000","last_unstale":"2024-08-17T02:45:41.859058+0000","last_undegraded":"2024-08-17T02:45:41.859058+0000","last_fullsized":"2024-08-17T02:45:41.859058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:00.504734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:45:40.856015+0000","last_change":"2024-08-17T02:45:40.848058+0000","last_active":"2024-08-17T02:45:40.856015+0000","last_peered":"2024-08-17T02:45:40.856015+0000","last_clean":"2024-08-17T02:45:40.856015+0000","last_became_active":"2024-08-17T02:45:40.846274+0000","last_became_peered":"2024-08-17T02:45:40.846274+0000","last_unstale":"2024-08-17T02:45:40.856015+0000","last_undegraded":"2024-08-17T02:45:40.856015+0000","last_fullsized":"2024-08-17T02:45:40.856015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:13.885252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.864247+0000","last_change":"2024-08-17T02:45:41.864247+0000","last_active":"2024-08-17T02:45:41.864247+0000","last_peered":"2024-08-17T02:45:41.864247+0000","last_clean":"2024-08-17T02:45:41.864247+0000","last_became_active":"2024-08-17T02:45:41.861904+0000","last_became_peered":"2024-08-17T02:45:41.861904+0000","last_unstale":"2024-08-17T02:45:41.864247+0000","last_undegraded":"2024-08-17T02:45:41.864247+0000","last_fullsized":"2024-08-17T02:45:41.864247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:25.446485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.847751+0000","last_change":"2024-08-17T02:45:40.851172+0000","last_active":"2024-08-17T02:45:41.847751+0000","last_peered":"2024-08-17T02:45:41.847751+0000","last_clean":"2024-08-17T02:45:41.847751+0000","last_became_active":"2024-08-17T02:45:40.850891+0000","last_became_peered":"2024-08-17T02:45:40.850891+0000","last_unstale":"2024-08-17T02:45:41.847751+0000","last_undegraded":"2024-08-17T02:45:41.847751+0000","last_fullsized":"2024-08-17T02:45:41.847751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:30.021288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.853051+0000","last_change":"2024-08-17T02:45:41.853051+0000","last_active":"2024-08-17T02:45:41.853051+0000","last_peered":"2024-08-17T02:45:41.853051+0000","last_clean":"2024-08-17T02:45:41.853051+0000","last_became_active":"2024-08-17T02:45:41.852732+0000","last_became_peered":"2024-08-17T02:45:41.852732+0000","last_unstale":"2024-08-17T02:45:41.853051+0000","last_undegraded":"2024-08-17T02:45:41.853051+0000","last_fullsized":"2024-08-17T02:45:41.853051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:06.130481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:45:40.868933+0000","last_change":"2024-08-17T02:45:40.863294+0000","last_active":"2024-08-17T02:45:40.868933+0000","last_peered":"2024-08-17T02:45:40.868933+0000","last_clean":"2024-08-17T02:45:40.868933+0000","last_became_active":"2024-08-17T02:45:40.863098+0000","last_became_peered":"2024-08-17T02:45:40.863098+0000","last_unstale":"2024-08-17T02:45:40.868933+0000","last_undegraded":"2024-08-17T02:45:40.868933+0000","last_fullsized":"2024-08-17T02:45:40.868933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:34:13.760542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.858888+0000","last_change":"2024-08-17T02:45:41.852369+0000","last_active":"2024-08-17T02:45:41.858888+0000","last_peered":"2024-08-17T02:45:41.858888+0000","last_clean":"2024-08-17T02:45:41.858888+0000","last_became_active":"2024-08-17T02:45:41.852188+0000","last_became_peered":"2024-08-17T02:45:41.852188+0000","last_unstale":"2024-08-17T02:45:41.858888+0000","last_undegraded":"2024-08-17T02:45:41.858888+0000","last_fullsized":"2024-08-17T02:45:41.858888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:35:47.023580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.848562+0000","last_change":"2024-08-17T02:45:40.854078+0000","last_active":"2024-08-17T02:45:41.848562+0000","last_peered":"2024-08-17T02:45:41.848562+0000","last_clean":"2024-08-17T02:45:41.848562+0000","last_became_active":"2024-08-17T02:45:40.853737+0000","last_became_peered":"2024-08-17T02:45:40.853737+0000","last_unstale":"2024-08-17T02:45:41.848562+0000","last_undegraded":"2024-08-17T02:45:41.848562+0000","last_fullsized":"2024-08-17T02:45:41.848562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:43.419530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.865212+0000","last_change":"2024-08-17T02:45:41.861623+0000","last_active":"2024-08-17T02:45:41.865212+0000","last_peered":"2024-08-17T02:45:41.865212+0000","last_clean":"2024-08-17T02:45:41.865212+0000","last_became_active":"2024-08-17T02:45:41.861378+0000","last_became_peered":"2024-08-17T02:45:41.861378+0000","last_unstale":"2024-08-17T02:45:41.865212+0000","last_undegraded":"2024-08-17T02:45:41.865212+0000","last_fullsized":"2024-08-17T02:45:41.865212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:01.344799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.881441+0000","last_change":"2024-08-17T02:45:40.857808+0000","last_active":"2024-08-17T02:45:41.881441+0000","last_peered":"2024-08-17T02:45:41.881441+0000","last_clean":"2024-08-17T02:45:41.881441+0000","last_became_active":"2024-08-17T02:45:40.857551+0000","last_became_peered":"2024-08-17T02:45:40.857551+0000","last_unstale":"2024-08-17T02:45:41.881441+0000","last_undegraded":"2024-08-17T02:45:41.881441+0000","last_fullsized":"2024-08-17T02:45:41.881441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:08.041685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.864378+0000","last_change":"2024-08-17T02:45:41.864378+0000","last_active":"2024-08-17T02:45:41.864378+0000","last_peered":"2024-08-17T02:45:41.864378+0000","last_clean":"2024-08-17T02:45:41.864378+0000","last_became_active":"2024-08-17T02:45:41.864154+0000","last_became_peered":"2024-08-17T02:45:41.864154+0000","last_unstale":"2024-08-17T02:45:41.864378+0000","last_undegraded":"2024-08-17T02:45:41.864378+0000","last_fullsized":"2024-08-17T02:45:41.864378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:02.801412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:45:40.862657+0000","last_change":"2024-08-17T02:45:40.857559+0000","last_active":"2024-08-17T02:45:40.862657+0000","last_peered":"2024-08-17T02:45:40.862657+0000","last_clean":"2024-08-17T02:45:40.862657+0000","last_became_active":"2024-08-17T02:45:40.856889+0000","last_became_peered":"2024-08-17T02:45:40.856889+0000","last_unstale":"2024-08-17T02:45:40.862657+0000","last_undegraded":"2024-08-17T02:45:40.862657+0000","last_fullsized":"2024-08-17T02:45:40.862657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:26.959391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.861090+0000","last_change":"2024-08-17T02:45:41.861090+0000","last_active":"2024-08-17T02:45:41.861090+0000","last_peered":"2024-08-17T02:45:41.861090+0000","last_clean":"2024-08-17T02:45:41.861090+0000","last_became_active":"2024-08-17T02:45:41.860752+0000","last_became_peered":"2024-08-17T02:45:41.860752+0000","last_unstale":"2024-08-17T02:45:41.861090+0000","last_undegraded":"2024-08-17T02:45:41.861090+0000","last_fullsized":"2024-08-17T02:45:41.861090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:44.425401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.849695+0000","last_change":"2024-08-17T02:45:40.855151+0000","last_active":"2024-08-17T02:45:41.849695+0000","last_peered":"2024-08-17T02:45:41.849695+0000","last_clean":"2024-08-17T02:45:41.849695+0000","last_became_active":"2024-08-17T02:45:40.854968+0000","last_became_peered":"2024-08-17T02:45:40.854968+0000","last_unstale":"2024-08-17T02:45:41.849695+0000","last_undegraded":"2024-08-17T02:45:41.849695+0000","last_fullsized":"2024-08-17T02:45:41.849695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:13.885252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.861997+0000","last_change":"2024-08-17T02:45:41.857268+0000","last_active":"2024-08-17T02:45:41.861997+0000","last_peered":"2024-08-17T02:45:41.861997+0000","last_clean":"2024-08-17T02:45:41.861997+0000","last_became_active":"2024-08-17T02:45:41.856839+0000","last_became_peered":"2024-08-17T02:45:41.856839+0000","last_unstale":"2024-08-17T02:45:41.861997+0000","last_undegraded":"2024-08-17T02:45:41.861997+0000","last_fullsized":"2024-08-17T02:45:41.861997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:25.446485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.848840+0000","last_change":"2024-08-17T02:45:40.843100+0000","last_active":"2024-08-17T02:45:41.848840+0000","last_peered":"2024-08-17T02:45:41.848840+0000","last_clean":"2024-08-17T02:45:41.848840+0000","last_became_active":"2024-08-17T02:45:40.842206+0000","last_became_peered":"2024-08-17T02:45:40.842206+0000","last_unstale":"2024-08-17T02:45:41.848840+0000","last_undegraded":"2024-08-17T02:45:41.848840+0000","last_fullsized":"2024-08-17T02:45:41.848840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:52:22.103135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.872919+0000","last_change":"2024-08-17T02:45:41.865819+0000","last_active":"2024-08-17T02:45:41.872919+0000","last_peered":"2024-08-17T02:45:41.872919+0000","last_clean":"2024-08-17T02:45:41.872919+0000","last_became_active":"2024-08-17T02:45:41.865537+0000","last_became_peered":"2024-08-17T02:45:41.865537+0000","last_unstale":"2024-08-17T02:45:41.872919+0000","last_undegraded":"2024-08-17T02:45:41.872919+0000","last_fullsized":"2024-08-17T02:45:41.872919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:44.220882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.887121+0000","last_change":"2024-08-17T02:45:40.861158+0000","last_active":"2024-08-17T02:45:41.887121+0000","last_peered":"2024-08-17T02:45:41.887121+0000","last_clean":"2024-08-17T02:45:41.887121+0000","last_became_active":"2024-08-17T02:45:40.860714+0000","last_became_peered":"2024-08-17T02:45:40.860714+0000","last_unstale":"2024-08-17T02:45:41.887121+0000","last_undegraded":"2024-08-17T02:45:41.887121+0000","last_fullsized":"2024-08-17T02:45:41.887121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:52:04.471737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.885525+0000","last_change":"2024-08-17T02:45:41.881747+0000","last_active":"2024-08-17T02:45:41.885525+0000","last_peered":"2024-08-17T02:45:41.885525+0000","last_clean":"2024-08-17T02:45:41.885525+0000","last_became_active":"2024-08-17T02:45:41.880618+0000","last_became_peered":"2024-08-17T02:45:41.880618+0000","last_unstale":"2024-08-17T02:45:41.885525+0000","last_undegraded":"2024-08-17T02:45:41.885525+0000","last_fullsized":"2024-08-17T02:45:41.885525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:03:23.967191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.862264+0000","last_change":"2024-08-17T02:45:41.862264+0000","last_active":"2024-08-17T02:45:41.862264+0000","last_peered":"2024-08-17T02:45:41.862264+0000","last_clean":"2024-08-17T02:45:41.862264+0000","last_became_active":"2024-08-17T02:45:41.862036+0000","last_became_peered":"2024-08-17T02:45:41.862036+0000","last_unstale":"2024-08-17T02:45:41.862264+0000","last_undegraded":"2024-08-17T02:45:41.862264+0000","last_fullsized":"2024-08-17T02:45:41.862264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:31:57.128164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886803+0000","last_change":"2024-08-17T02:45:40.860423+0000","last_active":"2024-08-17T02:45:41.886803+0000","last_peered":"2024-08-17T02:45:41.886803+0000","last_clean":"2024-08-17T02:45:41.886803+0000","last_became_active":"2024-08-17T02:45:40.860126+0000","last_became_peered":"2024-08-17T02:45:40.860126+0000","last_unstale":"2024-08-17T02:45:41.886803+0000","last_undegraded":"2024-08-17T02:45:41.886803+0000","last_fullsized":"2024-08-17T02:45:41.886803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:43:21.770605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.880348+0000","last_change":"2024-08-17T02:45:41.880348+0000","last_active":"2024-08-17T02:45:41.880348+0000","last_peered":"2024-08-17T02:45:41.880348+0000","last_clean":"2024-08-17T02:45:41.880348+0000","last_became_active":"2024-08-17T02:45:41.879896+0000","last_became_peered":"2024-08-17T02:45:41.879896+0000","last_unstale":"2024-08-17T02:45:41.880348+0000","last_undegraded":"2024-08-17T02:45:41.880348+0000","last_fullsized":"2024-08-17T02:45:41.880348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:09.195225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886010+0000","last_change":"2024-08-17T02:45:40.862857+0000","last_active":"2024-08-17T02:45:41.886010+0000","last_peered":"2024-08-17T02:45:41.886010+0000","last_clean":"2024-08-17T02:45:41.886010+0000","last_became_active":"2024-08-17T02:45:40.862629+0000","last_became_peered":"2024-08-17T02:45:40.862629+0000","last_unstale":"2024-08-17T02:45:41.886010+0000","last_undegraded":"2024-08-17T02:45:41.886010+0000","last_fullsized":"2024-08-17T02:45:41.886010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:30:25.700503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.863606+0000","last_change":"2024-08-17T02:45:41.863606+0000","last_active":"2024-08-17T02:45:41.863606+0000","last_peered":"2024-08-17T02:45:41.863606+0000","last_clean":"2024-08-17T02:45:41.863606+0000","last_became_active":"2024-08-17T02:45:41.863332+0000","last_became_peered":"2024-08-17T02:45:41.863332+0000","last_unstale":"2024-08-17T02:45:41.863606+0000","last_undegraded":"2024-08-17T02:45:41.863606+0000","last_fullsized":"2024-08-17T02:45:41.863606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:09.195225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.875437+0000","last_change":"2024-08-17T02:45:40.851226+0000","last_active":"2024-08-17T02:45:41.875437+0000","last_peered":"2024-08-17T02:45:41.875437+0000","last_clean":"2024-08-17T02:45:41.875437+0000","last_became_active":"2024-08-17T02:45:40.850945+0000","last_became_peered":"2024-08-17T02:45:40.850945+0000","last_unstale":"2024-08-17T02:45:41.875437+0000","last_undegraded":"2024-08-17T02:45:41.875437+0000","last_fullsized":"2024-08-17T02:45:41.875437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:00:43.864087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.875679+0000","last_change":"2024-08-17T02:45:41.871607+0000","last_active":"2024-08-17T02:45:41.875679+0000","last_peered":"2024-08-17T02:45:41.875679+0000","last_clean":"2024-08-17T02:45:41.875679+0000","last_became_active":"2024-08-17T02:45:41.871278+0000","last_became_peered":"2024-08-17T02:45:41.871278+0000","last_unstale":"2024-08-17T02:45:41.875679+0000","last_undegraded":"2024-08-17T02:45:41.875679+0000","last_fullsized":"2024-08-17T02:45:41.875679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:02.143166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.884446+0000","last_change":"2024-08-17T02:45:40.857851+0000","last_active":"2024-08-17T02:45:41.884446+0000","last_peered":"2024-08-17T02:45:41.884446+0000","last_clean":"2024-08-17T02:45:41.884446+0000","last_became_active":"2024-08-17T02:45:40.857532+0000","last_became_peered":"2024-08-17T02:45:40.857532+0000","last_unstale":"2024-08-17T02:45:41.884446+0000","last_undegraded":"2024-08-17T02:45:41.884446+0000","last_fullsized":"2024-08-17T02:45:41.884446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:25:01.252070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":811008,"data_stored":663172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":237568,"data_stored":80074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.430999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.654}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2629999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.073}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.545999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.111000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.526999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":72324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":225280,"data_stored":72360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":225280,"data_stored":73786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":225280,"data_stored":78522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":233472,"data_stored":78682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":819200,"data_stored":663228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:45:45.999 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:45:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.178+0000 7f8759400640 1 Processor -- start 2024-08-17T02:45:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.178+0000 7f8759400640 1 -- start start 2024-08-17T02:45:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.179+0000 7f8759400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8754155180 0x7f87540aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.179+0000 7f8759400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87540afc10 con 0x7f875406e080 2024-08-17T02:45:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.179+0000 7f8759400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87540af000 con 0x7f8754155550 2024-08-17T02:45:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.179+0000 7f8759400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87540af2e0 con 0x7f8754155180 2024-08-17T02:45:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.180+0000 7f8753200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f875406e080 0x7f875406e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44938/0 (socket says 172.21.15.100:44938) 2024-08-17T02:45:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.180+0000 7f8753200640 1 -- 172.21.15.100:0/1526869631 learned_addr learned my addr 172.21.15.100:0/1526869631 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.180+0000 7f8752800640 1 --2- 172.21.15.100:0/1526869631 >> v2:172.21.15.123:3300/0 conn(0x7f8754155180 0x7f87540aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.180+0000 7f8751e00640 1 -- 172.21.15.100:0/1526869631 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757706323 0 0) 0x7f87540afc10 con 0x7f875406e080 2024-08-17T02:45:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.180+0000 7f8751e00640 1 -- 172.21.15.100:0/1526869631 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87380034e0 con 0x7f875406e080 2024-08-17T02:45:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.180+0000 7f8751e00640 1 -- 172.21.15.100:0/1526869631 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 416451792 0 0) 0x7f87380034e0 con 0x7f875406e080 2024-08-17T02:45:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.180+0000 7f8751e00640 1 -- 172.21.15.100:0/1526869631 >> v2:172.21.15.123:3300/0 conn(0x7f8754155180 msgr2=0x7f87540aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:46.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.180+0000 7f8751e00640 1 --2- 172.21.15.100:0/1526869631 >> v2:172.21.15.123:3300/0 conn(0x7f8754155180 0x7f87540aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.180+0000 7f8751e00640 1 -- 172.21.15.100:0/1526869631 >> v1:172.21.15.123:6789/0 conn(0x7f8754155550 legacy=0x7f87540ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.180+0000 7f8751e00640 1 -- 172.21.15.100:0/1526869631 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87540af5c0 con 0x7f875406e080 2024-08-17T02:45:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.180+0000 7f8751e00640 1 -- 172.21.15.100:0/1526869631 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1817143124 0 0) 0x7f874c001810 con 0x7f875406e080 2024-08-17T02:45:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.181+0000 7f8751e00640 1 -- 172.21.15.100:0/1526869631 >> v1:172.21.15.100:6789/0 conn(0x7f875406e080 legacy=0x7f875406e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.181+0000 7f8751e00640 1 --2- 172.21.15.100:0/1526869631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8738003a20 0x7f8738003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.181+0000 7f8751e00640 1 --2- 172.21.15.100:0/1526869631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8738004780 0x7f8738004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.181+0000 7f8751e00640 1 --2- 172.21.15.100:0/1526869631 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8738005130 0x7f873800ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.181+0000 7f8751e00640 1 -- 172.21.15.100:0/1526869631 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87540af2e0 con 0x7f8738003a20 2024-08-17T02:45:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.181+0000 7f8751e00640 1 -- 172.21.15.100:0/1526869631 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8738010520 con 0x7f8738004780 2024-08-17T02:45:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.181+0000 7f8751e00640 1 -- 172.21.15.100:0/1526869631 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8738010690 con 0x7f8738005130 2024-08-17T02:45:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.181+0000 7f8752800640 1 --2- 172.21.15.100:0/1526869631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8738003a20 0x7f8738003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.181+0000 7f8749e00640 1 --2- 172.21.15.100:0/1526869631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8738004780 0x7f8738004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.181+0000 7f8753200640 1 --2- 172.21.15.100:0/1526869631 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8738005130 0x7f873800ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.181+0000 7f8752800640 1 -- 172.21.15.100:0/1526869631 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8738005130 msgr2=0x7f873800ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.181+0000 7f8752800640 1 --2- 172.21.15.100:0/1526869631 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8738005130 0x7f873800ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.181+0000 7f8752800640 1 -- 172.21.15.100:0/1526869631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8738004780 msgr2=0x7f8738004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.181+0000 7f8752800640 1 --2- 172.21.15.100:0/1526869631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8738004780 0x7f8738004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.181+0000 7f8752800640 1 -- 172.21.15.100:0/1526869631 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87380034e0 con 0x7f8738003a20 2024-08-17T02:45:46.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.181+0000 7f8753200640 1 -- 172.21.15.100:0/1526869631 reap_dead start 2024-08-17T02:45:46.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.182+0000 7f8752800640 1 --2- 172.21.15.100:0/1526869631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8738003a20 0x7f8738003e30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8744006e70 tx=0x7f87440090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ccc444439fbdd07 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:46.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.182+0000 7f8751e00640 1 -- 172.21.15.100:0/1526869631 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8744031400 con 0x7f8738003a20 2024-08-17T02:45:46.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.182+0000 7f8751e00640 1 -- 172.21.15.100:0/1526869631 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874402d050 con 0x7f8738003a20 2024-08-17T02:45:46.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.182+0000 7f8751e00640 1 -- 172.21.15.100:0/1526869631 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8744031790 con 0x7f8738003a20 2024-08-17T02:45:46.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.183+0000 7f8759400640 1 -- 172.21.15.100:0/1526869631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8738003a20 msgr2=0x7f8738003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:46.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.183+0000 7f8759400640 1 --2- 172.21.15.100:0/1526869631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8738003a20 0x7f8738003e30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8744006e70 tx=0x7f87440090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.183+0000 7f8759400640 1 -- 172.21.15.100:0/1526869631 shutdown_connections 2024-08-17T02:45:46.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.183+0000 7f8759400640 1 --2- 172.21.15.100:0/1526869631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8738003a20 0x7f8738003e30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.183+0000 7f8759400640 1 -- 172.21.15.100:0/1526869631 >> 172.21.15.100:0/1526869631 conn(0x7f87540cb9b0 msgr2=0x7f87540cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:46.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.183+0000 7f8759400640 1 -- 172.21.15.100:0/1526869631 shutdown_connections 2024-08-17T02:45:46.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.183+0000 7f8759400640 1 -- 172.21.15.100:0/1526869631 wait complete. 2024-08-17T02:45:46.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.184+0000 7f8759400640 1 Processor -- start 2024-08-17T02:45:46.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.184+0000 7f8759400640 1 -- start start 2024-08-17T02:45:46.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.185+0000 7f8759400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8738003a20 0x7f87541559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.185+0000 7f8759400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f875414a6d0 0x7f87541397a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.185+0000 7f8759400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8754168870 0x7f8754168ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.185+0000 7f8759400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875414a530 con 0x7f8738003a20 2024-08-17T02:45:46.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.185+0000 7f8759400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8754169830 con 0x7f8754168870 2024-08-17T02:45:46.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.185+0000 7f8759400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87541582a0 con 0x7f875414a6d0 2024-08-17T02:45:46.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.185+0000 7f8752800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8738003a20 0x7f87541559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.185+0000 7f8752800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8738003a20 0x7f87541559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40498/0 (socket says 172.21.15.100:40498) 2024-08-17T02:45:46.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.185+0000 7f8752800640 1 -- 172.21.15.100:0/1510840403 learned_addr learned my addr 172.21.15.100:0/1510840403 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:46.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.186+0000 7f8749e00640 1 --2- 172.21.15.100:0/1510840403 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f875414a6d0 0x7f87541397a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.186+0000 7f8753200640 1 --2- 172.21.15.100:0/1510840403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8754168870 0x7f8754168ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.186+0000 7f8752800640 1 -- 172.21.15.100:0/1510840403 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f875414a6d0 msgr2=0x7f87541397a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:46.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.186+0000 7f8752800640 1 --2- 172.21.15.100:0/1510840403 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f875414a6d0 0x7f87541397a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.186+0000 7f8752800640 1 -- 172.21.15.100:0/1510840403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8754168870 msgr2=0x7f8754168ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:46.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.186+0000 7f8752800640 1 --2- 172.21.15.100:0/1510840403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8754168870 0x7f8754168ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.186+0000 7f8752800640 1 -- 172.21.15.100:0/1510840403 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875414c330 con 0x7f8738003a20 2024-08-17T02:45:46.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.186+0000 7f8752800640 1 --2- 172.21.15.100:0/1510840403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8738003a20 0x7f87541559d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f874402aa80 tx=0x7f8744035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:46.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.186+0000 7f874aa00640 1 -- 172.21.15.100:0/1510840403 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8744030850 con 0x7f8738003a20 2024-08-17T02:45:46.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.186+0000 7f874aa00640 1 -- 172.21.15.100:0/1510840403 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87440309b0 con 0x7f8738003a20 2024-08-17T02:45:46.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.186+0000 7f874aa00640 1 -- 172.21.15.100:0/1510840403 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8744030d30 con 0x7f8738003a20 2024-08-17T02:45:46.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.186+0000 7f8759400640 1 -- 172.21.15.100:0/1510840403 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8754169550 con 0x7f8738003a20 2024-08-17T02:45:46.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.187+0000 7f8759400640 1 -- 172.21.15.100:0/1510840403 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8754139ce0 con 0x7f8738003a20 2024-08-17T02:45:46.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.187+0000 7f8759400640 1 -- 172.21.15.100:0/1510840403 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f875414aaa0 con 0x7f8738003a20 2024-08-17T02:45:46.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.188+0000 7f874aa00640 1 -- 172.21.15.100:0/1510840403 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f874402ad50 con 0x7f8738003a20 2024-08-17T02:45:46.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.189+0000 7f874aa00640 1 --2- 172.21.15.100:0/1510840403 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8730065180 0x7f8730067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.189+0000 7f874aa00640 1 -- 172.21.15.100:0/1510840403 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f87440a3190 con 0x7f8738003a20 2024-08-17T02:45:46.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.189+0000 7f8749e00640 1 --2- 172.21.15.100:0/1510840403 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8730065180 0x7f8730067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.190+0000 7f8749e00640 1 --2- 172.21.15.100:0/1510840403 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8730065180 0x7f8730067630 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f87541687d0 tx=0x7f873c007ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:46.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.193+0000 7f874aa00640 1 -- 172.21.15.100:0/1510840403 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8744071300 con 0x7f8738003a20 2024-08-17T02:45:46.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.362+0000 7f8759400640 1 -- 172.21.15.100:0/1510840403 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f875414c4c0 con 0x7f8730065180 2024-08-17T02:45:46.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.369+0000 7f874aa00640 1 -- 172.21.15.100:0/1510840403 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264590 (secure 0 0 0) 0x7f873c003cd0 con 0x7f8730065180 2024-08-17T02:45:46.372 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:46.374 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-08-17T02:45:46.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.373+0000 7f8759400640 1 -- 172.21.15.100:0/1510840403 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8730065180 msgr2=0x7f8730067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:46.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.373+0000 7f8759400640 1 --2- 172.21.15.100:0/1510840403 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8730065180 0x7f8730067630 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f87541687d0 tx=0x7f873c007ca0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.373+0000 7f8759400640 1 -- 172.21.15.100:0/1510840403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8738003a20 msgr2=0x7f87541559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:46.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.373+0000 7f8759400640 1 --2- 172.21.15.100:0/1510840403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8738003a20 0x7f87541559d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f874402aa80 tx=0x7f8744035000 comp rx=0 tx=0).stop 2024-08-17T02:45:46.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.373+0000 7f8759400640 1 -- 172.21.15.100:0/1510840403 shutdown_connections 2024-08-17T02:45:46.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.373+0000 7f8759400640 1 --2- 172.21.15.100:0/1510840403 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8730065180 0x7f8730067630 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.373+0000 7f8759400640 1 --2- 172.21.15.100:0/1510840403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8754168870 0x7f8754168ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.373+0000 7f8759400640 1 --2- 172.21.15.100:0/1510840403 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f875414a6d0 0x7f87541397a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.373+0000 7f8759400640 1 --2- 172.21.15.100:0/1510840403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8738003a20 0x7f87541559d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.373+0000 7f8759400640 1 -- 172.21.15.100:0/1510840403 >> 172.21.15.100:0/1510840403 conn(0x7f87540cb9b0 msgr2=0x7f8754154440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:46.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.373+0000 7f8759400640 1 -- 172.21.15.100:0/1510840403 shutdown_connections 2024-08-17T02:45:46.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.373+0000 7f8759400640 1 -- 172.21.15.100:0/1510840403 wait complete. 2024-08-17T02:45:46.389 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-08-17T02:45:45.089902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381984,"kb_used_data":2924,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592736,"statfs":{"total":773094113280,"available":770654961664,"internally_reserved":0,"allocated":2994176,"data_stored":1782148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.268781"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.879971+0000","last_change":"2024-08-17T02:45:41.879971+0000","last_active":"2024-08-17T02:45:41.879971+0000","last_peered":"2024-08-17T02:45:41.879971+0000","last_clean":"2024-08-17T02:45:41.879971+0000","last_became_active":"2024-08-17T02:45:41.879691+0000","last_became_peered":"2024-08-17T02:45:41.879691+0000","last_unstale":"2024-08-17T02:45:41.879971+0000","last_undegraded":"2024-08-17T02:45:41.879971+0000","last_fullsized":"2024-08-17T02:45:41.879971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:02:08.258895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.869545+0000","last_change":"2024-08-17T02:45:41.863383+0000","last_active":"2024-08-17T02:45:41.869545+0000","last_peered":"2024-08-17T02:45:41.869545+0000","last_clean":"2024-08-17T02:45:41.869545+0000","last_became_active":"2024-08-17T02:45:41.863151+0000","last_became_peered":"2024-08-17T02:45:41.863151+0000","last_unstale":"2024-08-17T02:45:41.869545+0000","last_undegraded":"2024-08-17T02:45:41.869545+0000","last_fullsized":"2024-08-17T02:45:41.869545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:09.195225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.859813+0000","last_change":"2024-08-17T02:45:41.859813+0000","last_active":"2024-08-17T02:45:41.859813+0000","last_peered":"2024-08-17T02:45:41.859813+0000","last_clean":"2024-08-17T02:45:41.859813+0000","last_became_active":"2024-08-17T02:45:41.859526+0000","last_became_peered":"2024-08-17T02:45:41.859526+0000","last_unstale":"2024-08-17T02:45:41.859813+0000","last_undegraded":"2024-08-17T02:45:41.859813+0000","last_fullsized":"2024-08-17T02:45:41.859813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:07.343258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.855298+0000","last_change":"2024-08-17T02:45:41.855298+0000","last_active":"2024-08-17T02:45:41.855298+0000","last_peered":"2024-08-17T02:45:41.855298+0000","last_clean":"2024-08-17T02:45:41.855298+0000","last_became_active":"2024-08-17T02:45:41.854637+0000","last_became_peered":"2024-08-17T02:45:41.854637+0000","last_unstale":"2024-08-17T02:45:41.855298+0000","last_undegraded":"2024-08-17T02:45:41.855298+0000","last_fullsized":"2024-08-17T02:45:41.855298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:02.143166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.867785+0000","last_change":"2024-08-17T02:45:41.867785+0000","last_active":"2024-08-17T02:45:41.867785+0000","last_peered":"2024-08-17T02:45:41.867785+0000","last_clean":"2024-08-17T02:45:41.867785+0000","last_became_active":"2024-08-17T02:45:41.866024+0000","last_became_peered":"2024-08-17T02:45:41.866024+0000","last_unstale":"2024-08-17T02:45:41.867785+0000","last_undegraded":"2024-08-17T02:45:41.867785+0000","last_fullsized":"2024-08-17T02:45:41.867785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:27.873599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.855424+0000","last_change":"2024-08-17T02:45:41.855424+0000","last_active":"2024-08-17T02:45:41.855424+0000","last_peered":"2024-08-17T02:45:41.855424+0000","last_clean":"2024-08-17T02:45:41.855424+0000","last_became_active":"2024-08-17T02:45:41.854196+0000","last_became_peered":"2024-08-17T02:45:41.854196+0000","last_unstale":"2024-08-17T02:45:41.855424+0000","last_undegraded":"2024-08-17T02:45:41.855424+0000","last_fullsized":"2024-08-17T02:45:41.855424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:01.344799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.875455+0000","last_change":"2024-08-17T02:45:41.875455+0000","last_active":"2024-08-17T02:45:41.875455+0000","last_peered":"2024-08-17T02:45:41.875455+0000","last_clean":"2024-08-17T02:45:41.875455+0000","last_became_active":"2024-08-17T02:45:41.874847+0000","last_became_peered":"2024-08-17T02:45:41.874847+0000","last_unstale":"2024-08-17T02:45:41.875455+0000","last_undegraded":"2024-08-17T02:45:41.875455+0000","last_fullsized":"2024-08-17T02:45:41.875455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:51.387674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.849358+0000","last_change":"2024-08-17T02:45:41.845108+0000","last_active":"2024-08-17T02:45:41.849358+0000","last_peered":"2024-08-17T02:45:41.849358+0000","last_clean":"2024-08-17T02:45:41.849358+0000","last_became_active":"2024-08-17T02:45:41.844922+0000","last_became_peered":"2024-08-17T02:45:41.844922+0000","last_unstale":"2024-08-17T02:45:41.849358+0000","last_undegraded":"2024-08-17T02:45:41.849358+0000","last_fullsized":"2024-08-17T02:45:41.849358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:13.016129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.879469+0000","last_change":"2024-08-17T02:45:41.879469+0000","last_active":"2024-08-17T02:45:41.879469+0000","last_peered":"2024-08-17T02:45:41.879469+0000","last_clean":"2024-08-17T02:45:41.879469+0000","last_became_active":"2024-08-17T02:45:41.879191+0000","last_became_peered":"2024-08-17T02:45:41.879191+0000","last_unstale":"2024-08-17T02:45:41.879469+0000","last_undegraded":"2024-08-17T02:45:41.879469+0000","last_fullsized":"2024-08-17T02:45:41.879469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:36.351108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.869635+0000","last_change":"2024-08-17T02:45:41.865511+0000","last_active":"2024-08-17T02:45:41.869635+0000","last_peered":"2024-08-17T02:45:41.869635+0000","last_clean":"2024-08-17T02:45:41.869635+0000","last_became_active":"2024-08-17T02:45:41.865229+0000","last_became_peered":"2024-08-17T02:45:41.865229+0000","last_unstale":"2024-08-17T02:45:41.869635+0000","last_undegraded":"2024-08-17T02:45:41.869635+0000","last_fullsized":"2024-08-17T02:45:41.869635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:24.850532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.869380+0000","last_change":"2024-08-17T02:45:41.867609+0000","last_active":"2024-08-17T02:45:41.869380+0000","last_peered":"2024-08-17T02:45:41.869380+0000","last_clean":"2024-08-17T02:45:41.869380+0000","last_became_active":"2024-08-17T02:45:41.867267+0000","last_became_peered":"2024-08-17T02:45:41.867267+0000","last_unstale":"2024-08-17T02:45:41.869380+0000","last_undegraded":"2024-08-17T02:45:41.869380+0000","last_fullsized":"2024-08-17T02:45:41.869380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:36:25.246538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.878878+0000","last_change":"2024-08-17T02:45:41.878878+0000","last_active":"2024-08-17T02:45:41.878878+0000","last_peered":"2024-08-17T02:45:41.878878+0000","last_clean":"2024-08-17T02:45:41.878878+0000","last_became_active":"2024-08-17T02:45:41.876755+0000","last_became_peered":"2024-08-17T02:45:41.876755+0000","last_unstale":"2024-08-17T02:45:41.878878+0000","last_undegraded":"2024-08-17T02:45:41.878878+0000","last_fullsized":"2024-08-17T02:45:41.878878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:15.533277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.875157+0000","last_change":"2024-08-17T02:45:41.870345+0000","last_active":"2024-08-17T02:45:41.875157+0000","last_peered":"2024-08-17T02:45:41.875157+0000","last_clean":"2024-08-17T02:45:41.875157+0000","last_became_active":"2024-08-17T02:45:41.869995+0000","last_became_peered":"2024-08-17T02:45:41.869995+0000","last_unstale":"2024-08-17T02:45:41.875157+0000","last_undegraded":"2024-08-17T02:45:41.875157+0000","last_fullsized":"2024-08-17T02:45:41.875157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:27.590592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.865428+0000","last_change":"2024-08-17T02:45:41.865428+0000","last_active":"2024-08-17T02:45:41.865428+0000","last_peered":"2024-08-17T02:45:41.865428+0000","last_clean":"2024-08-17T02:45:41.865428+0000","last_became_active":"2024-08-17T02:45:41.865184+0000","last_became_peered":"2024-08-17T02:45:41.865184+0000","last_unstale":"2024-08-17T02:45:41.865428+0000","last_undegraded":"2024-08-17T02:45:41.865428+0000","last_fullsized":"2024-08-17T02:45:41.865428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:00.504734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.867141+0000","last_change":"2024-08-17T02:45:41.862050+0000","last_active":"2024-08-17T02:45:41.867141+0000","last_peered":"2024-08-17T02:45:41.867141+0000","last_clean":"2024-08-17T02:45:41.867141+0000","last_became_active":"2024-08-17T02:45:41.861754+0000","last_became_peered":"2024-08-17T02:45:41.861754+0000","last_unstale":"2024-08-17T02:45:41.867141+0000","last_undegraded":"2024-08-17T02:45:41.867141+0000","last_fullsized":"2024-08-17T02:45:41.867141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:31:57.128164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.861246+0000","last_change":"2024-08-17T02:45:41.861246+0000","last_active":"2024-08-17T02:45:41.861246+0000","last_peered":"2024-08-17T02:45:41.861246+0000","last_clean":"2024-08-17T02:45:41.861246+0000","last_became_active":"2024-08-17T02:45:41.860955+0000","last_became_peered":"2024-08-17T02:45:41.860955+0000","last_unstale":"2024-08-17T02:45:41.861246+0000","last_undegraded":"2024-08-17T02:45:41.861246+0000","last_fullsized":"2024-08-17T02:45:41.861246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:13.016129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.863642+0000","last_change":"2024-08-17T02:45:41.863642+0000","last_active":"2024-08-17T02:45:41.863642+0000","last_peered":"2024-08-17T02:45:41.863642+0000","last_clean":"2024-08-17T02:45:41.863642+0000","last_became_active":"2024-08-17T02:45:41.863379+0000","last_became_peered":"2024-08-17T02:45:41.863379+0000","last_unstale":"2024-08-17T02:45:41.863642+0000","last_undegraded":"2024-08-17T02:45:41.863642+0000","last_fullsized":"2024-08-17T02:45:41.863642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:26.094951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.877544+0000","last_change":"2024-08-17T02:45:41.872075+0000","last_active":"2024-08-17T02:45:41.877544+0000","last_peered":"2024-08-17T02:45:41.877544+0000","last_clean":"2024-08-17T02:45:41.877544+0000","last_became_active":"2024-08-17T02:45:41.871439+0000","last_became_peered":"2024-08-17T02:45:41.871439+0000","last_unstale":"2024-08-17T02:45:41.877544+0000","last_undegraded":"2024-08-17T02:45:41.877544+0000","last_fullsized":"2024-08-17T02:45:41.877544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:15.533277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.866609+0000","last_change":"2024-08-17T02:45:41.866609+0000","last_active":"2024-08-17T02:45:41.866609+0000","last_peered":"2024-08-17T02:45:41.866609+0000","last_clean":"2024-08-17T02:45:41.866609+0000","last_became_active":"2024-08-17T02:45:41.866323+0000","last_became_peered":"2024-08-17T02:45:41.866323+0000","last_unstale":"2024-08-17T02:45:41.866609+0000","last_undegraded":"2024-08-17T02:45:41.866609+0000","last_fullsized":"2024-08-17T02:45:41.866609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:52.201878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.884941+0000","last_change":"2024-08-17T02:45:41.881550+0000","last_active":"2024-08-17T02:45:41.884941+0000","last_peered":"2024-08-17T02:45:41.884941+0000","last_clean":"2024-08-17T02:45:41.884941+0000","last_became_active":"2024-08-17T02:45:41.881022+0000","last_became_peered":"2024-08-17T02:45:41.881022+0000","last_unstale":"2024-08-17T02:45:41.884941+0000","last_undegraded":"2024-08-17T02:45:41.884941+0000","last_fullsized":"2024-08-17T02:45:41.884941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:50:11.095464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.868514+0000","last_change":"2024-08-17T02:45:41.868514+0000","last_active":"2024-08-17T02:45:41.868514+0000","last_peered":"2024-08-17T02:45:41.868514+0000","last_clean":"2024-08-17T02:45:41.868514+0000","last_became_active":"2024-08-17T02:45:41.868230+0000","last_became_peered":"2024-08-17T02:45:41.868230+0000","last_unstale":"2024-08-17T02:45:41.868514+0000","last_undegraded":"2024-08-17T02:45:41.868514+0000","last_fullsized":"2024-08-17T02:45:41.868514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:31:57.128164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.860030+0000","last_change":"2024-08-17T02:45:41.860030+0000","last_active":"2024-08-17T02:45:41.860030+0000","last_peered":"2024-08-17T02:45:41.860030+0000","last_clean":"2024-08-17T02:45:41.860030+0000","last_became_active":"2024-08-17T02:45:41.859373+0000","last_became_peered":"2024-08-17T02:45:41.859373+0000","last_unstale":"2024-08-17T02:45:41.860030+0000","last_undegraded":"2024-08-17T02:45:41.860030+0000","last_fullsized":"2024-08-17T02:45:41.860030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:44:02.932481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.867355+0000","last_change":"2024-08-17T02:45:41.862826+0000","last_active":"2024-08-17T02:45:41.867355+0000","last_peered":"2024-08-17T02:45:41.867355+0000","last_clean":"2024-08-17T02:45:41.867355+0000","last_became_active":"2024-08-17T02:45:41.862601+0000","last_became_peered":"2024-08-17T02:45:41.862601+0000","last_unstale":"2024-08-17T02:45:41.867355+0000","last_undegraded":"2024-08-17T02:45:41.867355+0000","last_fullsized":"2024-08-17T02:45:41.867355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:31:57.128164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.853293+0000","last_change":"2024-08-17T02:45:41.853293+0000","last_active":"2024-08-17T02:45:41.853293+0000","last_peered":"2024-08-17T02:45:41.853293+0000","last_clean":"2024-08-17T02:45:41.853293+0000","last_became_active":"2024-08-17T02:45:41.853030+0000","last_became_peered":"2024-08-17T02:45:41.853030+0000","last_unstale":"2024-08-17T02:45:41.853293+0000","last_undegraded":"2024-08-17T02:45:41.853293+0000","last_fullsized":"2024-08-17T02:45:41.853293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:10:57.188283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.863593+0000","last_change":"2024-08-17T02:45:41.858360+0000","last_active":"2024-08-17T02:45:41.863593+0000","last_peered":"2024-08-17T02:45:41.863593+0000","last_clean":"2024-08-17T02:45:41.863593+0000","last_became_active":"2024-08-17T02:45:41.858129+0000","last_became_peered":"2024-08-17T02:45:41.858129+0000","last_unstale":"2024-08-17T02:45:41.863593+0000","last_undegraded":"2024-08-17T02:45:41.863593+0000","last_fullsized":"2024-08-17T02:45:41.863593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:00.504734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886048+0000","last_change":"2024-08-17T02:45:41.882941+0000","last_active":"2024-08-17T02:45:41.886048+0000","last_peered":"2024-08-17T02:45:41.886048+0000","last_clean":"2024-08-17T02:45:41.886048+0000","last_became_active":"2024-08-17T02:45:41.880910+0000","last_became_peered":"2024-08-17T02:45:41.880910+0000","last_unstale":"2024-08-17T02:45:41.886048+0000","last_undegraded":"2024-08-17T02:45:41.886048+0000","last_fullsized":"2024-08-17T02:45:41.886048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:35.831054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.859157+0000","last_change":"2024-08-17T02:45:41.855434+0000","last_active":"2024-08-17T02:45:41.859157+0000","last_peered":"2024-08-17T02:45:41.859157+0000","last_clean":"2024-08-17T02:45:41.859157+0000","last_became_active":"2024-08-17T02:45:41.855036+0000","last_became_peered":"2024-08-17T02:45:41.855036+0000","last_unstale":"2024-08-17T02:45:41.859157+0000","last_undegraded":"2024-08-17T02:45:41.859157+0000","last_fullsized":"2024-08-17T02:45:41.859157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:06.130481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.878219+0000","last_change":"2024-08-17T02:45:41.875037+0000","last_active":"2024-08-17T02:45:41.878219+0000","last_peered":"2024-08-17T02:45:41.878219+0000","last_clean":"2024-08-17T02:45:41.878219+0000","last_became_active":"2024-08-17T02:45:41.874745+0000","last_became_peered":"2024-08-17T02:45:41.874745+0000","last_unstale":"2024-08-17T02:45:41.878219+0000","last_undegraded":"2024-08-17T02:45:41.878219+0000","last_fullsized":"2024-08-17T02:45:41.878219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:07.343258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.860577+0000","last_change":"2024-08-17T02:45:41.860577+0000","last_active":"2024-08-17T02:45:41.860577+0000","last_peered":"2024-08-17T02:45:41.860577+0000","last_clean":"2024-08-17T02:45:41.860577+0000","last_became_active":"2024-08-17T02:45:41.857944+0000","last_became_peered":"2024-08-17T02:45:41.857944+0000","last_unstale":"2024-08-17T02:45:41.860577+0000","last_undegraded":"2024-08-17T02:45:41.860577+0000","last_fullsized":"2024-08-17T02:45:41.860577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:06.130481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.852863+0000","last_change":"2024-08-17T02:45:41.852863+0000","last_active":"2024-08-17T02:45:41.852863+0000","last_peered":"2024-08-17T02:45:41.852863+0000","last_clean":"2024-08-17T02:45:41.852863+0000","last_became_active":"2024-08-17T02:45:41.852578+0000","last_became_peered":"2024-08-17T02:45:41.852578+0000","last_unstale":"2024-08-17T02:45:41.852863+0000","last_undegraded":"2024-08-17T02:45:41.852863+0000","last_fullsized":"2024-08-17T02:45:41.852863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:27.590592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.851184+0000","last_change":"2024-08-17T02:45:41.846025+0000","last_active":"2024-08-17T02:45:41.851184+0000","last_peered":"2024-08-17T02:45:41.851184+0000","last_clean":"2024-08-17T02:45:41.851184+0000","last_became_active":"2024-08-17T02:45:41.845713+0000","last_became_peered":"2024-08-17T02:45:41.845713+0000","last_unstale":"2024-08-17T02:45:41.851184+0000","last_undegraded":"2024-08-17T02:45:41.851184+0000","last_fullsized":"2024-08-17T02:45:41.851184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:21.073718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.874435+0000","last_change":"2024-08-17T02:45:41.870783+0000","last_active":"2024-08-17T02:45:41.874435+0000","last_peered":"2024-08-17T02:45:41.874435+0000","last_clean":"2024-08-17T02:45:41.874435+0000","last_became_active":"2024-08-17T02:45:41.870550+0000","last_became_peered":"2024-08-17T02:45:41.870550+0000","last_unstale":"2024-08-17T02:45:41.874435+0000","last_undegraded":"2024-08-17T02:45:41.874435+0000","last_fullsized":"2024-08-17T02:45:41.874435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:55:47.666421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.860580+0000","last_change":"2024-08-17T02:45:41.860580+0000","last_active":"2024-08-17T02:45:41.860580+0000","last_peered":"2024-08-17T02:45:41.860580+0000","last_clean":"2024-08-17T02:45:41.860580+0000","last_became_active":"2024-08-17T02:45:41.860364+0000","last_became_peered":"2024-08-17T02:45:41.860364+0000","last_unstale":"2024-08-17T02:45:41.860580+0000","last_undegraded":"2024-08-17T02:45:41.860580+0000","last_fullsized":"2024-08-17T02:45:41.860580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:44.911480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.878927+0000","last_change":"2024-08-17T02:45:40.856192+0000","last_active":"2024-08-17T02:45:41.878927+0000","last_peered":"2024-08-17T02:45:41.878927+0000","last_clean":"2024-08-17T02:45:41.878927+0000","last_became_active":"2024-08-17T02:45:40.856008+0000","last_became_peered":"2024-08-17T02:45:40.856008+0000","last_unstale":"2024-08-17T02:45:41.878927+0000","last_undegraded":"2024-08-17T02:45:41.878927+0000","last_fullsized":"2024-08-17T02:45:41.878927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:03.324359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.860685+0000","last_change":"2024-08-17T02:45:41.860685+0000","last_active":"2024-08-17T02:45:41.860685+0000","last_peered":"2024-08-17T02:45:41.860685+0000","last_clean":"2024-08-17T02:45:41.860685+0000","last_became_active":"2024-08-17T02:45:41.858422+0000","last_became_peered":"2024-08-17T02:45:41.858422+0000","last_unstale":"2024-08-17T02:45:41.860685+0000","last_undegraded":"2024-08-17T02:45:41.860685+0000","last_fullsized":"2024-08-17T02:45:41.860685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:25.446485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.883276+0000","last_change":"2024-08-17T02:45:40.850702+0000","last_active":"2024-08-17T02:45:41.883276+0000","last_peered":"2024-08-17T02:45:41.883276+0000","last_clean":"2024-08-17T02:45:41.883276+0000","last_became_active":"2024-08-17T02:45:40.850384+0000","last_became_peered":"2024-08-17T02:45:40.850384+0000","last_unstale":"2024-08-17T02:45:41.883276+0000","last_undegraded":"2024-08-17T02:45:41.883276+0000","last_fullsized":"2024-08-17T02:45:41.883276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:38:15.702366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.840461+0000","last_change":"2024-08-17T02:45:40.847576+0000","last_active":"2024-08-17T02:45:41.840461+0000","last_peered":"2024-08-17T02:45:41.840461+0000","last_clean":"2024-08-17T02:45:41.840461+0000","last_became_active":"2024-08-17T02:45:40.847319+0000","last_became_peered":"2024-08-17T02:45:40.847319+0000","last_unstale":"2024-08-17T02:45:41.840461+0000","last_undegraded":"2024-08-17T02:45:41.840461+0000","last_fullsized":"2024-08-17T02:45:41.840461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:19.561224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.863488+0000","last_change":"2024-08-17T02:45:41.857865+0000","last_active":"2024-08-17T02:45:41.863488+0000","last_peered":"2024-08-17T02:45:41.863488+0000","last_clean":"2024-08-17T02:45:41.863488+0000","last_became_active":"2024-08-17T02:45:41.857585+0000","last_became_peered":"2024-08-17T02:45:41.857585+0000","last_unstale":"2024-08-17T02:45:41.863488+0000","last_undegraded":"2024-08-17T02:45:41.863488+0000","last_fullsized":"2024-08-17T02:45:41.863488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:10:57.188283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:45:40.857373+0000","last_change":"2024-08-17T02:45:40.853724+0000","last_active":"2024-08-17T02:45:40.857373+0000","last_peered":"2024-08-17T02:45:40.857373+0000","last_clean":"2024-08-17T02:45:40.857373+0000","last_became_active":"2024-08-17T02:45:40.848438+0000","last_became_peered":"2024-08-17T02:45:40.848438+0000","last_unstale":"2024-08-17T02:45:40.857373+0000","last_undegraded":"2024-08-17T02:45:40.857373+0000","last_fullsized":"2024-08-17T02:45:40.857373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:52:22.103135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.859791+0000","last_change":"2024-08-17T02:45:41.856281+0000","last_active":"2024-08-17T02:45:41.859791+0000","last_peered":"2024-08-17T02:45:41.859791+0000","last_clean":"2024-08-17T02:45:41.859791+0000","last_became_active":"2024-08-17T02:45:41.855982+0000","last_became_peered":"2024-08-17T02:45:41.855982+0000","last_unstale":"2024-08-17T02:45:41.859791+0000","last_undegraded":"2024-08-17T02:45:41.859791+0000","last_fullsized":"2024-08-17T02:45:41.859791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:10:57.188283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.865649+0000","last_change":"2024-08-17T02:45:40.856916+0000","last_active":"2024-08-17T02:45:41.865649+0000","last_peered":"2024-08-17T02:45:41.865649+0000","last_clean":"2024-08-17T02:45:41.865649+0000","last_became_active":"2024-08-17T02:45:40.856729+0000","last_became_peered":"2024-08-17T02:45:40.856729+0000","last_unstale":"2024-08-17T02:45:41.865649+0000","last_undegraded":"2024-08-17T02:45:41.865649+0000","last_fullsized":"2024-08-17T02:45:41.865649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:27.561597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.876111+0000","last_change":"2024-08-17T02:45:41.876111+0000","last_active":"2024-08-17T02:45:41.876111+0000","last_peered":"2024-08-17T02:45:41.876111+0000","last_clean":"2024-08-17T02:45:41.876111+0000","last_became_active":"2024-08-17T02:45:41.872909+0000","last_became_peered":"2024-08-17T02:45:41.872909+0000","last_unstale":"2024-08-17T02:45:41.876111+0000","last_undegraded":"2024-08-17T02:45:41.876111+0000","last_fullsized":"2024-08-17T02:45:41.876111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:37.395022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:45:40.862923+0000","last_change":"2024-08-17T02:45:40.861062+0000","last_active":"2024-08-17T02:45:40.862923+0000","last_peered":"2024-08-17T02:45:40.862923+0000","last_clean":"2024-08-17T02:45:40.862923+0000","last_became_active":"2024-08-17T02:45:40.860760+0000","last_became_peered":"2024-08-17T02:45:40.860760+0000","last_unstale":"2024-08-17T02:45:40.862923+0000","last_undegraded":"2024-08-17T02:45:40.862923+0000","last_fullsized":"2024-08-17T02:45:40.862923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:19.561224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.863001+0000","last_change":"2024-08-17T02:45:41.863001+0000","last_active":"2024-08-17T02:45:41.863001+0000","last_peered":"2024-08-17T02:45:41.863001+0000","last_clean":"2024-08-17T02:45:41.863001+0000","last_became_active":"2024-08-17T02:45:41.862662+0000","last_became_peered":"2024-08-17T02:45:41.862662+0000","last_unstale":"2024-08-17T02:45:41.863001+0000","last_undegraded":"2024-08-17T02:45:41.863001+0000","last_fullsized":"2024-08-17T02:45:41.863001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:10:57.188283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.889508+0000","last_change":"2024-08-17T02:45:40.853331+0000","last_active":"2024-08-17T02:45:41.889508+0000","last_peered":"2024-08-17T02:45:41.889508+0000","last_clean":"2024-08-17T02:45:41.889508+0000","last_became_active":"2024-08-17T02:45:40.853029+0000","last_became_peered":"2024-08-17T02:45:40.853029+0000","last_unstale":"2024-08-17T02:45:41.889508+0000","last_undegraded":"2024-08-17T02:45:41.889508+0000","last_fullsized":"2024-08-17T02:45:41.889508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:43.905610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.872156+0000","last_change":"2024-08-17T02:45:41.872156+0000","last_active":"2024-08-17T02:45:41.872156+0000","last_peered":"2024-08-17T02:45:41.872156+0000","last_clean":"2024-08-17T02:45:41.872156+0000","last_became_active":"2024-08-17T02:45:41.867463+0000","last_became_peered":"2024-08-17T02:45:41.867463+0000","last_unstale":"2024-08-17T02:45:41.872156+0000","last_undegraded":"2024-08-17T02:45:41.872156+0000","last_fullsized":"2024-08-17T02:45:41.872156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:21.073718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886214+0000","last_change":"2024-08-17T02:45:40.843999+0000","last_active":"2024-08-17T02:45:41.886214+0000","last_peered":"2024-08-17T02:45:41.886214+0000","last_clean":"2024-08-17T02:45:41.886214+0000","last_became_active":"2024-08-17T02:45:40.843713+0000","last_became_peered":"2024-08-17T02:45:40.843713+0000","last_unstale":"2024-08-17T02:45:41.886214+0000","last_undegraded":"2024-08-17T02:45:41.886214+0000","last_fullsized":"2024-08-17T02:45:41.886214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:11.722334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.866615+0000","last_change":"2024-08-17T02:45:41.866615+0000","last_active":"2024-08-17T02:45:41.866615+0000","last_peered":"2024-08-17T02:45:41.866615+0000","last_clean":"2024-08-17T02:45:41.866615+0000","last_became_active":"2024-08-17T02:45:41.865961+0000","last_became_peered":"2024-08-17T02:45:41.865961+0000","last_unstale":"2024-08-17T02:45:41.866615+0000","last_undegraded":"2024-08-17T02:45:41.866615+0000","last_fullsized":"2024-08-17T02:45:41.866615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:05.492164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.883278+0000","last_change":"2024-08-17T02:45:40.847584+0000","last_active":"2024-08-17T02:45:41.883278+0000","last_peered":"2024-08-17T02:45:41.883278+0000","last_clean":"2024-08-17T02:45:41.883278+0000","last_became_active":"2024-08-17T02:45:40.847259+0000","last_became_peered":"2024-08-17T02:45:40.847259+0000","last_unstale":"2024-08-17T02:45:41.883278+0000","last_undegraded":"2024-08-17T02:45:41.883278+0000","last_fullsized":"2024-08-17T02:45:41.883278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:00:43.864087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.864969+0000","last_change":"2024-08-17T02:45:41.864969+0000","last_active":"2024-08-17T02:45:41.864969+0000","last_peered":"2024-08-17T02:45:41.864969+0000","last_clean":"2024-08-17T02:45:41.864969+0000","last_became_active":"2024-08-17T02:45:41.860538+0000","last_became_peered":"2024-08-17T02:45:41.860538+0000","last_unstale":"2024-08-17T02:45:41.864969+0000","last_undegraded":"2024-08-17T02:45:41.864969+0000","last_fullsized":"2024-08-17T02:45:41.864969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:16:34.733391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:45:40.857432+0000","last_change":"2024-08-17T02:45:40.853949+0000","last_active":"2024-08-17T02:45:40.857432+0000","last_peered":"2024-08-17T02:45:40.857432+0000","last_clean":"2024-08-17T02:45:40.857432+0000","last_became_active":"2024-08-17T02:45:40.852638+0000","last_became_peered":"2024-08-17T02:45:40.852638+0000","last_unstale":"2024-08-17T02:45:40.857432+0000","last_undegraded":"2024-08-17T02:45:40.857432+0000","last_fullsized":"2024-08-17T02:45:40.857432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:03.324359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.876365+0000","last_change":"2024-08-17T02:45:41.876365+0000","last_active":"2024-08-17T02:45:41.876365+0000","last_peered":"2024-08-17T02:45:41.876365+0000","last_clean":"2024-08-17T02:45:41.876365+0000","last_became_active":"2024-08-17T02:45:41.876110+0000","last_became_peered":"2024-08-17T02:45:41.876110+0000","last_unstale":"2024-08-17T02:45:41.876365+0000","last_undegraded":"2024-08-17T02:45:41.876365+0000","last_fullsized":"2024-08-17T02:45:41.876365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:52.363743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.851754+0000","last_change":"2024-08-17T02:45:40.845008+0000","last_active":"2024-08-17T02:45:41.851754+0000","last_peered":"2024-08-17T02:45:41.851754+0000","last_clean":"2024-08-17T02:45:41.851754+0000","last_became_active":"2024-08-17T02:45:40.842289+0000","last_became_peered":"2024-08-17T02:45:40.842289+0000","last_unstale":"2024-08-17T02:45:41.851754+0000","last_undegraded":"2024-08-17T02:45:41.851754+0000","last_fullsized":"2024-08-17T02:45:41.851754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:48.334950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.870954+0000","last_change":"2024-08-17T02:45:41.864016+0000","last_active":"2024-08-17T02:45:41.870954+0000","last_peered":"2024-08-17T02:45:41.870954+0000","last_clean":"2024-08-17T02:45:41.870954+0000","last_became_active":"2024-08-17T02:45:41.863757+0000","last_became_peered":"2024-08-17T02:45:41.863757+0000","last_unstale":"2024-08-17T02:45:41.870954+0000","last_undegraded":"2024-08-17T02:45:41.870954+0000","last_fullsized":"2024-08-17T02:45:41.870954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:03.754114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.878538+0000","last_change":"2024-08-17T02:45:40.835613+0000","last_active":"2024-08-17T02:45:41.878538+0000","last_peered":"2024-08-17T02:45:41.878538+0000","last_clean":"2024-08-17T02:45:41.878538+0000","last_became_active":"2024-08-17T02:45:40.835051+0000","last_became_peered":"2024-08-17T02:45:40.835051+0000","last_unstale":"2024-08-17T02:45:41.878538+0000","last_undegraded":"2024-08-17T02:45:41.878538+0000","last_fullsized":"2024-08-17T02:45:41.878538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:13.885252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.876204+0000","last_change":"2024-08-17T02:45:41.876204+0000","last_active":"2024-08-17T02:45:41.876204+0000","last_peered":"2024-08-17T02:45:41.876204+0000","last_clean":"2024-08-17T02:45:41.876204+0000","last_became_active":"2024-08-17T02:45:41.875536+0000","last_became_peered":"2024-08-17T02:45:41.875536+0000","last_unstale":"2024-08-17T02:45:41.876204+0000","last_undegraded":"2024-08-17T02:45:41.876204+0000","last_fullsized":"2024-08-17T02:45:41.876204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:47:30.233998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.852138+0000","last_change":"2024-08-17T02:45:40.852072+0000","last_active":"2024-08-17T02:45:41.852138+0000","last_peered":"2024-08-17T02:45:41.852138+0000","last_clean":"2024-08-17T02:45:41.852138+0000","last_became_active":"2024-08-17T02:45:40.851346+0000","last_became_peered":"2024-08-17T02:45:40.851346+0000","last_unstale":"2024-08-17T02:45:41.852138+0000","last_undegraded":"2024-08-17T02:45:41.852138+0000","last_fullsized":"2024-08-17T02:45:41.852138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:26:40.603861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.884514+0000","last_change":"2024-08-17T02:45:41.884514+0000","last_active":"2024-08-17T02:45:41.884514+0000","last_peered":"2024-08-17T02:45:41.884514+0000","last_clean":"2024-08-17T02:45:41.884514+0000","last_became_active":"2024-08-17T02:45:41.883843+0000","last_became_peered":"2024-08-17T02:45:41.883843+0000","last_unstale":"2024-08-17T02:45:41.884514+0000","last_undegraded":"2024-08-17T02:45:41.884514+0000","last_fullsized":"2024-08-17T02:45:41.884514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:08:27.775215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.873328+0000","last_change":"2024-08-17T02:45:40.842420+0000","last_active":"2024-08-17T02:45:41.873328+0000","last_peered":"2024-08-17T02:45:41.873328+0000","last_clean":"2024-08-17T02:45:41.873328+0000","last_became_active":"2024-08-17T02:45:40.842134+0000","last_became_peered":"2024-08-17T02:45:40.842134+0000","last_unstale":"2024-08-17T02:45:41.873328+0000","last_undegraded":"2024-08-17T02:45:41.873328+0000","last_fullsized":"2024-08-17T02:45:41.873328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:19.561224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.885453+0000","last_change":"2024-08-17T02:45:41.885453+0000","last_active":"2024-08-17T02:45:41.885453+0000","last_peered":"2024-08-17T02:45:41.885453+0000","last_clean":"2024-08-17T02:45:41.885453+0000","last_became_active":"2024-08-17T02:45:41.885194+0000","last_became_peered":"2024-08-17T02:45:41.885194+0000","last_unstale":"2024-08-17T02:45:41.885453+0000","last_undegraded":"2024-08-17T02:45:41.885453+0000","last_fullsized":"2024-08-17T02:45:41.885453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:41:42.486969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886577+0000","last_change":"2024-08-17T02:45:40.843903+0000","last_active":"2024-08-17T02:45:41.886577+0000","last_peered":"2024-08-17T02:45:41.886577+0000","last_clean":"2024-08-17T02:45:41.886577+0000","last_became_active":"2024-08-17T02:45:40.841473+0000","last_became_peered":"2024-08-17T02:45:40.841473+0000","last_unstale":"2024-08-17T02:45:41.886577+0000","last_undegraded":"2024-08-17T02:45:41.886577+0000","last_fullsized":"2024-08-17T02:45:41.886577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:20.067847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.849797+0000","last_change":"2024-08-17T02:45:41.849797+0000","last_active":"2024-08-17T02:45:41.849797+0000","last_peered":"2024-08-17T02:45:41.849797+0000","last_clean":"2024-08-17T02:45:41.849797+0000","last_became_active":"2024-08-17T02:45:41.849495+0000","last_became_peered":"2024-08-17T02:45:41.849495+0000","last_unstale":"2024-08-17T02:45:41.849797+0000","last_undegraded":"2024-08-17T02:45:41.849797+0000","last_fullsized":"2024-08-17T02:45:41.849797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:44.220882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.841551+0000","last_change":"2024-08-17T02:45:40.858186+0000","last_active":"2024-08-17T02:45:41.841551+0000","last_peered":"2024-08-17T02:45:41.841551+0000","last_clean":"2024-08-17T02:45:41.841551+0000","last_became_active":"2024-08-17T02:45:40.857956+0000","last_became_peered":"2024-08-17T02:45:40.857956+0000","last_unstale":"2024-08-17T02:45:41.841551+0000","last_undegraded":"2024-08-17T02:45:41.841551+0000","last_fullsized":"2024-08-17T02:45:41.841551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:52:22.103135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.866120+0000","last_change":"2024-08-17T02:45:41.866120+0000","last_active":"2024-08-17T02:45:41.866120+0000","last_peered":"2024-08-17T02:45:41.866120+0000","last_clean":"2024-08-17T02:45:41.866120+0000","last_became_active":"2024-08-17T02:45:41.865856+0000","last_became_peered":"2024-08-17T02:45:41.865856+0000","last_unstale":"2024-08-17T02:45:41.866120+0000","last_undegraded":"2024-08-17T02:45:41.866120+0000","last_fullsized":"2024-08-17T02:45:41.866120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:50:37.265026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":162,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:45:40.845914+0000","last_change":"2024-08-17T02:45:37.011679+0000","last_active":"2024-08-17T02:45:40.845914+0000","last_peered":"2024-08-17T02:45:40.845914+0000","last_clean":"2024-08-17T02:45:40.845914+0000","last_became_active":"2024-08-17T02:45:37.010559+0000","last_became_peered":"2024-08-17T02:45:37.010559+0000","last_unstale":"2024-08-17T02:45:40.845914+0000","last_undegraded":"2024-08-17T02:45:40.845914+0000","last_fullsized":"2024-08-17T02:45:40.845914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:35.708391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:35.708391+0000","last_clean_scrub_stamp":"2024-08-17T02:45:35.708391+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:11.380093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:45:40.856272+0000","last_change":"2024-08-17T02:45:40.848763+0000","last_active":"2024-08-17T02:45:40.856272+0000","last_peered":"2024-08-17T02:45:40.856272+0000","last_clean":"2024-08-17T02:45:40.856272+0000","last_became_active":"2024-08-17T02:45:40.847935+0000","last_became_peered":"2024-08-17T02:45:40.847935+0000","last_unstale":"2024-08-17T02:45:40.856272+0000","last_undegraded":"2024-08-17T02:45:40.856272+0000","last_fullsized":"2024-08-17T02:45:40.856272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:15.864750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.851312+0000","last_change":"2024-08-17T02:45:41.846412+0000","last_active":"2024-08-17T02:45:41.851312+0000","last_peered":"2024-08-17T02:45:41.851312+0000","last_clean":"2024-08-17T02:45:41.851312+0000","last_became_active":"2024-08-17T02:45:41.846136+0000","last_became_peered":"2024-08-17T02:45:41.846136+0000","last_unstale":"2024-08-17T02:45:41.851312+0000","last_undegraded":"2024-08-17T02:45:41.851312+0000","last_fullsized":"2024-08-17T02:45:41.851312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:06.130481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:45:40.862708+0000","last_change":"2024-08-17T02:45:40.858420+0000","last_active":"2024-08-17T02:45:40.862708+0000","last_peered":"2024-08-17T02:45:40.862708+0000","last_clean":"2024-08-17T02:45:40.862708+0000","last_became_active":"2024-08-17T02:45:40.858149+0000","last_became_peered":"2024-08-17T02:45:40.858149+0000","last_unstale":"2024-08-17T02:45:40.862708+0000","last_undegraded":"2024-08-17T02:45:40.862708+0000","last_fullsized":"2024-08-17T02:45:40.862708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:48.334950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.864808+0000","last_change":"2024-08-17T02:45:41.864808+0000","last_active":"2024-08-17T02:45:41.864808+0000","last_peered":"2024-08-17T02:45:41.864808+0000","last_clean":"2024-08-17T02:45:41.864808+0000","last_became_active":"2024-08-17T02:45:41.864397+0000","last_became_peered":"2024-08-17T02:45:41.864397+0000","last_unstale":"2024-08-17T02:45:41.864808+0000","last_undegraded":"2024-08-17T02:45:41.864808+0000","last_fullsized":"2024-08-17T02:45:41.864808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:44.425401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.842270+0000","last_change":"2024-08-17T02:45:40.843284+0000","last_active":"2024-08-17T02:45:41.842270+0000","last_peered":"2024-08-17T02:45:41.842270+0000","last_clean":"2024-08-17T02:45:41.842270+0000","last_became_active":"2024-08-17T02:45:40.842914+0000","last_became_peered":"2024-08-17T02:45:40.842914+0000","last_unstale":"2024-08-17T02:45:41.842270+0000","last_undegraded":"2024-08-17T02:45:41.842270+0000","last_fullsized":"2024-08-17T02:45:41.842270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:03.324359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.859058+0000","last_change":"2024-08-17T02:45:41.855267+0000","last_active":"2024-08-17T02:45:41.859058+0000","last_peered":"2024-08-17T02:45:41.859058+0000","last_clean":"2024-08-17T02:45:41.859058+0000","last_became_active":"2024-08-17T02:45:41.854987+0000","last_became_peered":"2024-08-17T02:45:41.854987+0000","last_unstale":"2024-08-17T02:45:41.859058+0000","last_undegraded":"2024-08-17T02:45:41.859058+0000","last_fullsized":"2024-08-17T02:45:41.859058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:00.504734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:45:40.856015+0000","last_change":"2024-08-17T02:45:40.848058+0000","last_active":"2024-08-17T02:45:40.856015+0000","last_peered":"2024-08-17T02:45:40.856015+0000","last_clean":"2024-08-17T02:45:40.856015+0000","last_became_active":"2024-08-17T02:45:40.846274+0000","last_became_peered":"2024-08-17T02:45:40.846274+0000","last_unstale":"2024-08-17T02:45:40.856015+0000","last_undegraded":"2024-08-17T02:45:40.856015+0000","last_fullsized":"2024-08-17T02:45:40.856015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:13.885252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.864247+0000","last_change":"2024-08-17T02:45:41.864247+0000","last_active":"2024-08-17T02:45:41.864247+0000","last_peered":"2024-08-17T02:45:41.864247+0000","last_clean":"2024-08-17T02:45:41.864247+0000","last_became_active":"2024-08-17T02:45:41.861904+0000","last_became_peered":"2024-08-17T02:45:41.861904+0000","last_unstale":"2024-08-17T02:45:41.864247+0000","last_undegraded":"2024-08-17T02:45:41.864247+0000","last_fullsized":"2024-08-17T02:45:41.864247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:25.446485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.847751+0000","last_change":"2024-08-17T02:45:40.851172+0000","last_active":"2024-08-17T02:45:41.847751+0000","last_peered":"2024-08-17T02:45:41.847751+0000","last_clean":"2024-08-17T02:45:41.847751+0000","last_became_active":"2024-08-17T02:45:40.850891+0000","last_became_peered":"2024-08-17T02:45:40.850891+0000","last_unstale":"2024-08-17T02:45:41.847751+0000","last_undegraded":"2024-08-17T02:45:41.847751+0000","last_fullsized":"2024-08-17T02:45:41.847751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:30.021288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.853051+0000","last_change":"2024-08-17T02:45:41.853051+0000","last_active":"2024-08-17T02:45:41.853051+0000","last_peered":"2024-08-17T02:45:41.853051+0000","last_clean":"2024-08-17T02:45:41.853051+0000","last_became_active":"2024-08-17T02:45:41.852732+0000","last_became_peered":"2024-08-17T02:45:41.852732+0000","last_unstale":"2024-08-17T02:45:41.853051+0000","last_undegraded":"2024-08-17T02:45:41.853051+0000","last_fullsized":"2024-08-17T02:45:41.853051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:06.130481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:45:40.868933+0000","last_change":"2024-08-17T02:45:40.863294+0000","last_active":"2024-08-17T02:45:40.868933+0000","last_peered":"2024-08-17T02:45:40.868933+0000","last_clean":"2024-08-17T02:45:40.868933+0000","last_became_active":"2024-08-17T02:45:40.863098+0000","last_became_peered":"2024-08-17T02:45:40.863098+0000","last_unstale":"2024-08-17T02:45:40.868933+0000","last_undegraded":"2024-08-17T02:45:40.868933+0000","last_fullsized":"2024-08-17T02:45:40.868933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:34:13.760542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.858888+0000","last_change":"2024-08-17T02:45:41.852369+0000","last_active":"2024-08-17T02:45:41.858888+0000","last_peered":"2024-08-17T02:45:41.858888+0000","last_clean":"2024-08-17T02:45:41.858888+0000","last_became_active":"2024-08-17T02:45:41.852188+0000","last_became_peered":"2024-08-17T02:45:41.852188+0000","last_unstale":"2024-08-17T02:45:41.858888+0000","last_undegraded":"2024-08-17T02:45:41.858888+0000","last_fullsized":"2024-08-17T02:45:41.858888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:35:47.023580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.848562+0000","last_change":"2024-08-17T02:45:40.854078+0000","last_active":"2024-08-17T02:45:41.848562+0000","last_peered":"2024-08-17T02:45:41.848562+0000","last_clean":"2024-08-17T02:45:41.848562+0000","last_became_active":"2024-08-17T02:45:40.853737+0000","last_became_peered":"2024-08-17T02:45:40.853737+0000","last_unstale":"2024-08-17T02:45:41.848562+0000","last_undegraded":"2024-08-17T02:45:41.848562+0000","last_fullsized":"2024-08-17T02:45:41.848562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:43.419530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.865212+0000","last_change":"2024-08-17T02:45:41.861623+0000","last_active":"2024-08-17T02:45:41.865212+0000","last_peered":"2024-08-17T02:45:41.865212+0000","last_clean":"2024-08-17T02:45:41.865212+0000","last_became_active":"2024-08-17T02:45:41.861378+0000","last_became_peered":"2024-08-17T02:45:41.861378+0000","last_unstale":"2024-08-17T02:45:41.865212+0000","last_undegraded":"2024-08-17T02:45:41.865212+0000","last_fullsized":"2024-08-17T02:45:41.865212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:01.344799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.881441+0000","last_change":"2024-08-17T02:45:40.857808+0000","last_active":"2024-08-17T02:45:41.881441+0000","last_peered":"2024-08-17T02:45:41.881441+0000","last_clean":"2024-08-17T02:45:41.881441+0000","last_became_active":"2024-08-17T02:45:40.857551+0000","last_became_peered":"2024-08-17T02:45:40.857551+0000","last_unstale":"2024-08-17T02:45:41.881441+0000","last_undegraded":"2024-08-17T02:45:41.881441+0000","last_fullsized":"2024-08-17T02:45:41.881441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:08.041685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.864378+0000","last_change":"2024-08-17T02:45:41.864378+0000","last_active":"2024-08-17T02:45:41.864378+0000","last_peered":"2024-08-17T02:45:41.864378+0000","last_clean":"2024-08-17T02:45:41.864378+0000","last_became_active":"2024-08-17T02:45:41.864154+0000","last_became_peered":"2024-08-17T02:45:41.864154+0000","last_unstale":"2024-08-17T02:45:41.864378+0000","last_undegraded":"2024-08-17T02:45:41.864378+0000","last_fullsized":"2024-08-17T02:45:41.864378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:02.801412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:45:40.862657+0000","last_change":"2024-08-17T02:45:40.857559+0000","last_active":"2024-08-17T02:45:40.862657+0000","last_peered":"2024-08-17T02:45:40.862657+0000","last_clean":"2024-08-17T02:45:40.862657+0000","last_became_active":"2024-08-17T02:45:40.856889+0000","last_became_peered":"2024-08-17T02:45:40.856889+0000","last_unstale":"2024-08-17T02:45:40.862657+0000","last_undegraded":"2024-08-17T02:45:40.862657+0000","last_fullsized":"2024-08-17T02:45:40.862657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:26.959391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.861090+0000","last_change":"2024-08-17T02:45:41.861090+0000","last_active":"2024-08-17T02:45:41.861090+0000","last_peered":"2024-08-17T02:45:41.861090+0000","last_clean":"2024-08-17T02:45:41.861090+0000","last_became_active":"2024-08-17T02:45:41.860752+0000","last_became_peered":"2024-08-17T02:45:41.860752+0000","last_unstale":"2024-08-17T02:45:41.861090+0000","last_undegraded":"2024-08-17T02:45:41.861090+0000","last_fullsized":"2024-08-17T02:45:41.861090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:44.425401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.849695+0000","last_change":"2024-08-17T02:45:40.855151+0000","last_active":"2024-08-17T02:45:41.849695+0000","last_peered":"2024-08-17T02:45:41.849695+0000","last_clean":"2024-08-17T02:45:41.849695+0000","last_became_active":"2024-08-17T02:45:40.854968+0000","last_became_peered":"2024-08-17T02:45:40.854968+0000","last_unstale":"2024-08-17T02:45:41.849695+0000","last_undegraded":"2024-08-17T02:45:41.849695+0000","last_fullsized":"2024-08-17T02:45:41.849695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:13.885252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.861997+0000","last_change":"2024-08-17T02:45:41.857268+0000","last_active":"2024-08-17T02:45:41.861997+0000","last_peered":"2024-08-17T02:45:41.861997+0000","last_clean":"2024-08-17T02:45:41.861997+0000","last_became_active":"2024-08-17T02:45:41.856839+0000","last_became_peered":"2024-08-17T02:45:41.856839+0000","last_unstale":"2024-08-17T02:45:41.861997+0000","last_undegraded":"2024-08-17T02:45:41.861997+0000","last_fullsized":"2024-08-17T02:45:41.861997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:25.446485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.848840+0000","last_change":"2024-08-17T02:45:40.843100+0000","last_active":"2024-08-17T02:45:41.848840+0000","last_peered":"2024-08-17T02:45:41.848840+0000","last_clean":"2024-08-17T02:45:41.848840+0000","last_became_active":"2024-08-17T02:45:40.842206+0000","last_became_peered":"2024-08-17T02:45:40.842206+0000","last_unstale":"2024-08-17T02:45:41.848840+0000","last_undegraded":"2024-08-17T02:45:41.848840+0000","last_fullsized":"2024-08-17T02:45:41.848840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:52:22.103135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.872919+0000","last_change":"2024-08-17T02:45:41.865819+0000","last_active":"2024-08-17T02:45:41.872919+0000","last_peered":"2024-08-17T02:45:41.872919+0000","last_clean":"2024-08-17T02:45:41.872919+0000","last_became_active":"2024-08-17T02:45:41.865537+0000","last_became_peered":"2024-08-17T02:45:41.865537+0000","last_unstale":"2024-08-17T02:45:41.872919+0000","last_undegraded":"2024-08-17T02:45:41.872919+0000","last_fullsized":"2024-08-17T02:45:41.872919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:44.220882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.887121+0000","last_change":"2024-08-17T02:45:40.861158+0000","last_active":"2024-08-17T02:45:41.887121+0000","last_peered":"2024-08-17T02:45:41.887121+0000","last_clean":"2024-08-17T02:45:41.887121+0000","last_became_active":"2024-08-17T02:45:40.860714+0000","last_became_peered":"2024-08-17T02:45:40.860714+0000","last_unstale":"2024-08-17T02:45:41.887121+0000","last_undegraded":"2024-08-17T02:45:41.887121+0000","last_fullsized":"2024-08-17T02:45:41.887121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:52:04.471737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.885525+0000","last_change":"2024-08-17T02:45:41.881747+0000","last_active":"2024-08-17T02:45:41.885525+0000","last_peered":"2024-08-17T02:45:41.885525+0000","last_clean":"2024-08-17T02:45:41.885525+0000","last_became_active":"2024-08-17T02:45:41.880618+0000","last_became_peered":"2024-08-17T02:45:41.880618+0000","last_unstale":"2024-08-17T02:45:41.885525+0000","last_undegraded":"2024-08-17T02:45:41.885525+0000","last_fullsized":"2024-08-17T02:45:41.885525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:03:23.967191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.862264+0000","last_change":"2024-08-17T02:45:41.862264+0000","last_active":"2024-08-17T02:45:41.862264+0000","last_peered":"2024-08-17T02:45:41.862264+0000","last_clean":"2024-08-17T02:45:41.862264+0000","last_became_active":"2024-08-17T02:45:41.862036+0000","last_became_peered":"2024-08-17T02:45:41.862036+0000","last_unstale":"2024-08-17T02:45:41.862264+0000","last_undegraded":"2024-08-17T02:45:41.862264+0000","last_fullsized":"2024-08-17T02:45:41.862264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:31:57.128164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886803+0000","last_change":"2024-08-17T02:45:40.860423+0000","last_active":"2024-08-17T02:45:41.886803+0000","last_peered":"2024-08-17T02:45:41.886803+0000","last_clean":"2024-08-17T02:45:41.886803+0000","last_became_active":"2024-08-17T02:45:40.860126+0000","last_became_peered":"2024-08-17T02:45:40.860126+0000","last_unstale":"2024-08-17T02:45:41.886803+0000","last_undegraded":"2024-08-17T02:45:41.886803+0000","last_fullsized":"2024-08-17T02:45:41.886803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:43:21.770605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.880348+0000","last_change":"2024-08-17T02:45:41.880348+0000","last_active":"2024-08-17T02:45:41.880348+0000","last_peered":"2024-08-17T02:45:41.880348+0000","last_clean":"2024-08-17T02:45:41.880348+0000","last_became_active":"2024-08-17T02:45:41.879896+0000","last_became_peered":"2024-08-17T02:45:41.879896+0000","last_unstale":"2024-08-17T02:45:41.880348+0000","last_undegraded":"2024-08-17T02:45:41.880348+0000","last_fullsized":"2024-08-17T02:45:41.880348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:09.195225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886010+0000","last_change":"2024-08-17T02:45:40.862857+0000","last_active":"2024-08-17T02:45:41.886010+0000","last_peered":"2024-08-17T02:45:41.886010+0000","last_clean":"2024-08-17T02:45:41.886010+0000","last_became_active":"2024-08-17T02:45:40.862629+0000","last_became_peered":"2024-08-17T02:45:40.862629+0000","last_unstale":"2024-08-17T02:45:41.886010+0000","last_undegraded":"2024-08-17T02:45:41.886010+0000","last_fullsized":"2024-08-17T02:45:41.886010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:30:25.700503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.863606+0000","last_change":"2024-08-17T02:45:41.863606+0000","last_active":"2024-08-17T02:45:41.863606+0000","last_peered":"2024-08-17T02:45:41.863606+0000","last_clean":"2024-08-17T02:45:41.863606+0000","last_became_active":"2024-08-17T02:45:41.863332+0000","last_became_peered":"2024-08-17T02:45:41.863332+0000","last_unstale":"2024-08-17T02:45:41.863606+0000","last_undegraded":"2024-08-17T02:45:41.863606+0000","last_fullsized":"2024-08-17T02:45:41.863606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:09.195225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.875437+0000","last_change":"2024-08-17T02:45:40.851226+0000","last_active":"2024-08-17T02:45:41.875437+0000","last_peered":"2024-08-17T02:45:41.875437+0000","last_clean":"2024-08-17T02:45:41.875437+0000","last_became_active":"2024-08-17T02:45:40.850945+0000","last_became_peered":"2024-08-17T02:45:40.850945+0000","last_unstale":"2024-08-17T02:45:41.875437+0000","last_undegraded":"2024-08-17T02:45:41.875437+0000","last_fullsized":"2024-08-17T02:45:41.875437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:00:43.864087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.875679+0000","last_change":"2024-08-17T02:45:41.871607+0000","last_active":"2024-08-17T02:45:41.875679+0000","last_peered":"2024-08-17T02:45:41.875679+0000","last_clean":"2024-08-17T02:45:41.875679+0000","last_became_active":"2024-08-17T02:45:41.871278+0000","last_became_peered":"2024-08-17T02:45:41.871278+0000","last_unstale":"2024-08-17T02:45:41.875679+0000","last_undegraded":"2024-08-17T02:45:41.875679+0000","last_fullsized":"2024-08-17T02:45:41.875679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:02.143166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.884446+0000","last_change":"2024-08-17T02:45:40.857851+0000","last_active":"2024-08-17T02:45:41.884446+0000","last_peered":"2024-08-17T02:45:41.884446+0000","last_clean":"2024-08-17T02:45:41.884446+0000","last_became_active":"2024-08-17T02:45:40.857532+0000","last_became_peered":"2024-08-17T02:45:40.857532+0000","last_unstale":"2024-08-17T02:45:41.884446+0000","last_undegraded":"2024-08-17T02:45:41.884446+0000","last_fullsized":"2024-08-17T02:45:41.884446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:25:01.252070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":811008,"data_stored":663172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":237568,"data_stored":80074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.430999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.654}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2629999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.073}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.545999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.111000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.526999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":72324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":225280,"data_stored":72360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":225280,"data_stored":73786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":225280,"data_stored":78522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":233472,"data_stored":78682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":819200,"data_stored":663228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:45:46.393 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:45:46.393 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-17T02:45:46.393 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-17T02:45:46.394 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-17T02:45:46.394 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-17T02:45:46.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.575+0000 7fa232600640 1 Processor -- start 2024-08-17T02:45:46.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.576+0000 7fa232600640 1 -- start start 2024-08-17T02:45:46.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.577+0000 7fa232600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa22c0afdd0 0x7fa22c1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.577+0000 7fa232600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22c157690 con 0x7fa22c155900 2024-08-17T02:45:46.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.577+0000 7fa232600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22c156a80 con 0x7fa22c0b0270 2024-08-17T02:45:46.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.577+0000 7fa232600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22c156d60 con 0x7fa22c0afdd0 2024-08-17T02:45:46.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.577+0000 7fa231200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa22c155900 0x7fa22c155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44948/0 (socket says 172.21.15.100:44948) 2024-08-17T02:45:46.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.577+0000 7fa231200640 1 -- 172.21.15.100:0/835462463 learned_addr learned my addr 172.21.15.100:0/835462463 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:46.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.577+0000 7fa231c00640 1 --2- 172.21.15.100:0/835462463 >> v2:172.21.15.123:3300/0 conn(0x7fa22c0afdd0 0x7fa22c1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.577+0000 7fa22b400640 1 -- 172.21.15.100:0/835462463 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1815243155 0 0) 0x7fa22c157690 con 0x7fa22c155900 2024-08-17T02:45:46.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.577+0000 7fa22b400640 1 -- 172.21.15.100:0/835462463 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2140034e0 con 0x7fa22c155900 2024-08-17T02:45:46.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa22b400640 1 -- 172.21.15.100:0/835462463 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 80036457 0 0) 0x7fa2140034e0 con 0x7fa22c155900 2024-08-17T02:45:46.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa22b400640 1 -- 172.21.15.100:0/835462463 >> v2:172.21.15.123:3300/0 conn(0x7fa22c0afdd0 msgr2=0x7fa22c1563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:46.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa22b400640 1 --2- 172.21.15.100:0/835462463 >> v2:172.21.15.123:3300/0 conn(0x7fa22c0afdd0 0x7fa22c1563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa22b400640 1 -- 172.21.15.100:0/835462463 >> v1:172.21.15.123:6789/0 conn(0x7fa22c0b0270 legacy=0x7fa22c0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:46.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa22b400640 1 -- 172.21.15.100:0/835462463 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c157040 con 0x7fa22c155900 2024-08-17T02:45:46.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa22b400640 1 -- 172.21.15.100:0/835462463 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1817143124 0 0) 0x7fa220001470 con 0x7fa22c155900 2024-08-17T02:45:46.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa22b400640 1 -- 172.21.15.100:0/835462463 >> v1:172.21.15.100:6789/0 conn(0x7fa22c155900 legacy=0x7fa22c155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:46.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa22b400640 1 --2- 172.21.15.100:0/835462463 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa2140039d0 0x7fa214003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa22b400640 1 --2- 172.21.15.100:0/835462463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa214004780 0x7fa214004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa22b400640 1 --2- 172.21.15.100:0/835462463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa214005130 0x7fa21400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa22b400640 1 -- 172.21.15.100:0/835462463 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c156d60 con 0x7fa214004780 2024-08-17T02:45:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa22b400640 1 -- 172.21.15.100:0/835462463 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21400c020 con 0x7fa214005130 2024-08-17T02:45:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa22b400640 1 -- 172.21.15.100:0/835462463 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21400c1e0 con 0x7fa2140039d0 2024-08-17T02:45:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa22be00640 1 --2- 172.21.15.100:0/835462463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa214004780 0x7fa214004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa231c00640 1 --2- 172.21.15.100:0/835462463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa214005130 0x7fa21400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa231200640 1 --2- 172.21.15.100:0/835462463 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa2140039d0 0x7fa214003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa22be00640 1 -- 172.21.15.100:0/835462463 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa2140039d0 msgr2=0x7fa214003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa22be00640 1 --2- 172.21.15.100:0/835462463 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa2140039d0 0x7fa214003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa22be00640 1 -- 172.21.15.100:0/835462463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa214005130 msgr2=0x7fa21400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa22be00640 1 --2- 172.21.15.100:0/835462463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa214005130 0x7fa21400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa231c00640 1 -- 172.21.15.100:0/835462463 reap_dead start 2024-08-17T02:45:46.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa22be00640 1 -- 172.21.15.100:0/835462463 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c157040 con 0x7fa214004780 2024-08-17T02:45:46.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.578+0000 7fa231200640 1 --2- 172.21.15.100:0/835462463 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa2140039d0 0x7fa214003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:45:46.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.579+0000 7fa22be00640 1 --2- 172.21.15.100:0/835462463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa214004780 0x7fa214004bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa218001380 tx=0x7fa218007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae6d80d474c7b5f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:46.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.580+0000 7fa22b400640 1 -- 172.21.15.100:0/835462463 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21802ccc0 con 0x7fa214004780 2024-08-17T02:45:46.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.580+0000 7fa22b400640 1 -- 172.21.15.100:0/835462463 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21802ce40 con 0x7fa214004780 2024-08-17T02:45:46.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.580+0000 7fa22b400640 1 -- 172.21.15.100:0/835462463 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa218034640 con 0x7fa214004780 2024-08-17T02:45:46.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.580+0000 7fa232600640 1 -- 172.21.15.100:0/835462463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa214004780 msgr2=0x7fa214004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:46.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.580+0000 7fa232600640 1 --2- 172.21.15.100:0/835462463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa214004780 0x7fa214004bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa218001380 tx=0x7fa218007c80 comp rx=0 tx=0).stop 2024-08-17T02:45:46.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.580+0000 7fa232600640 1 -- 172.21.15.100:0/835462463 shutdown_connections 2024-08-17T02:45:46.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.580+0000 7fa232600640 1 --2- 172.21.15.100:0/835462463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa214004780 0x7fa214004bf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.580+0000 7fa232600640 1 -- 172.21.15.100:0/835462463 >> 172.21.15.100:0/835462463 conn(0x7fa22c067750 msgr2=0x7fa22c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:46.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.580+0000 7fa232600640 1 -- 172.21.15.100:0/835462463 shutdown_connections 2024-08-17T02:45:46.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.580+0000 7fa232600640 1 -- 172.21.15.100:0/835462463 wait complete. 2024-08-17T02:45:46.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.582+0000 7fa232600640 1 Processor -- start 2024-08-17T02:45:46.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.582+0000 7fa232600640 1 -- start start 2024-08-17T02:45:46.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.583+0000 7fa232600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa214004780 0x7fa22c0c1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.583+0000 7fa232600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22c0c9b20 0x7fa22c15ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.583+0000 7fa232600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa22c15bfb0 0x7fa22c151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.583+0000 7fa232600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c0caef0 con 0x7fa22c0c9b20 2024-08-17T02:45:46.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.583+0000 7fa232600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c0ca2e0 con 0x7fa22c15bfb0 2024-08-17T02:45:46.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.583+0000 7fa232600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c0ca5c0 con 0x7fa214004780 2024-08-17T02:45:46.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.583+0000 7fa22be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22c0c9b20 0x7fa22c15ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.583+0000 7fa22be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22c0c9b20 0x7fa22c15ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40510/0 (socket says 172.21.15.100:40510) 2024-08-17T02:45:46.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.583+0000 7fa22be00640 1 -- 172.21.15.100:0/4253988599 learned_addr learned my addr 172.21.15.100:0/4253988599 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:46.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.583+0000 7fa231200640 1 --2- 172.21.15.100:0/4253988599 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa214004780 0x7fa22c0c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.583+0000 7fa231c00640 1 --2- 172.21.15.100:0/4253988599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa22c15bfb0 0x7fa22c151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.583+0000 7fa22be00640 1 -- 172.21.15.100:0/4253988599 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa214004780 msgr2=0x7fa22c0c1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:46.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.583+0000 7fa22be00640 1 --2- 172.21.15.100:0/4253988599 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa214004780 0x7fa22c0c1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.583+0000 7fa22be00640 1 -- 172.21.15.100:0/4253988599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa22c15bfb0 msgr2=0x7fa22c151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:46.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.583+0000 7fa22be00640 1 --2- 172.21.15.100:0/4253988599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa22c15bfb0 0x7fa22c151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.583+0000 7fa22be00640 1 -- 172.21.15.100:0/4253988599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c0ca8a0 con 0x7fa22c0c9b20 2024-08-17T02:45:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.584+0000 7fa22be00640 1 --2- 172.21.15.100:0/4253988599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22c0c9b20 0x7fa22c15ba70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa21802c880 tx=0x7fa218003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.584+0000 7fa21fe00640 1 -- 172.21.15.100:0/4253988599 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa218034a70 con 0x7fa22c0c9b20 2024-08-17T02:45:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.584+0000 7fa21fe00640 1 -- 172.21.15.100:0/4253988599 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa218034bd0 con 0x7fa22c0c9b20 2024-08-17T02:45:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.584+0000 7fa21fe00640 1 -- 172.21.15.100:0/4253988599 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa218007040 con 0x7fa22c0c9b20 2024-08-17T02:45:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.584+0000 7fa232600640 1 -- 172.21.15.100:0/4253988599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22c0cab80 con 0x7fa22c0c9b20 2024-08-17T02:45:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.584+0000 7fa232600640 1 -- 172.21.15.100:0/4253988599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22c152360 con 0x7fa22c0c9b20 2024-08-17T02:45:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.585+0000 7fa232600640 1 -- 172.21.15.100:0/4253988599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa22c0cb0a0 con 0x7fa22c0c9b20 2024-08-17T02:45:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.586+0000 7fa21fe00640 1 -- 172.21.15.100:0/4253988599 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa218006790 con 0x7fa22c0c9b20 2024-08-17T02:45:46.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.587+0000 7fa21fe00640 1 --2- 172.21.15.100:0/4253988599 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa20c065150 0x7fa20c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.587+0000 7fa21fe00640 1 -- 172.21.15.100:0/4253988599 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa2180a3ba0 con 0x7fa22c0c9b20 2024-08-17T02:45:46.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.587+0000 7fa231200640 1 --2- 172.21.15.100:0/4253988599 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa20c065150 0x7fa20c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.587+0000 7fa231200640 1 --2- 172.21.15.100:0/4253988599 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa20c065150 0x7fa20c067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa2200011e0 tx=0x7fa220009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:46.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.590+0000 7fa21fe00640 1 -- 172.21.15.100:0/4253988599 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa22c0cb0a0 con 0x7fa22c0c9b20 2024-08-17T02:45:46.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.806+0000 7fa232600640 1 -- 172.21.15.100:0/4253988599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa22c071050 con 0x7fa22c0c9b20 2024-08-17T02:45:46.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.809+0000 7fa21fe00640 1 -- 172.21.15.100:0/4253988599 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+161038 (secure 0 0 0) 0x7fa218071c70 con 0x7fa22c0c9b20 2024-08-17T02:45:46.811 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:46.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.812+0000 7fa232600640 1 -- 172.21.15.100:0/4253988599 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa20c065150 msgr2=0x7fa20c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:46.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.812+0000 7fa232600640 1 --2- 172.21.15.100:0/4253988599 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa20c065150 0x7fa20c067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa2200011e0 tx=0x7fa220009040 comp rx=0 tx=0).stop 2024-08-17T02:45:46.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.812+0000 7fa232600640 1 -- 172.21.15.100:0/4253988599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22c0c9b20 msgr2=0x7fa22c15ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:46.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.812+0000 7fa232600640 1 --2- 172.21.15.100:0/4253988599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22c0c9b20 0x7fa22c15ba70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa21802c880 tx=0x7fa218003000 comp rx=0 tx=0).stop 2024-08-17T02:45:46.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.812+0000 7fa232600640 1 -- 172.21.15.100:0/4253988599 shutdown_connections 2024-08-17T02:45:46.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.812+0000 7fa232600640 1 --2- 172.21.15.100:0/4253988599 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa20c065150 0x7fa20c067600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.812+0000 7fa232600640 1 --2- 172.21.15.100:0/4253988599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa22c15bfb0 0x7fa22c151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.812+0000 7fa232600640 1 --2- 172.21.15.100:0/4253988599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa22c0c9b20 0x7fa22c15ba70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.812+0000 7fa232600640 1 --2- 172.21.15.100:0/4253988599 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa214004780 0x7fa22c0c1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.812+0000 7fa232600640 1 -- 172.21.15.100:0/4253988599 >> 172.21.15.100:0/4253988599 conn(0x7fa22c067750 msgr2=0x7fa22c154b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:46.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.812+0000 7fa232600640 1 -- 172.21.15.100:0/4253988599 shutdown_connections 2024-08-17T02:45:46.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.812+0000 7fa232600640 1 -- 172.21.15.100:0/4253988599 wait complete. 2024-08-17T02:45:46.828 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":36756},{"type":"v1","addr":"172.21.15.100:6833","nonce":36756}]},"active_addr":"172.21.15.100:6833/36756","active_change":"2024-08-17T02:45:27.076250+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4101,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1460574795}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":3761236396}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":2841216897}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":3574172762}]}]} 2024-08-17T02:45:46.831 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-17T02:45:46.831 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-17T02:45:46.831 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:45:46.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.978+0000 7f854ee00640 1 Processor -- start 2024-08-17T02:45:46.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.978+0000 7f854ee00640 1 -- start start 2024-08-17T02:45:46.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.979+0000 7f854ee00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f854806e790 0x7f85480aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.979+0000 7f854ee00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85480afc10 con 0x7f8548155550 2024-08-17T02:45:46.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.979+0000 7f854ee00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85480af000 con 0x7f8548155180 2024-08-17T02:45:46.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.979+0000 7f854ee00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85480af2e0 con 0x7f854806e790 2024-08-17T02:45:46.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.979+0000 7f8547400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f8548155550 0x7f854806e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37388/0 (socket says 172.21.15.100:37388) 2024-08-17T02:45:46.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.979+0000 7f8547400640 1 -- 172.21.15.100:0/3511674040 learned_addr learned my addr 172.21.15.100:0/3511674040 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:46.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.980+0000 7f854ce00640 1 --2- 172.21.15.100:0/3511674040 >> v2:172.21.15.123:3300/0 conn(0x7f854806e790 0x7f85480aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.980+0000 7f8546a00640 1 -- 172.21.15.100:0/3511674040 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927484482 0 0) 0x7f85480afc10 con 0x7f8548155550 2024-08-17T02:45:46.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.980+0000 7f8546a00640 1 -- 172.21.15.100:0/3511674040 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f852c0045f0 con 0x7f8548155550 2024-08-17T02:45:46.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.980+0000 7f854ce00640 1 -- 172.21.15.100:0/3511674040 >> v1:172.21.15.123:6789/0 conn(0x7f8548155180 legacy=0x7f85480ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:46.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.980+0000 7f854ce00640 1 -- 172.21.15.100:0/3511674040 >> v1:172.21.15.100:6789/0 conn(0x7f8548155550 legacy=0x7f854806e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:46.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.980+0000 7f8546a00640 1 -- 172.21.15.100:0/3511674040 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143780047 0 0) 0x7f85480af000 con 0x7f8548155180 2024-08-17T02:45:46.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.980+0000 7f854ce00640 1 -- 172.21.15.100:0/3511674040 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85480af5c0 con 0x7f854806e790 2024-08-17T02:45:46.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.981+0000 7f854ce00640 1 --2- 172.21.15.100:0/3511674040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f854806e790 0x7f85480aea20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8540009e60 tx=0x7f8540009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ec3737d489af8c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:46.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.981+0000 7f8546a00640 1 -- 172.21.15.100:0/3511674040 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8540007550 con 0x7f854806e790 2024-08-17T02:45:46.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.981+0000 7f8546a00640 1 -- 172.21.15.100:0/3511674040 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854002d050 con 0x7f854806e790 2024-08-17T02:45:46.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.981+0000 7f8546a00640 1 -- 172.21.15.100:0/3511674040 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85400078c0 con 0x7f854806e790 2024-08-17T02:45:46.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.982+0000 7f854ee00640 1 -- 172.21.15.100:0/3511674040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f854806e790 msgr2=0x7f85480aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:46.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.982+0000 7f854ee00640 1 --2- 172.21.15.100:0/3511674040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f854806e790 0x7f85480aea20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8540009e60 tx=0x7f8540009780 comp rx=0 tx=0).stop 2024-08-17T02:45:46.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.982+0000 7f854ee00640 1 -- 172.21.15.100:0/3511674040 shutdown_connections 2024-08-17T02:45:46.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.982+0000 7f854ee00640 1 --2- 172.21.15.100:0/3511674040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f854806e790 0x7f85480aea20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.982+0000 7f854ee00640 1 -- 172.21.15.100:0/3511674040 >> 172.21.15.100:0/3511674040 conn(0x7f85480cb9b0 msgr2=0x7f85480cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:46.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.982+0000 7f854ee00640 1 -- 172.21.15.100:0/3511674040 shutdown_connections 2024-08-17T02:45:46.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.982+0000 7f854ee00640 1 -- 172.21.15.100:0/3511674040 wait complete. 2024-08-17T02:45:46.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.983+0000 7f854ee00640 1 Processor -- start 2024-08-17T02:45:46.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.984+0000 7f854ee00640 1 -- start start 2024-08-17T02:45:46.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.984+0000 7f854ee00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854806e790 0x7f85480ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.984+0000 7f854ee00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8548155180 0x7f85480a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.984+0000 7f854ee00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8548155550 0x7f8548151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.984+0000 7f854ee00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85480c8440 con 0x7f854806e790 2024-08-17T02:45:46.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.984+0000 7f854ee00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85480a5c70 con 0x7f8548155180 2024-08-17T02:45:46.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.984+0000 7f854ee00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8548157f80 con 0x7f8548155550 2024-08-17T02:45:46.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.985+0000 7f8547e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854806e790 0x7f85480ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.985+0000 7f8547400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8548155180 0x7f85480a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.985+0000 7f8547e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854806e790 0x7f85480ab1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32864/0 (socket says 172.21.15.100:32864) 2024-08-17T02:45:46.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.985+0000 7f854ce00640 1 --2- 172.21.15.100:0/223454629 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8548155550 0x7f8548151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.985+0000 7f8547e00640 1 -- 172.21.15.100:0/223454629 learned_addr learned my addr 172.21.15.100:0/223454629 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:46.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.985+0000 7f8547e00640 1 -- 172.21.15.100:0/223454629 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8548155550 msgr2=0x7f8548151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:46.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.985+0000 7f8547e00640 1 --2- 172.21.15.100:0/223454629 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8548155550 0x7f8548151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.985+0000 7f8547e00640 1 -- 172.21.15.100:0/223454629 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8548155180 msgr2=0x7f85480a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:46.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.985+0000 7f8547e00640 1 --2- 172.21.15.100:0/223454629 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8548155180 0x7f85480a5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:46.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.985+0000 7f8547e00640 1 -- 172.21.15.100:0/223454629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8540009a20 con 0x7f854806e790 2024-08-17T02:45:46.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.985+0000 7f8547400640 1 --2- 172.21.15.100:0/223454629 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8548155180 0x7f85480a5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:46.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.985+0000 7f8547e00640 1 --2- 172.21.15.100:0/223454629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854806e790 0x7f85480ab1c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f853800c5b0 tx=0x7f8538007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:46.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.986+0000 7f853f400640 1 -- 172.21.15.100:0/223454629 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8538012630 con 0x7f854806e790 2024-08-17T02:45:46.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.986+0000 7f853f400640 1 -- 172.21.15.100:0/223454629 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85380127d0 con 0x7f854806e790 2024-08-17T02:45:46.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.986+0000 7f853f400640 1 -- 172.21.15.100:0/223454629 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8538012b90 con 0x7f854806e790 2024-08-17T02:45:46.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.986+0000 7f854ee00640 1 -- 172.21.15.100:0/223454629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8548157650 con 0x7f854806e790 2024-08-17T02:45:46.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.986+0000 7f854ee00640 1 -- 172.21.15.100:0/223454629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8548157c10 con 0x7f854806e790 2024-08-17T02:45:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.987+0000 7f854ee00640 1 -- 172.21.15.100:0/223454629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8548064db0 con 0x7f854806e790 2024-08-17T02:45:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.988+0000 7f853f400640 1 -- 172.21.15.100:0/223454629 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f853801b400 con 0x7f854806e790 2024-08-17T02:45:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.989+0000 7f853f400640 1 --2- 172.21.15.100:0/223454629 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8528065150 0x7f8528067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:46.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.989+0000 7f853f400640 1 -- 172.21.15.100:0/223454629 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8538081fc0 con 0x7f854806e790 2024-08-17T02:45:46.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.989+0000 7f8547400640 1 --2- 172.21.15.100:0/223454629 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8528065150 0x7f8528067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:46.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.990+0000 7f8547400640 1 --2- 172.21.15.100:0/223454629 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8528065150 0x7f8528067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f854806d930 tx=0x7f8534009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:46.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:46.993+0000 7f853f400640 1 -- 172.21.15.100:0/223454629 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8538050090 con 0x7f854806e790 2024-08-17T02:45:47.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.170+0000 7f854ee00640 1 -- 172.21.15.100:0/223454629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85480cbd80 con 0x7f854806e790 2024-08-17T02:45:47.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.171+0000 7f853f400640 1 -- 172.21.15.100:0/223454629 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f85380536b0 con 0x7f854806e790 2024-08-17T02:45:47.172 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:47.172 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:42.845503+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:45:39.036964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:45:40.232954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:45:47.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.173+0000 7f854ee00640 1 -- 172.21.15.100:0/223454629 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8528065150 msgr2=0x7f8528067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.173+0000 7f854ee00640 1 --2- 172.21.15.100:0/223454629 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8528065150 0x7f8528067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f854806d930 tx=0x7f8534009040 comp rx=0 tx=0).stop 2024-08-17T02:45:47.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.173+0000 7f854ee00640 1 -- 172.21.15.100:0/223454629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854806e790 msgr2=0x7f85480ab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.173+0000 7f854ee00640 1 --2- 172.21.15.100:0/223454629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854806e790 0x7f85480ab1c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f853800c5b0 tx=0x7f8538007d60 comp rx=0 tx=0).stop 2024-08-17T02:45:47.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.173+0000 7f854ee00640 1 -- 172.21.15.100:0/223454629 shutdown_connections 2024-08-17T02:45:47.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.173+0000 7f854ee00640 1 --2- 172.21.15.100:0/223454629 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8528065150 0x7f8528067600 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.173+0000 7f854ee00640 1 --2- 172.21.15.100:0/223454629 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8548155550 0x7f8548151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.173+0000 7f854ee00640 1 --2- 172.21.15.100:0/223454629 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8548155180 0x7f85480a5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.173+0000 7f854ee00640 1 --2- 172.21.15.100:0/223454629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854806e790 0x7f85480ab1c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.173+0000 7f854ee00640 1 -- 172.21.15.100:0/223454629 >> 172.21.15.100:0/223454629 conn(0x7f85480cb9b0 msgr2=0x7f854806d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:47.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.174+0000 7f854ee00640 1 -- 172.21.15.100:0/223454629 shutdown_connections 2024-08-17T02:45:47.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.174+0000 7f854ee00640 1 -- 172.21.15.100:0/223454629 wait complete. 2024-08-17T02:45:47.190 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-17T02:45:47.190 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:45:47.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.336+0000 7f9104c00640 1 Processor -- start 2024-08-17T02:45:47.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.336+0000 7f9104c00640 1 -- start start 2024-08-17T02:45:47.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.337+0000 7f9104c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9100155180 0x7f91000aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.337+0000 7f9104c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f910006e080 0x7f910006e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.337+0000 7f9104c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91000afc10 con 0x7f9100155550 2024-08-17T02:45:47.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.337+0000 7f9104c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910006ea00 con 0x7f9100155180 2024-08-17T02:45:47.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.337+0000 7f9104c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91000af000 con 0x7f910006e080 2024-08-17T02:45:47.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.337+0000 7f90fde00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9100155180 0x7f91000aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.337+0000 7f90f5400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f9100155550 0x7f91000ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37400/0 (socket says 172.21.15.100:37400) 2024-08-17T02:45:47.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.337+0000 7f90f5400640 1 -- 172.21.15.100:0/1337491086 learned_addr learned my addr 172.21.15.100:0/1337491086 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:47.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.337+0000 7f90fde00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9100155180 0x7f91000aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32876/0 (socket says 172.21.15.100:32876) 2024-08-17T02:45:47.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.338+0000 7f90fe800640 1 --2- 172.21.15.100:0/1337491086 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f910006e080 0x7f910006e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.338+0000 7f90fde00640 1 -- 172.21.15.100:0/1337491086 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f910006e080 msgr2=0x7f910006e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:47.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.338+0000 7f90fde00640 1 --2- 172.21.15.100:0/1337491086 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f910006e080 0x7f910006e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.338+0000 7f90fde00640 1 -- 172.21.15.100:0/1337491086 >> v1:172.21.15.100:6789/0 conn(0x7f9100155550 legacy=0x7f91000ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.338+0000 7f90fde00640 1 -- 172.21.15.100:0/1337491086 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91000af2e0 con 0x7f9100155180 2024-08-17T02:45:47.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.338+0000 7f90fd400640 1 -- 172.21.15.100:0/1337491086 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2238759005 0 0) 0x7f91000afc10 con 0x7f9100155550 2024-08-17T02:45:47.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.339+0000 7f90fde00640 1 --2- 172.21.15.100:0/1337491086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9100155180 0x7f91000aea20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009880 tx=0x7f90f00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3646f003fd92371 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.339+0000 7f90fd400640 1 -- 172.21.15.100:0/1337491086 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f002ad70 con 0x7f9100155180 2024-08-17T02:45:47.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.339+0000 7f90fd400640 1 -- 172.21.15.100:0/1337491086 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f0032440 con 0x7f9100155180 2024-08-17T02:45:47.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.339+0000 7f90fd400640 1 -- 172.21.15.100:0/1337491086 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f00327e0 con 0x7f9100155180 2024-08-17T02:45:47.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.340+0000 7f9104c00640 1 -- 172.21.15.100:0/1337491086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9100155180 msgr2=0x7f91000aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.340+0000 7f9104c00640 1 --2- 172.21.15.100:0/1337491086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9100155180 0x7f91000aea20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009880 tx=0x7f90f00090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.340+0000 7f9104c00640 1 -- 172.21.15.100:0/1337491086 shutdown_connections 2024-08-17T02:45:47.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.340+0000 7f9104c00640 1 --2- 172.21.15.100:0/1337491086 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f910006e080 0x7f910006e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.340+0000 7f9104c00640 1 --2- 172.21.15.100:0/1337491086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9100155180 0x7f91000aea20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.340+0000 7f9104c00640 1 -- 172.21.15.100:0/1337491086 >> 172.21.15.100:0/1337491086 conn(0x7f91000cb9b0 msgr2=0x7f91000cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:47.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.340+0000 7f9104c00640 1 -- 172.21.15.100:0/1337491086 shutdown_connections 2024-08-17T02:45:47.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.340+0000 7f9104c00640 1 -- 172.21.15.100:0/1337491086 wait complete. 2024-08-17T02:45:47.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.341+0000 7f9104c00640 1 Processor -- start 2024-08-17T02:45:47.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.341+0000 7f9104c00640 1 -- start start 2024-08-17T02:45:47.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.342+0000 7f9104c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910006e080 0x7f91000c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.342+0000 7f9104c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9100155180 0x7f9100140520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.342+0000 7f9104c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9100155550 0x7f91001559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.342+0000 7f9104c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91000c8c00 con 0x7f910006e080 2024-08-17T02:45:47.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.342+0000 7f9104c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91000ca6d0 con 0x7f9100155180 2024-08-17T02:45:47.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.342+0000 7f9104c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91000c8ea0 con 0x7f9100155550 2024-08-17T02:45:47.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.342+0000 7f90fde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910006e080 0x7f91000c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.342+0000 7f90fde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910006e080 0x7f91000c9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32892/0 (socket says 172.21.15.100:32892) 2024-08-17T02:45:47.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.342+0000 7f90fde00640 1 -- 172.21.15.100:0/888975933 learned_addr learned my addr 172.21.15.100:0/888975933 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:47.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.343+0000 7f90f5400640 1 --2- 172.21.15.100:0/888975933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9100155180 0x7f9100140520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.343+0000 7f90fe800640 1 --2- 172.21.15.100:0/888975933 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9100155550 0x7f91001559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.343+0000 7f90fde00640 1 -- 172.21.15.100:0/888975933 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9100155550 msgr2=0x7f91001559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.343+0000 7f90fde00640 1 --2- 172.21.15.100:0/888975933 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9100155550 0x7f91001559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.343+0000 7f90fde00640 1 -- 172.21.15.100:0/888975933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9100155180 msgr2=0x7f9100140520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.343+0000 7f90fde00640 1 --2- 172.21.15.100:0/888975933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9100155180 0x7f9100140520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.343+0000 7f90fde00640 1 -- 172.21.15.100:0/888975933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f0009390 con 0x7f910006e080 2024-08-17T02:45:47.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.343+0000 7f90fe800640 1 --2- 172.21.15.100:0/888975933 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9100155550 0x7f91001559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:45:47.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.343+0000 7f90f5400640 1 --2- 172.21.15.100:0/888975933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9100155180 0x7f9100140520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:45:47.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.343+0000 7f90fde00640 1 --2- 172.21.15.100:0/888975933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910006e080 0x7f91000c9680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009880 tx=0x7f90f0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.343+0000 7f90f6000640 1 -- 172.21.15.100:0/888975933 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f0031de0 con 0x7f910006e080 2024-08-17T02:45:47.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.343+0000 7f90f6000640 1 -- 172.21.15.100:0/888975933 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f003d420 con 0x7f910006e080 2024-08-17T02:45:47.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.343+0000 7f9104c00640 1 -- 172.21.15.100:0/888975933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91000c9180 con 0x7f910006e080 2024-08-17T02:45:47.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.344+0000 7f90f6000640 1 -- 172.21.15.100:0/888975933 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f003d7e0 con 0x7f910006e080 2024-08-17T02:45:47.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.344+0000 7f9104c00640 1 -- 172.21.15.100:0/888975933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9100140a60 con 0x7f910006e080 2024-08-17T02:45:47.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.345+0000 7f9104c00640 1 -- 172.21.15.100:0/888975933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9100140c50 con 0x7f910006e080 2024-08-17T02:45:47.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.345+0000 7f90f6000640 1 -- 172.21.15.100:0/888975933 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f90f0039040 con 0x7f910006e080 2024-08-17T02:45:47.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.346+0000 7f90f6000640 1 --2- 172.21.15.100:0/888975933 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f90dc065150 0x7f90dc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.346+0000 7f90f6000640 1 -- 172.21.15.100:0/888975933 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f90f00a2530 con 0x7f910006e080 2024-08-17T02:45:47.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.346+0000 7f90f5400640 1 --2- 172.21.15.100:0/888975933 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f90dc065150 0x7f90dc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.347+0000 7f90f5400640 1 --2- 172.21.15.100:0/888975933 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f90dc065150 0x7f90dc067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f91000b0330 tx=0x7f90e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.350+0000 7f90f6000640 1 -- 172.21.15.100:0/888975933 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f90f0070550 con 0x7f910006e080 2024-08-17T02:45:47.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.526+0000 7f9104c00640 1 -- 172.21.15.100:0/888975933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9100064db0 con 0x7f910006e080 2024-08-17T02:45:47.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.527+0000 7f90f6000640 1 -- 172.21.15.100:0/888975933 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f90f0073b70 con 0x7f910006e080 2024-08-17T02:45:47.527 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:47.527 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:42.845503+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:45:39.036964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:45:40.232954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:45:47.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.529+0000 7f9104c00640 1 -- 172.21.15.100:0/888975933 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f90dc065150 msgr2=0x7f90dc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.529+0000 7f9104c00640 1 --2- 172.21.15.100:0/888975933 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f90dc065150 0x7f90dc067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f91000b0330 tx=0x7f90e8009040 comp rx=0 tx=0).stop 2024-08-17T02:45:47.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.529+0000 7f9104c00640 1 -- 172.21.15.100:0/888975933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910006e080 msgr2=0x7f91000c9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.529+0000 7f9104c00640 1 --2- 172.21.15.100:0/888975933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910006e080 0x7f91000c9680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009880 tx=0x7f90f0032000 comp rx=0 tx=0).stop 2024-08-17T02:45:47.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.529+0000 7f9104c00640 1 -- 172.21.15.100:0/888975933 shutdown_connections 2024-08-17T02:45:47.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.529+0000 7f9104c00640 1 --2- 172.21.15.100:0/888975933 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f90dc065150 0x7f90dc067600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.529+0000 7f9104c00640 1 --2- 172.21.15.100:0/888975933 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9100155550 0x7f91001559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.529+0000 7f9104c00640 1 --2- 172.21.15.100:0/888975933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9100155180 0x7f9100140520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.529+0000 7f9104c00640 1 --2- 172.21.15.100:0/888975933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910006e080 0x7f91000c9680 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.529+0000 7f9104c00640 1 -- 172.21.15.100:0/888975933 >> 172.21.15.100:0/888975933 conn(0x7f91000cb9b0 msgr2=0x7f9100152870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:47.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.529+0000 7f9104c00640 1 -- 172.21.15.100:0/888975933 shutdown_connections 2024-08-17T02:45:47.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.529+0000 7f9104c00640 1 -- 172.21.15.100:0/888975933 wait complete. 2024-08-17T02:45:47.544 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-17T02:45:47.545 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-17T02:45:47.545 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-17T02:45:47.545 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-17T02:45:47.546 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-17T02:45:47.546 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-17T02:45:47.547 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-17T02:45:47.547 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-17T02:45:47.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.806+0000 7fb9e1a00640 1 Processor -- start 2024-08-17T02:45:47.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.806+0000 7fb9e1a00640 1 -- start start 2024-08-17T02:45:47.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.808+0000 7f1a63000640 1 Processor -- start 2024-08-17T02:45:47.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.808+0000 7fb9e1a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb9dc0ae860 0x7fb9dc0cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.808+0000 7f1a63000640 1 -- start start 2024-08-17T02:45:47.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.808+0000 7fb9e1a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9dc0b1780 con 0x7fb9dc06dc80 2024-08-17T02:45:47.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.808+0000 7fb9e1a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9dc0ae280 con 0x7fb9dc0cade0 2024-08-17T02:45:47.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.808+0000 7fb9e1a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9dc0aecb0 con 0x7fb9dc0ae860 2024-08-17T02:45:47.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.809+0000 7fb9da000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb9dc06dc80 0x7fb9dc0c83a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37406/0 (socket says 172.21.15.100:37406) 2024-08-17T02:45:47.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.809+0000 7fb9da000640 1 -- 172.21.15.100:0/3194450883 learned_addr learned my addr 172.21.15.100:0/3194450883 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:47.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.810+0000 7fb9db400640 1 --2- 172.21.15.100:0/3194450883 >> v2:172.21.15.123:3300/0 conn(0x7fb9dc0ae860 0x7fb9dc0cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.810+0000 7f1a63000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1a540e5eb0 0x7f1a540e6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.810+0000 7f1a63000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1a54033a80 0x7f1a540e5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.810+0000 7f1a63000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a54033f00 0x7f1a540e55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.810+0000 7f1a63000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a54051210 con 0x7f1a54033a80 2024-08-17T02:45:47.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.810+0000 7f1a63000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a540e5b10 con 0x7f1a540e5eb0 2024-08-17T02:45:47.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.810+0000 7f1a63000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5404fbe0 con 0x7f1a54033f00 2024-08-17T02:45:47.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.811+0000 7fb9d9600640 1 -- 172.21.15.100:0/3194450883 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2805826249 0 0) 0x7fb9dc0b1780 con 0x7fb9dc06dc80 2024-08-17T02:45:47.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.811+0000 7f1a61200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1a54033a80 0x7f1a540e5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.811+0000 7f1a62600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a54033f00 0x7f1a540e55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.811+0000 7fb9d9600640 1 -- 172.21.15.100:0/3194450883 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9c00034e0 con 0x7fb9dc06dc80 2024-08-17T02:45:47.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.811+0000 7fb9d9600640 1 -- 172.21.15.100:0/3194450883 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903471323 0 0) 0x7fb9dc0ae280 con 0x7fb9dc0cade0 2024-08-17T02:45:47.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.811+0000 7fb9d9600640 1 -- 172.21.15.100:0/3194450883 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9dc0b1780 con 0x7fb9dc0cade0 2024-08-17T02:45:47.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.811+0000 7f1a61200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1a54033a80 0x7f1a540e5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32904/0 (socket says 172.21.15.100:32904) 2024-08-17T02:45:47.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.811+0000 7f1a61200640 1 -- 172.21.15.100:0/3696949163 learned_addr learned my addr 172.21.15.100:0/3696949163 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:47.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.811+0000 7f1a61c00640 1 --2- 172.21.15.100:0/3696949163 >> v2:172.21.15.123:3300/0 conn(0x7f1a540e5eb0 0x7f1a540e6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.811+0000 7fb9db400640 1 -- 172.21.15.100:0/3194450883 >> v1:172.21.15.123:6789/0 conn(0x7fb9dc0cade0 legacy=0x7fb9dc06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.811+0000 7fb9db400640 1 -- 172.21.15.100:0/3194450883 >> v1:172.21.15.100:6789/0 conn(0x7fb9dc06dc80 legacy=0x7fb9dc0c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.811+0000 7fb9db400640 1 -- 172.21.15.100:0/3194450883 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc0b0e50 con 0x7fb9dc0ae860 2024-08-17T02:45:47.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.812+0000 7f1a62600640 1 -- 172.21.15.100:0/3696949163 >> v2:172.21.15.123:3300/0 conn(0x7f1a540e5eb0 msgr2=0x7f1a540e6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:47.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.812+0000 7f1a62600640 1 --2- 172.21.15.100:0/3696949163 >> v2:172.21.15.123:3300/0 conn(0x7f1a540e5eb0 0x7f1a540e6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.812+0000 7f1a62600640 1 -- 172.21.15.100:0/3696949163 >> v2:172.21.15.100:3300/0 conn(0x7f1a54033a80 msgr2=0x7f1a540e5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:47.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.812+0000 7f1a62600640 1 --2- 172.21.15.100:0/3696949163 >> v2:172.21.15.100:3300/0 conn(0x7f1a54033a80 0x7f1a540e5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.812+0000 7f1a62600640 1 -- 172.21.15.100:0/3696949163 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a54005f50 con 0x7f1a54033f00 2024-08-17T02:45:47.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.813+0000 7fb9db400640 1 --2- 172.21.15.100:0/3194450883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9dc0ae860 0x7fb9dc0cb1b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009e60 tx=0x7fb9d4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30ea64ca155535dd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.813+0000 7f1a61200640 1 --2- 172.21.15.100:0/3696949163 >> v2:172.21.15.100:3300/0 conn(0x7f1a54033a80 0x7f1a540e5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:47.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.813+0000 7f1a62600640 1 --2- 172.21.15.100:0/3696949163 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a54033f00 0x7f1a540e55d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400d380 tx=0x7f1a500090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=649ee977e769527f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.813+0000 7fb9d9600640 1 -- 172.21.15.100:0/3194450883 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4007550 con 0x7fb9dc0ae860 2024-08-17T02:45:47.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.813+0000 7fb9d9600640 1 -- 172.21.15.100:0/3194450883 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d402d050 con 0x7fb9dc0ae860 2024-08-17T02:45:47.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.813+0000 7fb9d9600640 1 -- 172.21.15.100:0/3194450883 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4007920 con 0x7fb9dc0ae860 2024-08-17T02:45:47.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.813+0000 7f1a5be00640 1 -- 172.21.15.100:0/3696949163 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5002ab20 con 0x7f1a54033f00 2024-08-17T02:45:47.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.814+0000 7f1a5be00640 1 -- 172.21.15.100:0/3696949163 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5002ac80 con 0x7f1a54033f00 2024-08-17T02:45:47.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.814+0000 7f1a5be00640 1 -- 172.21.15.100:0/3696949163 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a50032670 con 0x7f1a54033f00 2024-08-17T02:45:47.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.815+0000 7f1a63000640 1 -- 172.21.15.100:0/3696949163 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a54033f00 msgr2=0x7f1a540e55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.815+0000 7f1a63000640 1 --2- 172.21.15.100:0/3696949163 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a54033f00 0x7f1a540e55d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400d380 tx=0x7f1a500090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.815+0000 7fb9e1a00640 1 -- 172.21.15.100:0/3194450883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9dc0ae860 msgr2=0x7fb9dc0cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.815+0000 7fb9e1a00640 1 --2- 172.21.15.100:0/3194450883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9dc0ae860 0x7fb9dc0cb1b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009e60 tx=0x7fb9d4009780 comp rx=0 tx=0).stop 2024-08-17T02:45:47.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.815+0000 7fb9e1a00640 1 -- 172.21.15.100:0/3194450883 shutdown_connections 2024-08-17T02:45:47.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.815+0000 7fb9e1a00640 1 --2- 172.21.15.100:0/3194450883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9dc0ae860 0x7fb9dc0cb1b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.815+0000 7fb9e1a00640 1 -- 172.21.15.100:0/3194450883 >> 172.21.15.100:0/3194450883 conn(0x7fb9dc0cb7f0 msgr2=0x7fb9dc0cbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:47.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.815+0000 7f1a63000640 1 -- 172.21.15.100:0/3696949163 shutdown_connections 2024-08-17T02:45:47.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.815+0000 7f1a63000640 1 --2- 172.21.15.100:0/3696949163 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a54033f00 0x7f1a540e55d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.815+0000 7f1a63000640 1 --2- 172.21.15.100:0/3696949163 >> v2:172.21.15.100:3300/0 conn(0x7f1a54033a80 0x7f1a540e5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.815+0000 7f1a63000640 1 --2- 172.21.15.100:0/3696949163 >> v2:172.21.15.123:3300/0 conn(0x7f1a540e5eb0 0x7f1a540e6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.815+0000 7f1a63000640 1 -- 172.21.15.100:0/3696949163 >> 172.21.15.100:0/3696949163 conn(0x7f1a54051600 msgr2=0x7f1a54051a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:47.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.815+0000 7fb9e1a00640 1 -- 172.21.15.100:0/3194450883 shutdown_connections 2024-08-17T02:45:47.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.816+0000 7f1a63000640 1 -- 172.21.15.100:0/3696949163 shutdown_connections 2024-08-17T02:45:47.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.816+0000 7fb9e1a00640 1 -- 172.21.15.100:0/3194450883 wait complete. 2024-08-17T02:45:47.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.816+0000 7f1a63000640 1 -- 172.21.15.100:0/3696949163 wait complete. 2024-08-17T02:45:47.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.816+0000 7fa6d8200640 1 Processor -- start 2024-08-17T02:45:47.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.817+0000 7fa6d8200640 1 -- start start 2024-08-17T02:45:47.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.818+0000 7fb9e1a00640 1 Processor -- start 2024-08-17T02:45:47.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.818+0000 7fb9e1a00640 1 -- start start 2024-08-17T02:45:47.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.818+0000 7f1a63000640 1 Processor -- start 2024-08-17T02:45:47.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.819+0000 7fb9e1a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9dc06dc80 0x7fb9dc149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.819+0000 7fb9e1a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9dc0ae860 0x7fb9dc170cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.818+0000 7f1a63000640 1 -- start start 2024-08-17T02:45:47.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.819+0000 7fb9e1a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9dc0cade0 0x7fb9dc1493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.819+0000 7fb9e1a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc14ae70 con 0x7fb9dc0ae860 2024-08-17T02:45:47.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.819+0000 7fb9e1a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc171200 con 0x7fb9dc0cade0 2024-08-17T02:45:47.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.820+0000 7fa6d8200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa6d00c6a30 0x7fa6d00cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.820+0000 7fa6d8200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa6d0159430 0x7fa6d00c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.820+0000 7f1a63000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a54033a80 0x7f1a540e4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.820+0000 7f1a63000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54033f00 0x7f1a540f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.820+0000 7f1a63000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a540e5eb0 0x7f1a5404e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.821+0000 7f1a63000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5404e5c0 con 0x7f1a54033f00 2024-08-17T02:45:47.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.821+0000 7f1a61c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a54033a80 0x7f1a540e4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.821+0000 7f1a63000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540e3000 con 0x7f1a54033a80 2024-08-17T02:45:47.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.821+0000 7f1a61c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a54033a80 0x7f1a540e4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:52638/0 (socket says 172.21.15.100:52638) 2024-08-17T02:45:47.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.821+0000 7f1a63000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540e3280 con 0x7f1a540e5eb0 2024-08-17T02:45:47.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.821+0000 7f1a61c00640 1 -- 172.21.15.100:0/4013215087 learned_addr learned my addr 172.21.15.100:0/4013215087 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:47.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.821+0000 7f1a61200640 1 --2- 172.21.15.100:0/4013215087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54033f00 0x7f1a540f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.820+0000 7f351d000640 1 Processor -- start 2024-08-17T02:45:47.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.821+0000 7f1a62600640 1 --2- 172.21.15.100:0/4013215087 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a540e5eb0 0x7f1a5404e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.820+0000 7fa6d8200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d00cbf40 con 0x7fa6d0159060 2024-08-17T02:45:47.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.820+0000 7fa6d8200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d00cb930 con 0x7fa6d0159430 2024-08-17T02:45:47.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.820+0000 7fa6d8200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d00ced10 con 0x7fa6d00c6a30 2024-08-17T02:45:47.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.819+0000 7fb9e1a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc14a260 con 0x7fb9dc06dc80 2024-08-17T02:45:47.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.820+0000 7fb9daa00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9dc06dc80 0x7fb9dc149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.820+0000 7fb9daa00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9dc06dc80 0x7fb9dc149c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:32884/0 (socket says 172.21.15.100:32884) 2024-08-17T02:45:47.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.820+0000 7fb9daa00640 1 -- 172.21.15.100:0/3523120474 learned_addr learned my addr 172.21.15.100:0/3523120474 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:47.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.820+0000 7fb9db400640 1 --2- 172.21.15.100:0/3523120474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9dc0cade0 0x7fb9dc1493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.820+0000 7fb9daa00640 1 -- 172.21.15.100:0/3523120474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9dc0cade0 msgr2=0x7fb9dc1493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.820+0000 7fb9daa00640 1 --2- 172.21.15.100:0/3523120474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9dc0cade0 0x7fb9dc1493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.820+0000 7fb9daa00640 1 -- 172.21.15.100:0/3523120474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9dc0ae860 msgr2=0x7fb9dc170cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.820+0000 7fb9daa00640 1 --2- 172.21.15.100:0/3523120474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9dc0ae860 0x7fb9dc170cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.820+0000 7fb9daa00640 1 -- 172.21.15.100:0/3523120474 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d4009a20 con 0x7fb9dc06dc80 2024-08-17T02:45:47.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.821+0000 7fb9db400640 1 --2- 172.21.15.100:0/3523120474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9dc0cade0 0x7fb9dc1493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:45:47.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.821+0000 7f1a61c00640 1 -- 172.21.15.100:0/4013215087 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a540e5eb0 msgr2=0x7f1a5404e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.821+0000 7f1a61c00640 1 --2- 172.21.15.100:0/4013215087 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a540e5eb0 0x7f1a5404e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.821+0000 7f1a61c00640 1 -- 172.21.15.100:0/4013215087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54033f00 msgr2=0x7f1a540f6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.822+0000 7f1a61c00640 1 --2- 172.21.15.100:0/4013215087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54033f00 0x7f1a540f6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.822+0000 7f1a61c00640 1 -- 172.21.15.100:0/4013215087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c04c200 con 0x7f1a54033a80 2024-08-17T02:45:47.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.822+0000 7f1a61200640 1 --2- 172.21.15.100:0/4013215087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54033f00 0x7f1a540f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:47.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.822+0000 7f1a62600640 1 --2- 172.21.15.100:0/4013215087 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a540e5eb0 0x7f1a5404e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:47.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.822+0000 7fb9daa00640 1 --2- 172.21.15.100:0/3523120474 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9dc06dc80 0x7fb9dc149c80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00c590 tx=0x7fb9cc007d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.821+0000 7fa6d5800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa6d0159060 0x7fa6d00cabc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37416/0 (socket says 172.21.15.100:37416) 2024-08-17T02:45:47.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.822+0000 7fa6d5800640 1 -- 172.21.15.100:0/3738488109 learned_addr learned my addr 172.21.15.100:0/3738488109 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:47.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.822+0000 7fa6d6200640 1 --2- 172.21.15.100:0/3738488109 >> v2:172.21.15.100:3300/0 conn(0x7fa6d0159430 0x7fa6d00c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.822+0000 7fa6d4e00640 1 --2- 172.21.15.100:0/3738488109 >> v2:172.21.15.123:3300/0 conn(0x7fa6d00c6a30 0x7fa6d00cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.822+0000 7fb9d2000640 1 -- 172.21.15.100:0/3523120474 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc012630 con 0x7fb9dc06dc80 2024-08-17T02:45:47.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.822+0000 7fb9d2000640 1 -- 172.21.15.100:0/3523120474 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc0127b0 con 0x7fb9dc06dc80 2024-08-17T02:45:47.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.822+0000 7fb9d2000640 1 -- 172.21.15.100:0/3523120474 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc012bb0 con 0x7fb9dc06dc80 2024-08-17T02:45:47.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.821+0000 7f351d000640 1 -- start start 2024-08-17T02:45:47.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.823+0000 7f37bfe00640 1 Processor -- start 2024-08-17T02:45:47.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.823+0000 7f351d000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f351806dc80 0x7f35180ae970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.823+0000 7f351d000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35180b17d0 con 0x7f35180cb2d0 2024-08-17T02:45:47.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.823+0000 7f351d000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35180c9420 con 0x7f35180caf00 2024-08-17T02:45:47.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.823+0000 7f351d000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35180b0cc0 con 0x7f351806dc80 2024-08-17T02:45:47.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.823+0000 7fa6cfe00640 1 -- 172.21.15.100:0/3738488109 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582022539 0 0) 0x7fa6d00cbf40 con 0x7fa6d0159060 2024-08-17T02:45:47.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.823+0000 7fa6cfe00640 1 -- 172.21.15.100:0/3738488109 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6b80034e0 con 0x7fa6d0159060 2024-08-17T02:45:47.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.823+0000 7fa6d4e00640 1 -- 172.21.15.100:0/3738488109 >> v2:172.21.15.100:3300/0 conn(0x7fa6d0159430 msgr2=0x7fa6d00c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:47.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.823+0000 7f3515e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f35180caf00 0x7f35180adb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.100:36962/0 (socket says 172.21.15.100:36962) 2024-08-17T02:45:47.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.823+0000 7f3515e00640 1 -- 172.21.15.100:0/1951001597 learned_addr learned my addr 172.21.15.100:0/1951001597 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:47.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.823+0000 7f37bfe00640 1 -- start start 2024-08-17T02:45:47.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.823+0000 7f3516800640 1 --2- 172.21.15.100:0/1951001597 >> v2:172.21.15.100:3300/0 conn(0x7f351806dc80 0x7f35180ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.823+0000 7fb9e1a00640 1 -- 172.21.15.100:0/3523120474 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9dc14a540 con 0x7fb9dc06dc80 2024-08-17T02:45:47.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.823+0000 7fb9e1a00640 1 -- 172.21.15.100:0/3523120474 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc14ab00 con 0x7fb9dc06dc80 2024-08-17T02:45:47.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.823+0000 7f1a61c00640 1 --2- 172.21.15.100:0/4013215087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a54033a80 0x7f1a540e4320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800e900 tx=0x7f1a480090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.823+0000 7fa6cfe00640 1 -- 172.21.15.100:0/3738488109 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3935161285 0 0) 0x7fa6b80034e0 con 0x7fa6d0159060 2024-08-17T02:45:47.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.823+0000 7fa6d4e00640 1 --2- 172.21.15.100:0/3738488109 >> v2:172.21.15.100:3300/0 conn(0x7fa6d0159430 0x7fa6d00c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.823+0000 7fa6d4e00640 1 -- 172.21.15.100:0/3738488109 >> v1:172.21.15.100:6789/0 conn(0x7fa6d0159060 legacy=0x7fa6d00cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.823+0000 7fa6d4e00640 1 -- 172.21.15.100:0/3738488109 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d00cbbd0 con 0x7fa6d00c6a30 2024-08-17T02:45:47.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.824+0000 7f1a58c00640 1 -- 172.21.15.100:0/4013215087 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4800c8e0 con 0x7f1a54033a80 2024-08-17T02:45:47.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.825+0000 7fa6d6200640 1 --2- 172.21.15.100:0/3738488109 >> v2:172.21.15.100:3300/0 conn(0x7fa6d0159430 0x7fa6d00c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:45:47.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.824+0000 7f1a58c00640 1 -- 172.21.15.100:0/4013215087 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4800ca40 con 0x7f1a54033a80 2024-08-17T02:45:47.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.824+0000 7f1a58c00640 1 -- 172.21.15.100:0/4013215087 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4800cde0 con 0x7f1a54033a80 2024-08-17T02:45:47.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.824+0000 7f1a63000640 1 -- 172.21.15.100:0/4013215087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a50009390 con 0x7f1a54033a80 2024-08-17T02:45:47.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.824+0000 7f3514a00640 1 -- 172.21.15.100:0/1951001597 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746986821 0 0) 0x7f35180c9420 con 0x7f35180caf00 2024-08-17T02:45:47.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.824+0000 7f3514a00640 1 -- 172.21.15.100:0/1951001597 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34fc0034e0 con 0x7f35180caf00 2024-08-17T02:45:47.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.824+0000 7f3514a00640 1 -- 172.21.15.100:0/1951001597 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25286617 0 0) 0x7f35180b17d0 con 0x7f35180cb2d0 2024-08-17T02:45:47.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.824+0000 7f3514a00640 1 -- 172.21.15.100:0/1951001597 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35180c9420 con 0x7f35180cb2d0 2024-08-17T02:45:47.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.825+0000 7f3514a00640 1 -- 172.21.15.100:0/1951001597 <== mon.1 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 535933099 0 0) 0x7f34fc0034e0 con 0x7f35180caf00 2024-08-17T02:45:47.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.825+0000 7f3514a00640 1 -- 172.21.15.100:0/1951001597 >> v2:172.21.15.100:3300/0 conn(0x7f351806dc80 msgr2=0x7f35180ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:47.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.825+0000 7f1a63000640 1 -- 172.21.15.100:0/4013215087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a540e3840 con 0x7f1a54033a80 2024-08-17T02:45:47.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.825+0000 7f3514a00640 1 --2- 172.21.15.100:0/1951001597 >> v2:172.21.15.100:3300/0 conn(0x7f351806dc80 0x7f35180ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.825+0000 7f2bb6200640 1 Processor -- start 2024-08-17T02:45:47.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.825+0000 7fa6d4e00640 1 --2- 172.21.15.100:0/3738488109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6d00c6a30 0x7fa6d00cb2d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00b5de0 tx=0x7fa6c40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e20634da82fba3b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.825+0000 7f3514a00640 1 -- 172.21.15.100:0/1951001597 >> v1:172.21.15.100:6789/0 conn(0x7f35180cb2d0 legacy=0x7f351806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.825+0000 7f3514a00640 1 -- 172.21.15.100:0/1951001597 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35180c96c0 con 0x7f35180caf00 2024-08-17T02:45:47.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.825+0000 7f3514a00640 1 -- 172.21.15.100:0/1951001597 <== mon.1 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1817143124 0 0) 0x7f3504001470 con 0x7f35180caf00 2024-08-17T02:45:47.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.825+0000 7f3514a00640 1 -- 172.21.15.100:0/1951001597 >> v1:172.21.15.123:6789/0 conn(0x7f35180caf00 legacy=0x7f35180adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.825+0000 7f3514a00640 1 --2- 172.21.15.100:0/1951001597 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f34fc003b60 0x7f34fc003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.825+0000 7f3514a00640 1 --2- 172.21.15.100:0/1951001597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34fc004780 0x7f34fc004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.825+0000 7f3514a00640 1 --2- 172.21.15.100:0/1951001597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34fc005130 0x7f34fc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.825+0000 7f3514a00640 1 -- 172.21.15.100:0/1951001597 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35180b0cc0 con 0x7f34fc005130 2024-08-17T02:45:47.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.825+0000 7f3514a00640 1 -- 172.21.15.100:0/1951001597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc00c020 con 0x7f34fc004780 2024-08-17T02:45:47.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.825+0000 7f3514a00640 1 -- 172.21.15.100:0/1951001597 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc00c1e0 con 0x7f34fc003b60 2024-08-17T02:45:47.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.825+0000 7f3516800640 1 --2- 172.21.15.100:0/1951001597 >> v2:172.21.15.100:3300/0 conn(0x7f351806dc80 0x7f35180ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:47.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.826+0000 7fa6cfe00640 1 -- 172.21.15.100:0/3738488109 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80017f0 con 0x7fa6d00c6a30 2024-08-17T02:45:47.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.826+0000 7f3515400640 1 --2- 172.21.15.100:0/1951001597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34fc004780 0x7f34fc004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.826+0000 7fa6cfe00640 1 -- 172.21.15.100:0/3738488109 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c402a9f0 con 0x7fa6d00c6a30 2024-08-17T02:45:47.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.826+0000 7f3515e00640 1 --2- 172.21.15.100:0/1951001597 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f34fc003b60 0x7f34fc003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.826+0000 7fa6cfe00640 1 -- 172.21.15.100:0/3738488109 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c402ad70 con 0x7fa6d00c6a30 2024-08-17T02:45:47.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.826+0000 7f3516800640 1 --2- 172.21.15.100:0/1951001597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34fc005130 0x7f34fc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.826+0000 7f3515400640 1 -- 172.21.15.100:0/1951001597 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f34fc003b60 msgr2=0x7f34fc003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:47.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.826+0000 7f3515400640 1 --2- 172.21.15.100:0/1951001597 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f34fc003b60 0x7f34fc003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.826+0000 7f3515400640 1 -- 172.21.15.100:0/1951001597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34fc005130 msgr2=0x7f34fc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:47.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.826+0000 7f2bb6200640 1 -- start start 2024-08-17T02:45:47.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.827+0000 7f37bfe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f37c00aed50 0x7f37c00ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.827+0000 7f37bfe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f37c00ce6d0 0x7f37c00ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.827+0000 7f37bfe00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c00cc890 con 0x7f37c00cacf0 2024-08-17T02:45:47.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.827+0000 7f37bfe00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c00ceb20 con 0x7f37c00aed50 2024-08-17T02:45:47.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.827+0000 7f37bfe00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c00cb4c0 con 0x7f37c00ce6d0 2024-08-17T02:45:47.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.827+0000 7f37be000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f37c00ce6d0 0x7f37c00ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.827+0000 7f37be000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f37c00ce6d0 0x7f37c00ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:52658/0 (socket says 172.21.15.100:52658) 2024-08-17T02:45:47.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.827+0000 7f37be000640 1 -- 172.21.15.100:0/3219705880 learned_addr learned my addr 172.21.15.100:0/3219705880 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:47.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.827+0000 7f3515400640 1 --2- 172.21.15.100:0/1951001597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34fc005130 0x7f34fc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.827+0000 7f3515400640 1 -- 172.21.15.100:0/1951001597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35180c96c0 con 0x7f34fc004780 2024-08-17T02:45:47.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.827+0000 7f3516800640 1 --2- 172.21.15.100:0/1951001597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34fc005130 0x7f34fc00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:47.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.828+0000 7f37be000640 1 -- 172.21.15.100:0/3219705880 >> v2:172.21.15.100:3300/0 conn(0x7f37c00aed50 msgr2=0x7f37c00ce190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:45:47.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.828+0000 7f37be000640 1 --2- 172.21.15.100:0/3219705880 >> v2:172.21.15.100:3300/0 conn(0x7f37c00aed50 0x7f37c00ce190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.828+0000 7f37be000640 1 -- 172.21.15.100:0/3219705880 >> v1:172.21.15.100:6789/0 conn(0x7f37c00cacf0 legacy=0x7f37c00c4c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:45:47.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.828+0000 7f37be000640 1 -- 172.21.15.100:0/3219705880 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c00cb7a0 con 0x7f37c00ce6d0 2024-08-17T02:45:47.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.827+0000 7fb9e1a00640 1 -- 172.21.15.100:0/3523120474 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb9dc071050 con 0x7fb9dc06dc80 2024-08-17T02:45:47.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.828+0000 7f3516800640 1 -- 172.21.15.100:0/1951001597 reap_dead start 2024-08-17T02:45:47.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.828+0000 7fa6d8200640 1 -- 172.21.15.100:0/3738488109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6d00c6a30 msgr2=0x7fa6d00cb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.828+0000 7fa6d8200640 1 --2- 172.21.15.100:0/3738488109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6d00c6a30 0x7fa6d00cb2d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00b5de0 tx=0x7fa6c40090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.828+0000 7f1a63000640 1 -- 172.21.15.100:0/4013215087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a38000fd0 con 0x7f1a54033a80 2024-08-17T02:45:47.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.828+0000 7f6408600640 1 Processor -- start 2024-08-17T02:45:47.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.828+0000 7fa6d8200640 1 -- 172.21.15.100:0/3738488109 shutdown_connections 2024-08-17T02:45:47.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.828+0000 7fa6d8200640 1 --2- 172.21.15.100:0/3738488109 >> v2:172.21.15.100:3300/0 conn(0x7fa6d0159430 0x7fa6d00c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.828+0000 7fa6d8200640 1 --2- 172.21.15.100:0/3738488109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6d00c6a30 0x7fa6d00cb2d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.828+0000 7fa6d8200640 1 -- 172.21.15.100:0/3738488109 >> 172.21.15.100:0/3738488109 conn(0x7fa6d00cfde0 msgr2=0x7fa6d00d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:47.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.828+0000 7f2bb6200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2bb0158c80 0x7f2bb00ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.828+0000 7f2bb6200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2bb00cd700 0x7f2bb00cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.828+0000 7f2bb6200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2bb00cc800 0x7f2bb00ca380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.828+0000 7f2bb6200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb00cf9d0 con 0x7f2bb00cc800 2024-08-17T02:45:47.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.828+0000 7f2bb6200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb00ceb60 con 0x7f2bb00cd700 2024-08-17T02:45:47.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.828+0000 7f2bb6200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb00cedc0 con 0x7f2bb0158c80 2024-08-17T02:45:47.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.828+0000 7f2ba7e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2bb00cd700 0x7f2bb00cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.829+0000 7f2ba7e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2bb00cd700 0x7f2bb00cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:52660/0 (socket says 172.21.15.100:52660) 2024-08-17T02:45:47.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.829+0000 7f2ba7e00640 1 -- 172.21.15.100:0/222936842 learned_addr learned my addr 172.21.15.100:0/222936842 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:47.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.829+0000 7f3515400640 1 --2- 172.21.15.100:0/1951001597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34fc004780 0x7f34fc004bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3508001990 tx=0x7f3508007c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b265b4061c87dfea server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.829+0000 7fa6d8200640 1 -- 172.21.15.100:0/3738488109 shutdown_connections 2024-08-17T02:45:47.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.829+0000 7f6408600640 1 -- start start 2024-08-17T02:45:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.829+0000 7f2bb4e00640 1 --2- 172.21.15.100:0/222936842 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2bb0158c80 0x7f2bb00ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.829+0000 7f3514a00640 1 -- 172.21.15.100:0/1951001597 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350802ab10 con 0x7f34fc004780 2024-08-17T02:45:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.829+0000 7f3514a00640 1 -- 172.21.15.100:0/1951001597 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350802ac70 con 0x7f34fc004780 2024-08-17T02:45:47.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.829+0000 7f3514a00640 1 -- 172.21.15.100:0/1951001597 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508032620 con 0x7f34fc004780 2024-08-17T02:45:47.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.829+0000 7f2ba7e00640 1 -- 172.21.15.100:0/222936842 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2bb0158c80 msgr2=0x7f2bb00ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:47.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.829+0000 7f2ba7e00640 1 --2- 172.21.15.100:0/222936842 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2bb0158c80 0x7f2bb00ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.829+0000 7f37be000640 1 --2- 172.21.15.100:0/3219705880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37c00ce6d0 0x7f37c00ca7b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f37c00d0c40 tx=0x7f37b8009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fb15571e7fd71b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.829+0000 7fa6d8200640 1 -- 172.21.15.100:0/3738488109 wait complete. 2024-08-17T02:45:47.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.830+0000 7fb9d2000640 1 -- 172.21.15.100:0/3523120474 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb9cc01a3b0 con 0x7fb9dc06dc80 2024-08-17T02:45:47.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.830+0000 7f37bd600640 1 -- 172.21.15.100:0/3219705880 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b8031400 con 0x7f37c00ce6d0 2024-08-17T02:45:47.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.830+0000 7f37bd600640 1 -- 172.21.15.100:0/3219705880 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b802d050 con 0x7f37c00ce6d0 2024-08-17T02:45:47.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.830+0000 7f37bd600640 1 -- 172.21.15.100:0/3219705880 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b8031790 con 0x7f37c00ce6d0 2024-08-17T02:45:47.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.829+0000 7f2ba7e00640 1 -- 172.21.15.100:0/222936842 >> v2:172.21.15.100:3300/0 conn(0x7f2bb00cc800 msgr2=0x7f2bb00ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:47.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.829+0000 7f2ba7e00640 1 --2- 172.21.15.100:0/222936842 >> v2:172.21.15.100:3300/0 conn(0x7f2bb00cc800 0x7f2bb00ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.829+0000 7f2ba7e00640 1 -- 172.21.15.100:0/222936842 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb00cf0a0 con 0x7f2bb00cd700 2024-08-17T02:45:47.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.830+0000 7f351d000640 1 -- 172.21.15.100:0/1951001597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34fc004780 msgr2=0x7f34fc004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.830+0000 7f351d000640 1 --2- 172.21.15.100:0/1951001597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34fc004780 0x7f34fc004bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3508001990 tx=0x7f3508007c80 comp rx=0 tx=0).stop 2024-08-17T02:45:47.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.830+0000 7f2ba7e00640 1 --2- 172.21.15.100:0/222936842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bb00cd700 0x7f2bb00cc2c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2bb008a090 tx=0x7f2b980091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e90a992649727829 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f37bfe00640 1 -- 172.21.15.100:0/3219705880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37c00ce6d0 msgr2=0x7f37c00ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f37bfe00640 1 --2- 172.21.15.100:0/3219705880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37c00ce6d0 0x7f37c00ca7b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f37c00d0c40 tx=0x7f37b8009840 comp rx=0 tx=0).stop 2024-08-17T02:45:47.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f351d000640 1 -- 172.21.15.100:0/1951001597 shutdown_connections 2024-08-17T02:45:47.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f351d000640 1 --2- 172.21.15.100:0/1951001597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34fc004780 0x7f34fc004bf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f351d000640 1 -- 172.21.15.100:0/1951001597 >> 172.21.15.100:0/1951001597 conn(0x7f35180cb7f0 msgr2=0x7f35180cbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:47.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.830+0000 7f1a58c00640 1 -- 172.21.15.100:0/4013215087 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1a48013680 con 0x7f1a54033a80 2024-08-17T02:45:47.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f6408600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f640006e7f0 0x7f64000adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f6408600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f640013e130 0x7f640013e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f6408600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6400069ed0 0x7f640006a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f6408600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64000af6e0 con 0x7f640013e130 2024-08-17T02:45:47.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f6408600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64000ad6c0 con 0x7f6400069ed0 2024-08-17T02:45:47.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f6408600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640006a850 con 0x7f640006e7f0 2024-08-17T02:45:47.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f37bfe00640 1 -- 172.21.15.100:0/3219705880 shutdown_connections 2024-08-17T02:45:47.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f37bfe00640 1 --2- 172.21.15.100:0/3219705880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37c00ce6d0 0x7f37c00ca7b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f37bfe00640 1 --2- 172.21.15.100:0/3219705880 >> v2:172.21.15.100:3300/0 conn(0x7f37c00aed50 0x7f37c00ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f37bfe00640 1 -- 172.21.15.100:0/3219705880 >> 172.21.15.100:0/3219705880 conn(0x7f37c0098e30 msgr2=0x7f37c006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:47.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f351d000640 1 -- 172.21.15.100:0/1951001597 shutdown_connections 2024-08-17T02:45:47.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f6405200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f640013e130 0x7f640013e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f6405200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f640013e130 0x7f640013e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32974/0 (socket says 172.21.15.100:32974) 2024-08-17T02:45:47.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f6405200640 1 -- 172.21.15.100:0/2397335691 learned_addr learned my addr 172.21.15.100:0/2397335691 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:47.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f6406600640 1 --2- 172.21.15.100:0/2397335691 >> v2:172.21.15.123:3300/0 conn(0x7f6400069ed0 0x7f640006a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7f351d000640 1 -- 172.21.15.100:0/1951001597 wait complete. 2024-08-17T02:45:47.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7f1a58c00640 1 --2- 172.21.15.100:0/4013215087 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1a3c0652a0 0x7f1a3c067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7f37bfe00640 1 -- 172.21.15.100:0/3219705880 shutdown_connections 2024-08-17T02:45:47.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7f37bfe00640 1 -- 172.21.15.100:0/3219705880 wait complete. 2024-08-17T02:45:47.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7f6405200640 1 -- 172.21.15.100:0/2397335691 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f640006e7f0 msgr2=0x7f64000adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:47.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7f6405c00640 1 --2- 172.21.15.100:0/2397335691 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f640006e7f0 0x7f64000adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7f2bafe00640 1 -- 172.21.15.100:0/222936842 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9802ad40 con 0x7f2bb00cd700 2024-08-17T02:45:47.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7fb9d2000640 1 --2- 172.21.15.100:0/3523120474 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb9bc0652a0 0x7fb9bc067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7f1a58c00640 1 -- 172.21.15.100:0/4013215087 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1a48082530 con 0x7f1a54033a80 2024-08-17T02:45:47.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7f1a58c00640 1 --2- 172.21.15.100:0/4013215087 >> [v2:172.21.15.100:6816/37022,v1:172.21.15.100:6817/37022] conn(0x7f1a3c06d4b0 0x7f1a3c06f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7f1a58c00640 1 -- 172.21.15.100:0/4013215087 --> [v2:172.21.15.100:6816/37022,v1:172.21.15.100:6817/37022] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a3c06ff70 con 0x7f1a3c06d4b0 2024-08-17T02:45:47.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7f1a58c00640 1 -- 172.21.15.100:0/4013215087 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a48084ad0 con 0x7f1a54033a80 2024-08-17T02:45:47.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.831+0000 7fb9d2000640 1 -- 172.21.15.100:0/3523120474 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb9cc0823a0 con 0x7fb9dc06dc80 2024-08-17T02:45:47.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7fb9d2000640 1 --2- 172.21.15.100:0/3523120474 >> [v2:172.21.15.100:6800/37019,v1:172.21.15.100:6801/37019] conn(0x7fb9bc06d430 0x7fb9bc06f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7fb9d2000640 1 -- 172.21.15.100:0/3523120474 --> [v2:172.21.15.100:6800/37019,v1:172.21.15.100:6801/37019] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb9bc06fef0 con 0x7fb9bc06d430 2024-08-17T02:45:47.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7f1a61200640 1 --2- 172.21.15.100:0/4013215087 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1a3c0652a0 0x7f1a3c067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.833+0000 7f1a62600640 1 --2- 172.21.15.100:0/4013215087 >> [v2:172.21.15.100:6816/37022,v1:172.21.15.100:6817/37022] conn(0x7f1a3c06d4b0 0x7f1a3c06f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7fa6d8200640 1 Processor -- start 2024-08-17T02:45:47.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7f6405200640 1 --2- 172.21.15.100:0/2397335691 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f640006e7f0 0x7f64000adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7f6405200640 1 -- 172.21.15.100:0/2397335691 >> v2:172.21.15.123:3300/0 conn(0x7f6400069ed0 msgr2=0x7f640006a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:47.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7f6405200640 1 --2- 172.21.15.100:0/2397335691 >> v2:172.21.15.123:3300/0 conn(0x7f6400069ed0 0x7f640006a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7f6405200640 1 -- 172.21.15.100:0/2397335691 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640015bd60 con 0x7f640013e130 2024-08-17T02:45:47.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7f6405c00640 1 --2- 172.21.15.100:0/2397335691 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f640006e7f0 0x7f64000adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:45:47.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7f6406600640 1 --2- 172.21.15.100:0/2397335691 >> v2:172.21.15.123:3300/0 conn(0x7f6400069ed0 0x7f640006a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:47.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7f2bafe00640 1 -- 172.21.15.100:0/222936842 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b98032440 con 0x7f2bb00cd700 2024-08-17T02:45:47.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.832+0000 7f2bafe00640 1 -- 172.21.15.100:0/222936842 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9802aea0 con 0x7f2bb00cd700 2024-08-17T02:45:47.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.833+0000 7f6405200640 1 --2- 172.21.15.100:0/2397335691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f640013e130 0x7f640013e580 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f64000706f0 tx=0x7f63f40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531b6b950dfbb3ea server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.833+0000 7fb9da000640 1 --2- 172.21.15.100:0/3523120474 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb9bc0652a0 0x7fb9bc067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.834+0000 7f63ffe00640 1 -- 172.21.15.100:0/2397335691 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f402ae40 con 0x7f640013e130 2024-08-17T02:45:47.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.834+0000 7fb9db400640 1 --2- 172.21.15.100:0/3523120474 >> [v2:172.21.15.100:6800/37019,v1:172.21.15.100:6801/37019] conn(0x7fb9bc06d430 0x7fb9bc06f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.834+0000 7fb9da000640 1 --2- 172.21.15.100:0/3523120474 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb9bc0652a0 0x7fb9bc067750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8005840 tx=0x7fb9c8007940 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.834+0000 7f63ffe00640 1 -- 172.21.15.100:0/2397335691 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f4032440 con 0x7f640013e130 2024-08-17T02:45:47.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.834+0000 7f63ffe00640 1 -- 172.21.15.100:0/2397335691 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f402ae40 con 0x7f640013e130 2024-08-17T02:45:47.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.834+0000 7fb9d2000640 1 -- 172.21.15.100:0/3523120474 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9cc050440 con 0x7fb9dc06dc80 2024-08-17T02:45:47.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.834+0000 7fa6d8200640 1 -- start start 2024-08-17T02:45:47.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.834+0000 7f2bb6200640 1 -- 172.21.15.100:0/222936842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bb00cd700 msgr2=0x7f2bb00cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.834+0000 7f2bb6200640 1 --2- 172.21.15.100:0/222936842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bb00cd700 0x7f2bb00cc2c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2bb008a090 tx=0x7f2b980091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.833+0000 7f1a62600640 1 --2- 172.21.15.100:0/4013215087 >> [v2:172.21.15.100:6816/37022,v1:172.21.15.100:6817/37022] conn(0x7f1a3c06d4b0 0x7f1a3c06f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.835+0000 7f5a0de00640 1 Processor -- start 2024-08-17T02:45:47.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.835+0000 7f5a0de00640 1 -- start start 2024-08-17T02:45:47.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.835+0000 7f2bb6200640 1 -- 172.21.15.100:0/222936842 shutdown_connections 2024-08-17T02:45:47.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.835+0000 7f2bb6200640 1 --2- 172.21.15.100:0/222936842 >> v2:172.21.15.100:3300/0 conn(0x7f2bb00cc800 0x7f2bb00ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.835+0000 7f2bb6200640 1 --2- 172.21.15.100:0/222936842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bb00cd700 0x7f2bb00cc2c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.835+0000 7f2bb6200640 1 --2- 172.21.15.100:0/222936842 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2bb0158c80 0x7f2bb00ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.835+0000 7f2bb6200640 1 -- 172.21.15.100:0/222936842 >> 172.21.15.100:0/222936842 conn(0x7f2bb0098e30 msgr2=0x7f2bb006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:47.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.835+0000 7f2bb6200640 1 -- 172.21.15.100:0/222936842 shutdown_connections 2024-08-17T02:45:47.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7fa6d8200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6d00c6a30 0x7fa6d0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7f6408600640 1 -- 172.21.15.100:0/2397335691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f640013e130 msgr2=0x7f640013e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7f6408600640 1 --2- 172.21.15.100:0/2397335691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f640013e130 0x7f640013e580 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f64000706f0 tx=0x7f63f40091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.835+0000 7f1a61200640 1 --2- 172.21.15.100:0/4013215087 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1a3c0652a0 0x7f1a3c067750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c02ae30 tx=0x7f1a5c069040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7f1a58c00640 1 -- 172.21.15.100:0/4013215087 <== osd.1 v2:172.21.15.100:6816/37022 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f1a3c06ff70 con 0x7f1a3c06d4b0 2024-08-17T02:45:47.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7f37bfe00640 1 Processor -- start 2024-08-17T02:45:47.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7fa6d8200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6d0159060 0x7fa6d0154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7f6408600640 1 -- 172.21.15.100:0/2397335691 shutdown_connections 2024-08-17T02:45:47.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7f6408600640 1 --2- 172.21.15.100:0/2397335691 >> v2:172.21.15.123:3300/0 conn(0x7f6400069ed0 0x7f640006a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7f6408600640 1 --2- 172.21.15.100:0/2397335691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f640013e130 0x7f640013e580 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7f6408600640 1 --2- 172.21.15.100:0/2397335691 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f640006e7f0 0x7f64000adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7f6408600640 1 -- 172.21.15.100:0/2397335691 >> 172.21.15.100:0/2397335691 conn(0x7f64000cc480 msgr2=0x7f64000687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:47.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7f37bfe00640 1 -- start start 2024-08-17T02:45:47.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7f351d000640 1 Processor -- start 2024-08-17T02:45:47.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7fa6d8200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa6d0159430 0x7fa6d0154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7fa6d8200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d015d430 con 0x7fa6d0159060 2024-08-17T02:45:47.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7fa6d8200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d015d710 con 0x7fa6d00c6a30 2024-08-17T02:45:47.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7fa6d8200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d015d9f0 con 0x7fa6d0159430 2024-08-17T02:45:47.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7f351d000640 1 -- start start 2024-08-17T02:45:47.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7f6408600640 1 -- 172.21.15.100:0/2397335691 shutdown_connections 2024-08-17T02:45:47.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.835+0000 7f2bb6200640 1 -- 172.21.15.100:0/222936842 wait complete. 2024-08-17T02:45:47.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7fa6d6200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa6d0159430 0x7fa6d0154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7fa6d6200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa6d0159430 0x7fa6d0154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:32924/0 (socket says 172.21.15.100:32924) 2024-08-17T02:45:47.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7fa6d6200640 1 -- 172.21.15.100:0/3582081462 learned_addr learned my addr 172.21.15.100:0/3582081462 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:47.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.837+0000 7fa6d5800640 1 --2- 172.21.15.100:0/3582081462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6d00c6a30 0x7fa6d0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.837+0000 7f5a0de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5a081401b0 0x7f5a080caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.837+0000 7f5a0de00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5a080b1440 0x7f5a080c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.837+0000 7f5a0de00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a080caa80 con 0x7f5a08140580 2024-08-17T02:45:47.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.837+0000 7f5a0de00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a080cb450 con 0x7f5a080b1440 2024-08-17T02:45:47.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.837+0000 7fb9db400640 1 --2- 172.21.15.100:0/3523120474 >> [v2:172.21.15.100:6800/37019,v1:172.21.15.100:6801/37019] conn(0x7fb9bc06d430 0x7fb9bc06f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.837+0000 7f5a0de00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a080c9e70 con 0x7f5a081401b0 2024-08-17T02:45:47.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.837+0000 7f2bb6200640 1 Processor -- start 2024-08-17T02:45:47.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.837+0000 7f2bb6200640 1 -- start start 2024-08-17T02:45:47.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.836+0000 7f6408600640 1 -- 172.21.15.100:0/2397335691 wait complete. 2024-08-17T02:45:47.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.837+0000 7fa6d6200640 1 -- 172.21.15.100:0/3582081462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6d00c6a30 msgr2=0x7fa6d0067f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.837+0000 7fa6d6200640 1 --2- 172.21.15.100:0/3582081462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6d00c6a30 0x7fa6d0067f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.837+0000 7fa6d6200640 1 -- 172.21.15.100:0/3582081462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6d0159060 msgr2=0x7fa6d0154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.837+0000 7fa6d4e00640 1 --2- 172.21.15.100:0/3582081462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6d0159060 0x7fa6d0154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.837+0000 7fa6d6200640 1 --2- 172.21.15.100:0/3582081462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6d0159060 0x7fa6d0154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.837+0000 7fa6d6200640 1 -- 172.21.15.100:0/3582081462 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c4009390 con 0x7fa6d0159430 2024-08-17T02:45:47.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.838+0000 7fa6d4e00640 1 --2- 172.21.15.100:0/3582081462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6d0159060 0x7fa6d0154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:45:47.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.838+0000 7f37bfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c00aed50 0x7f37c01509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.838+0000 7f5a06000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5a08140580 0x7f5a080b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37432/0 (socket says 172.21.15.100:37432) 2024-08-17T02:45:47.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.838+0000 7f5a06000640 1 -- 172.21.15.100:0/566384654 learned_addr learned my addr 172.21.15.100:0/566384654 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:47.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.838+0000 7f37bfe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37c00cacf0 0x7f37c00b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.838+0000 7fb9d2000640 1 -- 172.21.15.100:0/3523120474 <== osd.0 v2:172.21.15.100:6800/37019 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb9bc06fef0 con 0x7fb9bc06d430 2024-08-17T02:45:47.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.838+0000 7f37bfe00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f37c00ce6d0 0x7f37c00c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.838+0000 7fa6d6200640 1 --2- 172.21.15.100:0/3582081462 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa6d0159430 0x7fa6d0154ab0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc00c850 tx=0x7fa6bc008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7f37be000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37c00cacf0 0x7f37c00b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7f37be000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37c00cacf0 0x7f37c00b4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:52692/0 (socket says 172.21.15.100:52692) 2024-08-17T02:45:47.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7f5a06a00640 1 --2- 172.21.15.100:0/566384654 >> v2:172.21.15.123:3300/0 conn(0x7f5a081401b0 0x7f5a080caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7fa6ccc00640 1 -- 172.21.15.100:0/3582081462 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc007620 con 0x7fa6d0159430 2024-08-17T02:45:47.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7f37be000640 1 -- 172.21.15.100:0/3310143620 learned_addr learned my addr 172.21.15.100:0/3310143620 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:47.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.838+0000 7f6408600640 1 Processor -- start 2024-08-17T02:45:47.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7f37bf400640 1 --2- 172.21.15.100:0/3310143620 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f37c00ce6d0 0x7f37c00c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7f37bfe00640 1 -- 172.21.15.100:0/3310143620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c00b55e0 con 0x7f37c00aed50 2024-08-17T02:45:47.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7f37bfe00640 1 -- 172.21.15.100:0/3310143620 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c0155150 con 0x7f37c00cacf0 2024-08-17T02:45:47.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7f37bfe00640 1 -- 172.21.15.100:0/3310143620 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c0154820 con 0x7f37c00ce6d0 2024-08-17T02:45:47.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7f6408600640 1 -- start start 2024-08-17T02:45:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7f351d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34fc004780 0x7f351815c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7f351d000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f351814baf0 0x7f35180aa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7f351d000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f35180697b0 0x7f3518069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7f351d000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351806a160 con 0x7f34fc004780 2024-08-17T02:45:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7f351d000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35180abc60 con 0x7f351814baf0 2024-08-17T02:45:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7f351d000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35180ac0f0 con 0x7f35180697b0 2024-08-17T02:45:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7fa6ccc00640 1 -- 172.21.15.100:0/3582081462 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6bc007780 con 0x7fa6d0159430 2024-08-17T02:45:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7fa6ccc00640 1 -- 172.21.15.100:0/3582081462 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc007b40 con 0x7fa6d0159430 2024-08-17T02:45:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7fa6d8200640 1 -- 172.21.15.100:0/3582081462 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d015dcd0 con 0x7fa6d0159430 2024-08-17T02:45:47.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7fa6d8200640 1 -- 172.21.15.100:0/3582081462 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d0068490 con 0x7fa6d0159430 2024-08-17T02:45:47.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.839+0000 7f5a06a00640 1 -- 172.21.15.100:0/566384654 >> v2:172.21.15.100:3300/0 conn(0x7f5a080b1440 msgr2=0x7f5a080c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:47.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.840+0000 7f3515e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34fc004780 0x7f351815c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.840+0000 7f2bb6200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2bb00cc800 0x7f2bb014d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.840+0000 7f3515e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34fc004780 0x7f351815c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33006/0 (socket says 172.21.15.100:33006) 2024-08-17T02:45:47.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.840+0000 7f3515e00640 1 -- 172.21.15.100:0/80301735 learned_addr learned my addr 172.21.15.100:0/80301735 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:47.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.840+0000 7f37bf400640 1 -- 172.21.15.100:0/3310143620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37c00cacf0 msgr2=0x7f37c00b4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.840+0000 7f37bf400640 1 --2- 172.21.15.100:0/3310143620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37c00cacf0 0x7f37c00b4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.840+0000 7f37bf400640 1 -- 172.21.15.100:0/3310143620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c00aed50 msgr2=0x7f37c01509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.840+0000 7f37bf400640 1 --2- 172.21.15.100:0/3310143620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c00aed50 0x7f37c01509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.840+0000 7f37bf400640 1 -- 172.21.15.100:0/3310143620 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b8009ae0 con 0x7f37c00ce6d0 2024-08-17T02:45:47.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.840+0000 7f37be000640 1 --2- 172.21.15.100:0/3310143620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37c00cacf0 0x7f37c00b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:47.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.840+0000 7f2bb6200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bb00cd700 0x7f2bb00b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.840+0000 7f2bb4e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2bb00cc800 0x7f2bb014d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.840+0000 7f2bb4e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2bb00cc800 0x7f2bb014d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:32942/0 (socket says 172.21.15.100:32942) 2024-08-17T02:45:47.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.840+0000 7f3515400640 1 --2- 172.21.15.100:0/80301735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f351814baf0 0x7f35180aa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.840+0000 7f3516800640 1 --2- 172.21.15.100:0/80301735 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f35180697b0 0x7f3518069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.840+0000 7f2bb4e00640 1 -- 172.21.15.100:0/3088564028 learned_addr learned my addr 172.21.15.100:0/3088564028 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:47.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.840+0000 7f5a05600640 1 -- 172.21.15.100:0/566384654 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466161907 0 0) 0x7f5a080caa80 con 0x7f5a08140580 2024-08-17T02:45:47.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.841+0000 7f5a06a00640 1 --2- 172.21.15.100:0/566384654 >> v2:172.21.15.100:3300/0 conn(0x7f5a080b1440 0x7f5a080c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.841+0000 7f5a06a00640 1 -- 172.21.15.100:0/566384654 >> v1:172.21.15.100:6789/0 conn(0x7f5a08140580 legacy=0x7f5a080b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.841+0000 7f5a06a00640 1 -- 172.21.15.100:0/566384654 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a080ca150 con 0x7f5a081401b0 2024-08-17T02:45:47.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.841+0000 7f2bb6200640 1 --2- 172.21.15.100:0/3088564028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bb0158c80 0x7f2bb00c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.841+0000 7f2ba7e00640 1 --2- 172.21.15.100:0/3088564028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bb00cd700 0x7f2bb00b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.841+0000 7f37bf400640 1 --2- 172.21.15.100:0/3310143620 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f37c00ce6d0 0x7f37c00c5c00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f37b000b4c0 tx=0x7f37b0006f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.841+0000 7f37b6000640 1 -- 172.21.15.100:0/3310143620 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b000f510 con 0x7f37c00ce6d0 2024-08-17T02:45:47.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.841+0000 7f3515400640 1 -- 172.21.15.100:0/80301735 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f35180697b0 msgr2=0x7f3518069c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.841+0000 7f3515400640 1 --2- 172.21.15.100:0/80301735 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f35180697b0 0x7f3518069c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.841+0000 7f3515400640 1 -- 172.21.15.100:0/80301735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34fc004780 msgr2=0x7f351815c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.841+0000 7f3515400640 1 --2- 172.21.15.100:0/80301735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34fc004780 0x7f351815c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.841+0000 7f3515400640 1 -- 172.21.15.100:0/80301735 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35180ab050 con 0x7f351814baf0 2024-08-17T02:45:47.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.841+0000 7f3515400640 1 --2- 172.21.15.100:0/80301735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f351814baf0 0x7f35180aa720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3508007fd0 tx=0x7f3508003000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.841+0000 7f37b6000640 1 -- 172.21.15.100:0/3310143620 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b000f690 con 0x7f37c00ce6d0 2024-08-17T02:45:47.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.841+0000 7f37b6000640 1 -- 172.21.15.100:0/3310143620 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b000fa50 con 0x7f37c00ce6d0 2024-08-17T02:45:47.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.841+0000 7f2bb5800640 1 --2- 172.21.15.100:0/3088564028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bb0158c80 0x7f2bb00c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.841+0000 7f2bb6200640 1 -- 172.21.15.100:0/3088564028 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb014d750 con 0x7f2bb0158c80 2024-08-17T02:45:47.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.842+0000 7f2bb6200640 1 -- 172.21.15.100:0/3088564028 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb00c5da0 con 0x7f2bb00cd700 2024-08-17T02:45:47.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.842+0000 7f2bb6200640 1 -- 172.21.15.100:0/3088564028 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb00c5790 con 0x7f2bb00cc800 2024-08-17T02:45:47.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.841+0000 7f37bfe00640 1 -- 172.21.15.100:0/3310143620 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c0154b00 con 0x7f37c00ce6d0 2024-08-17T02:45:47.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.841+0000 7f37bfe00640 1 -- 172.21.15.100:0/3310143620 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c0150f20 con 0x7f37c00ce6d0 2024-08-17T02:45:47.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.841+0000 7f350d600640 1 -- 172.21.15.100:0/80301735 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350802ab10 con 0x7f351814baf0 2024-08-17T02:45:47.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.842+0000 7f350d600640 1 -- 172.21.15.100:0/80301735 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3508007030 con 0x7f351814baf0 2024-08-17T02:45:47.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.842+0000 7f350d600640 1 -- 172.21.15.100:0/80301735 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35080073f0 con 0x7f351814baf0 2024-08-17T02:45:47.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.842+0000 7f5a06a00640 1 --2- 172.21.15.100:0/566384654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a081401b0 0x7f5a080caf10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5a08068650 tx=0x7f59f8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38d63b900e68a539 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.842+0000 7f6408600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6400069ed0 0x7f640013cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7fa6d8200640 1 -- 172.21.15.100:0/3582081462 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa6ac000fd0 con 0x7fa6d0159430 2024-08-17T02:45:47.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.842+0000 7f2ba7e00640 1 -- 172.21.15.100:0/3088564028 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2bb00cc800 msgr2=0x7f2bb014d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f2ba7e00640 1 --2- 172.21.15.100:0/3088564028 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2bb00cc800 0x7f2bb014d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f37bfe00640 1 -- 172.21.15.100:0/3310143620 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f37c0071050 con 0x7f37c00ce6d0 2024-08-17T02:45:47.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f6408600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f640006e7f0 0x7f6400154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f6408600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f640013e130 0x7f6400153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f2ba7e00640 1 -- 172.21.15.100:0/3088564028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bb0158c80 msgr2=0x7f2bb00c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f2ba7e00640 1 --2- 172.21.15.100:0/3088564028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bb0158c80 0x7f2bb00c45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f5a05600640 1 -- 172.21.15.100:0/566384654 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f8007550 con 0x7f5a081401b0 2024-08-17T02:45:47.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f6405c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6400069ed0 0x7f640013cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f6406600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f640013e130 0x7f6400153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f6405c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6400069ed0 0x7f640013cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:52712/0 (socket says 172.21.15.100:52712) 2024-08-17T02:45:47.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f2ba7e00640 1 -- 172.21.15.100:0/3088564028 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b98009450 con 0x7f2bb00cd700 2024-08-17T02:45:47.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f2bb5800640 1 --2- 172.21.15.100:0/3088564028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bb0158c80 0x7f2bb00c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:47.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f2ba7e00640 1 --2- 172.21.15.100:0/3088564028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bb00cd700 0x7f2bb00b47a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2b98031000 tx=0x7f2b98032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f6406600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f640013e130 0x7f6400153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33016/0 (socket says 172.21.15.100:33016) 2024-08-17T02:45:47.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f5a05600640 1 -- 172.21.15.100:0/566384654 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f802d050 con 0x7f5a081401b0 2024-08-17T02:45:47.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f6406600640 1 -- 172.21.15.100:0/3546900809 learned_addr learned my addr 172.21.15.100:0/3546900809 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:47.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f6405200640 1 --2- 172.21.15.100:0/3546900809 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f640006e7f0 0x7f6400154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f6408600640 1 -- 172.21.15.100:0/3546900809 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640013d1c0 con 0x7f640013e130 2024-08-17T02:45:47.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f5a05600640 1 -- 172.21.15.100:0/566384654 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f8007550 con 0x7f5a081401b0 2024-08-17T02:45:47.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f6408600640 1 -- 172.21.15.100:0/3546900809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64000a54d0 con 0x7f6400069ed0 2024-08-17T02:45:47.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f6408600640 1 -- 172.21.15.100:0/3546900809 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64000a57b0 con 0x7f640006e7f0 2024-08-17T02:45:47.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.843+0000 7f2bacc00640 1 -- 172.21.15.100:0/3088564028 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b98000cc0 con 0x7f2bb00cd700 2024-08-17T02:45:47.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.844+0000 7f2bacc00640 1 -- 172.21.15.100:0/3088564028 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b98031a60 con 0x7f2bb00cd700 2024-08-17T02:45:47.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.844+0000 7f2bacc00640 1 -- 172.21.15.100:0/3088564028 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b98031e20 con 0x7f2bb00cd700 2024-08-17T02:45:47.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.844+0000 7f351d000640 1 -- 172.21.15.100:0/80301735 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35180ab330 con 0x7f351814baf0 2024-08-17T02:45:47.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.844+0000 7f351d000640 1 -- 172.21.15.100:0/80301735 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35180ab8f0 con 0x7f351814baf0 2024-08-17T02:45:47.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.844+0000 7f2bb6200640 1 -- 172.21.15.100:0/3088564028 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb00b2fd0 con 0x7f2bb00cd700 2024-08-17T02:45:47.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.844+0000 7f2bb6200640 1 -- 172.21.15.100:0/3088564028 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb00c5a30 con 0x7f2bb00cd700 2024-08-17T02:45:47.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.844+0000 7f6405c00640 1 -- 172.21.15.100:0/3546900809 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f640006e7f0 msgr2=0x7f6400154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.844+0000 7f6405c00640 1 --2- 172.21.15.100:0/3546900809 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f640006e7f0 0x7f6400154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.844+0000 7f6405c00640 1 -- 172.21.15.100:0/3546900809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f640013e130 msgr2=0x7f6400153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.844+0000 7f6405c00640 1 --2- 172.21.15.100:0/3546900809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f640013e130 0x7f6400153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.844+0000 7f6405c00640 1 -- 172.21.15.100:0/3546900809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f8009a20 con 0x7f6400069ed0 2024-08-17T02:45:47.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.845+0000 7f37b6000640 1 -- 172.21.15.100:0/3310143620 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f37b001a400 con 0x7f37c00ce6d0 2024-08-17T02:45:47.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.845+0000 7f5a0de00640 1 -- 172.21.15.100:0/566384654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a081401b0 msgr2=0x7f5a080caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.845+0000 7f5a0de00640 1 --2- 172.21.15.100:0/566384654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a081401b0 0x7f5a080caf10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5a08068650 tx=0x7f59f8009780 comp rx=0 tx=0).stop 2024-08-17T02:45:47.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.845+0000 7f2bb6200640 1 -- 172.21.15.100:0/3088564028 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2bb0071050 con 0x7f2bb00cd700 2024-08-17T02:45:47.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.845+0000 7fa6ccc00640 1 -- 172.21.15.100:0/3582081462 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa6bc0113f0 con 0x7fa6d0159430 2024-08-17T02:45:47.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.846+0000 7f5a0de00640 1 -- 172.21.15.100:0/566384654 shutdown_connections 2024-08-17T02:45:47.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.846+0000 7f5a0de00640 1 --2- 172.21.15.100:0/566384654 >> v2:172.21.15.100:3300/0 conn(0x7f5a080b1440 0x7f5a080c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.846+0000 7f5a0de00640 1 --2- 172.21.15.100:0/566384654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a081401b0 0x7f5a080caf10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.846+0000 7f5a0de00640 1 -- 172.21.15.100:0/566384654 >> 172.21.15.100:0/566384654 conn(0x7f5a080cb9b0 msgr2=0x7f5a080cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:47.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.845+0000 7f351d000640 1 -- 172.21.15.100:0/80301735 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3518071050 con 0x7f351814baf0 2024-08-17T02:45:47.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.846+0000 7f6405c00640 1 --2- 172.21.15.100:0/3546900809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6400069ed0 0x7f640013cbe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f63ec00c880 tx=0x7f63ec008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.846+0000 7f5a0de00640 1 -- 172.21.15.100:0/566384654 shutdown_connections 2024-08-17T02:45:47.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.846+0000 7f63fcc00640 1 -- 172.21.15.100:0/3546900809 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ec00ce10 con 0x7f6400069ed0 2024-08-17T02:45:47.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.846+0000 7f63fcc00640 1 -- 172.21.15.100:0/3546900809 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ec007830 con 0x7f6400069ed0 2024-08-17T02:45:47.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.846+0000 7f63fcc00640 1 -- 172.21.15.100:0/3546900809 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ec007bd0 con 0x7f6400069ed0 2024-08-17T02:45:47.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.846+0000 7f37b6000640 1 --2- 172.21.15.100:0/3310143620 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f37a00651d0 0x7f37a0067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.846+0000 7f37b6000640 1 -- 172.21.15.100:0/3310143620 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f37b0081d20 con 0x7f37c00ce6d0 2024-08-17T02:45:47.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.846+0000 7f37b6000640 1 --2- 172.21.15.100:0/3310143620 >> [v2:172.21.15.100:6824/37041,v1:172.21.15.100:6825/37041] conn(0x7f37a006d3e0 0x7f37a006f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.846+0000 7f37b6000640 1 -- 172.21.15.100:0/3310143620 --> [v2:172.21.15.100:6824/37041,v1:172.21.15.100:6825/37041] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f37a006fea0 con 0x7f37a006d3e0 2024-08-17T02:45:47.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.847+0000 7f37b6000640 1 -- 172.21.15.100:0/3310143620 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37b00842c0 con 0x7f37c00ce6d0 2024-08-17T02:45:47.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.847+0000 7fa6ccc00640 1 --2- 172.21.15.100:0/3582081462 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa6b00651d0 0x7fa6b0067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.846+0000 7f5a0de00640 1 -- 172.21.15.100:0/566384654 wait complete. 2024-08-17T02:45:47.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.847+0000 7fa6ccc00640 1 -- 172.21.15.100:0/3582081462 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa6bc082440 con 0x7fa6d0159430 2024-08-17T02:45:47.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.847+0000 7fa6ccc00640 1 --2- 172.21.15.100:0/3582081462 >> [v2:172.21.15.100:6808/37021,v1:172.21.15.100:6809/37021] conn(0x7fa6b006d3e0 0x7fa6b006f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.847+0000 7fa6ccc00640 1 -- 172.21.15.100:0/3582081462 --> [v2:172.21.15.100:6808/37021,v1:172.21.15.100:6809/37021] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6b006fea0 con 0x7fa6b006d3e0 2024-08-17T02:45:47.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.847+0000 7fa6ccc00640 1 -- 172.21.15.100:0/3582081462 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6bc084b30 con 0x7fa6d0159430 2024-08-17T02:45:47.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.848+0000 7fa6d4e00640 1 --2- 172.21.15.100:0/3582081462 >> [v2:172.21.15.100:6808/37021,v1:172.21.15.100:6809/37021] conn(0x7fa6b006d3e0 0x7fa6b006f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.848+0000 7fa6d5800640 1 --2- 172.21.15.100:0/3582081462 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa6b00651d0 0x7fa6b0067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.848+0000 7f37bea00640 1 --2- 172.21.15.100:0/3310143620 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f37a00651d0 0x7f37a0067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.848+0000 7f37be000640 1 --2- 172.21.15.100:0/3310143620 >> [v2:172.21.15.100:6824/37041,v1:172.21.15.100:6825/37041] conn(0x7f37a006d3e0 0x7f37a006f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.848+0000 7f5a0de00640 1 Processor -- start 2024-08-17T02:45:47.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.848+0000 7f5a0de00640 1 -- start start 2024-08-17T02:45:47.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.849+0000 7fa6d5800640 1 --2- 172.21.15.100:0/3582081462 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa6b00651d0 0x7fa6b0067680 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8001560 tx=0x7fa6c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.849+0000 7fa6d4e00640 1 --2- 172.21.15.100:0/3582081462 >> [v2:172.21.15.100:6808/37021,v1:172.21.15.100:6809/37021] conn(0x7fa6b006d3e0 0x7fa6b006f7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.849+0000 7f37bea00640 1 --2- 172.21.15.100:0/3310143620 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f37a00651d0 0x7f37a0067680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f37c016c0c0 tx=0x7f37ac007ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.847+0000 7f350d600640 1 -- 172.21.15.100:0/80301735 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3508007550 con 0x7f351814baf0 2024-08-17T02:45:47.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.849+0000 7f350d600640 1 --2- 172.21.15.100:0/80301735 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f34f8065220 0x7f34f80676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.846+0000 7f6408600640 1 -- 172.21.15.100:0/3546900809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f4009450 con 0x7f6400069ed0 2024-08-17T02:45:47.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.846+0000 7f6408600640 1 -- 172.21.15.100:0/3546900809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64000a5d70 con 0x7f6400069ed0 2024-08-17T02:45:47.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.849+0000 7f350d600640 1 -- 172.21.15.100:0/80301735 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3508074a60 con 0x7f351814baf0 2024-08-17T02:45:47.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.849+0000 7f3515e00640 1 --2- 172.21.15.100:0/80301735 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f34f8065220 0x7f34f80676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.850+0000 7f350d600640 1 --2- 172.21.15.100:0/80301735 >> [v2:172.21.15.123:6817/37279,v1:172.21.15.123:6820/37279] conn(0x7f34f806e110 0x7f34f80705a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.850+0000 7f350d600640 1 -- 172.21.15.100:0/80301735 --> [v2:172.21.15.123:6817/37279,v1:172.21.15.123:6820/37279] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f34f8070c70 con 0x7f34f806e110 2024-08-17T02:45:47.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.850+0000 7f350d600640 1 -- 172.21.15.100:0/80301735 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3508074130 con 0x7f351814baf0 2024-08-17T02:45:47.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.850+0000 7f5a0de00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5a080b1440 0x7f5a0816ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.850+0000 7f5a0de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a081401b0 0x7f5a08159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.850+0000 7f5a0de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a08140580 0x7f5a0816d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.850+0000 7f5a0de00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0816b070 con 0x7f5a08140580 2024-08-17T02:45:47.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.850+0000 7f5a0de00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0815b480 con 0x7f5a081401b0 2024-08-17T02:45:47.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.850+0000 7f5a0de00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0816e1b0 con 0x7f5a080b1440 2024-08-17T02:45:47.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.851+0000 7fa6ccc00640 1 -- 172.21.15.100:0/3582081462 <== osd.2 v2:172.21.15.100:6808/37021 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fa6b006fea0 con 0x7fa6b006d3e0 2024-08-17T02:45:47.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.850+0000 7f37be000640 1 --2- 172.21.15.100:0/3310143620 >> [v2:172.21.15.100:6824/37041,v1:172.21.15.100:6825/37041] conn(0x7f37a006d3e0 0x7f37a006f7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.848+0000 7f2bacc00640 1 -- 172.21.15.100:0/3088564028 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2b98039040 con 0x7f2bb00cd700 2024-08-17T02:45:47.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.850+0000 7f2bacc00640 1 --2- 172.21.15.100:0/3088564028 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f2b8c0652d0 0x7f2b8c067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.851+0000 7f2bacc00640 1 -- 172.21.15.100:0/3088564028 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2b980a2a30 con 0x7f2bb00cd700 2024-08-17T02:45:47.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.851+0000 7f2bacc00640 1 --2- 172.21.15.100:0/3088564028 >> [v2:172.21.15.123:6808/37278,v1:172.21.15.123:6809/37278] conn(0x7f2b8c06d4e0 0x7f2b8c06f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.851+0000 7f2bacc00640 1 -- 172.21.15.100:0/3088564028 --> [v2:172.21.15.123:6808/37278,v1:172.21.15.123:6809/37278] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b8c06ffa0 con 0x7f2b8c06d4e0 2024-08-17T02:45:47.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.851+0000 7f2bacc00640 1 -- 172.21.15.100:0/3088564028 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b980a2d60 con 0x7f2bb00cd700 2024-08-17T02:45:47.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.851+0000 7f2bb5800640 1 --2- 172.21.15.100:0/3088564028 >> [v2:172.21.15.123:6808/37278,v1:172.21.15.123:6809/37278] conn(0x7f2b8c06d4e0 0x7f2b8c06f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.850+0000 7f5a07400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a08140580 0x7f5a0816d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.850+0000 7f5a06000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a081401b0 0x7f5a08159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.851+0000 7f5a07400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a08140580 0x7f5a0816d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33032/0 (socket says 172.21.15.100:33032) 2024-08-17T02:45:47.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.851+0000 7f5a07400640 1 -- 172.21.15.100:0/893222622 learned_addr learned my addr 172.21.15.100:0/893222622 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:47.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.851+0000 7f5a07400640 1 -- 172.21.15.100:0/893222622 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5a080b1440 msgr2=0x7f5a0816ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.851+0000 7f5a07400640 1 --2- 172.21.15.100:0/893222622 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5a080b1440 0x7f5a0816ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.851+0000 7f5a07400640 1 -- 172.21.15.100:0/893222622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a081401b0 msgr2=0x7f5a08159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.851+0000 7f5a07400640 1 --2- 172.21.15.100:0/893222622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a081401b0 0x7f5a08159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.851+0000 7f5a07400640 1 -- 172.21.15.100:0/893222622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f8009a20 con 0x7f5a08140580 2024-08-17T02:45:47.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.852+0000 7f5a07400640 1 --2- 172.21.15.100:0/893222622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a08140580 0x7f5a0816d5d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000b510 tx=0x7f5a000090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.850+0000 7f3516800640 1 --2- 172.21.15.100:0/80301735 >> [v2:172.21.15.123:6817/37279,v1:172.21.15.123:6820/37279] conn(0x7f34f806e110 0x7f34f80705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.851+0000 7f3516800640 1 --2- 172.21.15.100:0/80301735 >> [v2:172.21.15.123:6817/37279,v1:172.21.15.123:6820/37279] conn(0x7f34f806e110 0x7f34f80705a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.852+0000 7f350d600640 1 -- 172.21.15.100:0/80301735 <== osd.4 v2:172.21.15.123:6817/37279 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f34f8070c70 con 0x7f34f806e110 2024-08-17T02:45:47.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.851+0000 7f63fcc00640 1 -- 172.21.15.100:0/3546900809 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f63ec0113f0 con 0x7f6400069ed0 2024-08-17T02:45:47.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.851+0000 7f6408600640 1 -- 172.21.15.100:0/3546900809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f63dc000fd0 con 0x7f6400069ed0 2024-08-17T02:45:47.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.852+0000 7f63fcc00640 1 --2- 172.21.15.100:0/3546900809 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f63e00652a0 0x7f63e0067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.852+0000 7f63fcc00640 1 -- 172.21.15.100:0/3546900809 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f63ec082360 con 0x7f6400069ed0 2024-08-17T02:45:47.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.852+0000 7f63fcc00640 1 --2- 172.21.15.100:0/3546900809 >> [v2:172.21.15.123:6800/37277,v1:172.21.15.123:6801/37277] conn(0x7f63e006d430 0x7f63e006f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.852+0000 7f63fcc00640 1 -- 172.21.15.100:0/3546900809 --> [v2:172.21.15.123:6800/37277,v1:172.21.15.123:6801/37277] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f63e006fef0 con 0x7f63e006d430 2024-08-17T02:45:47.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.852+0000 7f59fe000640 1 -- 172.21.15.100:0/893222622 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0000f510 con 0x7f5a08140580 2024-08-17T02:45:47.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.852+0000 7f5a0de00640 1 -- 172.21.15.100:0/893222622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0816e490 con 0x7f5a08140580 2024-08-17T02:45:47.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.853+0000 7f2bb4e00640 1 --2- 172.21.15.100:0/3088564028 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f2b8c0652d0 0x7f2b8c067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.853+0000 7f63fcc00640 1 -- 172.21.15.100:0/3546900809 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63ec0504b0 con 0x7f6400069ed0 2024-08-17T02:45:47.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.853+0000 7f37b6000640 1 -- 172.21.15.100:0/3310143620 <== osd.3 v2:172.21.15.100:6824/37041 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f37a006fea0 con 0x7f37a006d3e0 2024-08-17T02:45:47.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.852+0000 7f5a0de00640 1 -- 172.21.15.100:0/893222622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a08159480 con 0x7f5a08140580 2024-08-17T02:45:47.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.852+0000 7f59fe000640 1 -- 172.21.15.100:0/893222622 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0000f670 con 0x7f5a08140580 2024-08-17T02:45:47.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.852+0000 7f59fe000640 1 -- 172.21.15.100:0/893222622 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0000f510 con 0x7f5a08140580 2024-08-17T02:45:47.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.853+0000 7f6406600640 1 --2- 172.21.15.100:0/3546900809 >> [v2:172.21.15.123:6800/37277,v1:172.21.15.123:6801/37277] conn(0x7f63e006d430 0x7f63e006f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.853+0000 7f6405200640 1 --2- 172.21.15.100:0/3546900809 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f63e00652a0 0x7f63e0067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.854+0000 7f6406600640 1 --2- 172.21.15.100:0/3546900809 >> [v2:172.21.15.123:6800/37277,v1:172.21.15.123:6801/37277] conn(0x7f63e006d430 0x7f63e006f840 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.854+0000 7f2bb4e00640 1 --2- 172.21.15.100:0/3088564028 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f2b8c0652d0 0x7f2b8c067780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0009d70 tx=0x7f2ba0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.854+0000 7f5a0de00640 1 -- 172.21.15.100:0/893222622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f59e0000fd0 con 0x7f5a08140580 2024-08-17T02:45:47.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.854+0000 7f3515e00640 1 --2- 172.21.15.100:0/80301735 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f34f8065220 0x7f34f80676d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f35040015a0 tx=0x7f3504009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.855+0000 7f63fcc00640 1 -- 172.21.15.100:0/3546900809 <== osd.5 v2:172.21.15.123:6800/37277 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f63e006fef0 con 0x7f63e006d430 2024-08-17T02:45:47.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.855+0000 7f6405200640 1 --2- 172.21.15.100:0/3546900809 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f63e00652a0 0x7f63e0067750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f63f4034000 tx=0x7f63f4032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.856+0000 7f2bb5800640 1 --2- 172.21.15.100:0/3088564028 >> [v2:172.21.15.123:6808/37278,v1:172.21.15.123:6809/37278] conn(0x7f2b8c06d4e0 0x7f2b8c06f8f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.857+0000 7f2bacc00640 1 -- 172.21.15.100:0/3088564028 <== osd.6 v2:172.21.15.123:6808/37278 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f2b8c06ffa0 con 0x7f2b8c06d4e0 2024-08-17T02:45:47.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.857+0000 7f59fe000640 1 -- 172.21.15.100:0/893222622 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5a0000fa70 con 0x7f5a08140580 2024-08-17T02:45:47.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.858+0000 7f59fe000640 1 --2- 172.21.15.100:0/893222622 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f59e8065230 0x7f59e80676e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.859+0000 7f59fe000640 1 -- 172.21.15.100:0/893222622 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5a00081b90 con 0x7f5a08140580 2024-08-17T02:45:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.859+0000 7f59fe000640 1 --2- 172.21.15.100:0/893222622 >> [v2:172.21.15.123:6816/37289,v1:172.21.15.123:6818/37289] conn(0x7f59e806d3c0 0x7f59e806f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.859+0000 7f59fe000640 1 -- 172.21.15.100:0/893222622 --> [v2:172.21.15.123:6816/37289,v1:172.21.15.123:6818/37289] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59e806fe80 con 0x7f59e806d3c0 2024-08-17T02:45:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.859+0000 7f59fe000640 1 -- 172.21.15.100:0/893222622 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a0004fc30 con 0x7f5a08140580 2024-08-17T02:45:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.859+0000 7f5a06a00640 1 --2- 172.21.15.100:0/893222622 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f59e8065230 0x7f59e80676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.861+0000 7f5a06a00640 1 --2- 172.21.15.100:0/893222622 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f59e8065230 0x7f59e80676e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f59f8034000 tx=0x7f59f8037000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.861+0000 7f5a06000640 1 --2- 172.21.15.100:0/893222622 >> [v2:172.21.15.123:6816/37289,v1:172.21.15.123:6818/37289] conn(0x7f59e806d3c0 0x7f59e806f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.862+0000 7f5a06000640 1 --2- 172.21.15.100:0/893222622 >> [v2:172.21.15.123:6816/37289,v1:172.21.15.123:6818/37289] conn(0x7f59e806d3c0 0x7f59e806f7d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:47.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.863+0000 7f59fe000640 1 -- 172.21.15.100:0/893222622 <== osd.7 v2:172.21.15.123:6816/37289 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f59e806fe80 con 0x7f59e806d3c0 2024-08-17T02:45:47.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.866+0000 7f1a63000640 1 -- 172.21.15.100:0/4013215087 --> [v2:172.21.15.100:6816/37022,v1:172.21.15.100:6817/37022] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1a38002ca0 con 0x7f1a3c06d4b0 2024-08-17T02:45:47.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.867+0000 7f1a58c00640 1 -- 172.21.15.100:0/4013215087 <== osd.1 v2:172.21.15.100:6816/37022 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1a38002ca0 con 0x7f1a3c06d4b0 2024-08-17T02:45:47.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.867+0000 7f1a63000640 1 -- 172.21.15.100:0/4013215087 >> [v2:172.21.15.100:6816/37022,v1:172.21.15.100:6817/37022] conn(0x7f1a3c06d4b0 msgr2=0x7f1a3c06f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.867+0000 7f1a63000640 1 --2- 172.21.15.100:0/4013215087 >> [v2:172.21.15.100:6816/37022,v1:172.21.15.100:6817/37022] conn(0x7f1a3c06d4b0 0x7f1a3c06f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.868+0000 7f1a63000640 1 -- 172.21.15.100:0/4013215087 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1a3c0652a0 msgr2=0x7f1a3c067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.868+0000 7f1a63000640 1 --2- 172.21.15.100:0/4013215087 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1a3c0652a0 0x7f1a3c067750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c02ae30 tx=0x7f1a5c069040 comp rx=0 tx=0).stop 2024-08-17T02:45:47.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.868+0000 7f1a63000640 1 -- 172.21.15.100:0/4013215087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a54033a80 msgr2=0x7f1a540e4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.868+0000 7f1a63000640 1 --2- 172.21.15.100:0/4013215087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a54033a80 0x7f1a540e4320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800e900 tx=0x7f1a480090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.868+0000 7f1a62600640 1 -- 172.21.15.100:0/4013215087 reap_dead start 2024-08-17T02:45:47.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.868+0000 7f1a63000640 1 -- 172.21.15.100:0/4013215087 shutdown_connections 2024-08-17T02:45:47.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.868+0000 7f1a63000640 1 -- 172.21.15.100:0/4013215087 >> 172.21.15.100:0/4013215087 conn(0x7f1a54051600 msgr2=0x7f1a5404a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:47.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.869+0000 7f1a63000640 1 -- 172.21.15.100:0/4013215087 shutdown_connections 2024-08-17T02:45:47.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.869+0000 7f1a63000640 1 -- 172.21.15.100:0/4013215087 wait complete. 2024-08-17T02:45:47.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.872+0000 7fb9e1a00640 1 -- 172.21.15.100:0/3523120474 --> [v2:172.21.15.100:6800/37019,v1:172.21.15.100:6801/37019] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb9dc0cc610 con 0x7fb9bc06d430 2024-08-17T02:45:47.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.873+0000 7fb9d2000640 1 -- 172.21.15.100:0/3523120474 <== osd.0 v2:172.21.15.100:6800/37019 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb9dc0cc610 con 0x7fb9bc06d430 2024-08-17T02:45:47.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.873+0000 7fb9e1a00640 1 -- 172.21.15.100:0/3523120474 >> [v2:172.21.15.100:6800/37019,v1:172.21.15.100:6801/37019] conn(0x7fb9bc06d430 msgr2=0x7fb9bc06f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.873+0000 7fb9e1a00640 1 --2- 172.21.15.100:0/3523120474 >> [v2:172.21.15.100:6800/37019,v1:172.21.15.100:6801/37019] conn(0x7fb9bc06d430 0x7fb9bc06f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.874+0000 7fb9e1a00640 1 -- 172.21.15.100:0/3523120474 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb9bc0652a0 msgr2=0x7fb9bc067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.874+0000 7fb9e1a00640 1 --2- 172.21.15.100:0/3523120474 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb9bc0652a0 0x7fb9bc067750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8005840 tx=0x7fb9c8007940 comp rx=0 tx=0).stop 2024-08-17T02:45:47.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.874+0000 7fb9e1a00640 1 -- 172.21.15.100:0/3523120474 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9dc06dc80 msgr2=0x7fb9dc149c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.874+0000 7fb9e1a00640 1 --2- 172.21.15.100:0/3523120474 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9dc06dc80 0x7fb9dc149c80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00c590 tx=0x7fb9cc007d80 comp rx=0 tx=0).stop 2024-08-17T02:45:47.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.875+0000 7fb9db400640 1 -- 172.21.15.100:0/3523120474 reap_dead start 2024-08-17T02:45:47.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.875+0000 7fb9e1a00640 1 -- 172.21.15.100:0/3523120474 shutdown_connections 2024-08-17T02:45:47.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.875+0000 7fb9e1a00640 1 -- 172.21.15.100:0/3523120474 >> 172.21.15.100:0/3523120474 conn(0x7fb9dc0cb7f0 msgr2=0x7fb9dc0ca690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:47.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.875+0000 7fb9e1a00640 1 -- 172.21.15.100:0/3523120474 shutdown_connections 2024-08-17T02:45:47.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.876+0000 7fb9e1a00640 1 -- 172.21.15.100:0/3523120474 wait complete. 2024-08-17T02:45:47.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.881+0000 7fa6d8200640 1 -- 172.21.15.100:0/3582081462 --> [v2:172.21.15.100:6808/37021,v1:172.21.15.100:6809/37021] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa6ac002ca0 con 0x7fa6b006d3e0 2024-08-17T02:45:47.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.882+0000 7fa6ccc00640 1 -- 172.21.15.100:0/3582081462 <== osd.2 v2:172.21.15.100:6808/37021 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa6ac002ca0 con 0x7fa6b006d3e0 2024-08-17T02:45:47.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.882+0000 7f351d000640 1 -- 172.21.15.100:0/80301735 --> [v2:172.21.15.123:6817/37279,v1:172.21.15.123:6820/37279] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f351806a620 con 0x7f34f806e110 2024-08-17T02:45:47.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.883+0000 7f350d600640 1 -- 172.21.15.100:0/80301735 <== osd.4 v2:172.21.15.123:6817/37279 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f351806a620 con 0x7f34f806e110 2024-08-17T02:45:47.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.883+0000 7fa6d8200640 1 -- 172.21.15.100:0/3582081462 >> [v2:172.21.15.100:6808/37021,v1:172.21.15.100:6809/37021] conn(0x7fa6b006d3e0 msgr2=0x7fa6b006f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.884+0000 7fa6d8200640 1 --2- 172.21.15.100:0/3582081462 >> [v2:172.21.15.100:6808/37021,v1:172.21.15.100:6809/37021] conn(0x7fa6b006d3e0 0x7fa6b006f7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.884+0000 7fa6d8200640 1 -- 172.21.15.100:0/3582081462 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa6b00651d0 msgr2=0x7fa6b0067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.884+0000 7fa6d8200640 1 --2- 172.21.15.100:0/3582081462 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa6b00651d0 0x7fa6b0067680 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8001560 tx=0x7fa6c8009040 comp rx=0 tx=0).stop 2024-08-17T02:45:47.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.884+0000 7fa6d8200640 1 -- 172.21.15.100:0/3582081462 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa6d0159430 msgr2=0x7fa6d0154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.884+0000 7fa6d8200640 1 --2- 172.21.15.100:0/3582081462 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa6d0159430 0x7fa6d0154ab0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc00c850 tx=0x7fa6bc008040 comp rx=0 tx=0).stop 2024-08-17T02:45:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.884+0000 7fa6d6200640 1 -- 172.21.15.100:0/3582081462 reap_dead start 2024-08-17T02:45:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.884+0000 7f351d000640 1 -- 172.21.15.100:0/80301735 >> [v2:172.21.15.123:6817/37279,v1:172.21.15.123:6820/37279] conn(0x7f34f806e110 msgr2=0x7f34f80705a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.884+0000 7f351d000640 1 --2- 172.21.15.100:0/80301735 >> [v2:172.21.15.123:6817/37279,v1:172.21.15.123:6820/37279] conn(0x7f34f806e110 0x7f34f80705a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.884+0000 7f351d000640 1 -- 172.21.15.100:0/80301735 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f34f8065220 msgr2=0x7f34f80676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.884+0000 7f351d000640 1 --2- 172.21.15.100:0/80301735 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f34f8065220 0x7f34f80676d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f35040015a0 tx=0x7f3504009040 comp rx=0 tx=0).stop 2024-08-17T02:45:47.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.884+0000 7fa6d8200640 1 -- 172.21.15.100:0/3582081462 shutdown_connections 2024-08-17T02:45:47.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.884+0000 7fa6d8200640 1 -- 172.21.15.100:0/3582081462 >> 172.21.15.100:0/3582081462 conn(0x7fa6d00cfde0 msgr2=0x7fa6d015f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:47.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.885+0000 7fa6d8200640 1 -- 172.21.15.100:0/3582081462 shutdown_connections 2024-08-17T02:45:47.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.886+0000 7fa6d8200640 1 -- 172.21.15.100:0/3582081462 wait complete. 2024-08-17T02:45:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.884+0000 7f351d000640 1 -- 172.21.15.100:0/80301735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f351814baf0 msgr2=0x7f35180aa720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.884+0000 7f351d000640 1 --2- 172.21.15.100:0/80301735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f351814baf0 0x7f35180aa720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3508007fd0 tx=0x7f3508003000 comp rx=0 tx=0).stop 2024-08-17T02:45:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.885+0000 7f3516800640 1 -- 172.21.15.100:0/80301735 reap_dead start 2024-08-17T02:45:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.886+0000 7f351d000640 1 -- 172.21.15.100:0/80301735 shutdown_connections 2024-08-17T02:45:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.886+0000 7f351d000640 1 -- 172.21.15.100:0/80301735 >> 172.21.15.100:0/80301735 conn(0x7f35180cb7f0 msgr2=0x7f351806d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:47.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.886+0000 7f6408600640 1 -- 172.21.15.100:0/3546900809 --> [v2:172.21.15.123:6800/37277,v1:172.21.15.123:6801/37277] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f63dc002ca0 con 0x7f63e006d430 2024-08-17T02:45:47.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.886+0000 7f351d000640 1 -- 172.21.15.100:0/80301735 shutdown_connections 2024-08-17T02:45:47.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.886+0000 7f351d000640 1 -- 172.21.15.100:0/80301735 wait complete. 2024-08-17T02:45:47.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.887+0000 7f2bb6200640 1 -- 172.21.15.100:0/3088564028 --> [v2:172.21.15.123:6808/37278,v1:172.21.15.123:6809/37278] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2bb00cbaf0 con 0x7f2b8c06d4e0 2024-08-17T02:45:47.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.887+0000 7f63fcc00640 1 -- 172.21.15.100:0/3546900809 <== osd.5 v2:172.21.15.123:6800/37277 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f63dc002ca0 con 0x7f63e006d430 2024-08-17T02:45:47.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.888+0000 7f6408600640 1 -- 172.21.15.100:0/3546900809 >> [v2:172.21.15.123:6800/37277,v1:172.21.15.123:6801/37277] conn(0x7f63e006d430 msgr2=0x7f63e006f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.888+0000 7f6408600640 1 --2- 172.21.15.100:0/3546900809 >> [v2:172.21.15.123:6800/37277,v1:172.21.15.123:6801/37277] conn(0x7f63e006d430 0x7f63e006f840 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.888+0000 7f6408600640 1 -- 172.21.15.100:0/3546900809 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f63e00652a0 msgr2=0x7f63e0067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.888+0000 7f6408600640 1 --2- 172.21.15.100:0/3546900809 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f63e00652a0 0x7f63e0067750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f63f4034000 tx=0x7f63f4032000 comp rx=0 tx=0).stop 2024-08-17T02:45:47.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.888+0000 7f6408600640 1 -- 172.21.15.100:0/3546900809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6400069ed0 msgr2=0x7f640013cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.888+0000 7f6408600640 1 --2- 172.21.15.100:0/3546900809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6400069ed0 0x7f640013cbe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f63ec00c880 tx=0x7f63ec008040 comp rx=0 tx=0).stop 2024-08-17T02:45:47.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.889+0000 7f6406600640 1 -- 172.21.15.100:0/3546900809 reap_dead start 2024-08-17T02:45:47.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.889+0000 7f6408600640 1 -- 172.21.15.100:0/3546900809 shutdown_connections 2024-08-17T02:45:47.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.889+0000 7f6408600640 1 -- 172.21.15.100:0/3546900809 >> 172.21.15.100:0/3546900809 conn(0x7f64000cc480 msgr2=0x7f640006da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:47.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.889+0000 7f2bacc00640 1 -- 172.21.15.100:0/3088564028 <== osd.6 v2:172.21.15.123:6808/37278 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2bb00cbaf0 con 0x7f2b8c06d4e0 2024-08-17T02:45:47.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.889+0000 7f37bfe00640 1 -- 172.21.15.100:0/3310143620 --> [v2:172.21.15.100:6824/37041,v1:172.21.15.100:6825/37041] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f37c0156550 con 0x7f37a006d3e0 2024-08-17T02:45:47.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.891+0000 7f37b6000640 1 -- 172.21.15.100:0/3310143620 <== osd.3 v2:172.21.15.100:6824/37041 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f37c0156550 con 0x7f37a006d3e0 2024-08-17T02:45:47.941 INFO:teuthology.orchestra.run.smithi100.stdout:60129542148 2024-08-17T02:45:47.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.892+0000 7f37bfe00640 1 -- 172.21.15.100:0/3310143620 >> [v2:172.21.15.100:6824/37041,v1:172.21.15.100:6825/37041] conn(0x7f37a006d3e0 msgr2=0x7f37a006f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.892+0000 7f37bfe00640 1 --2- 172.21.15.100:0/3310143620 >> [v2:172.21.15.100:6824/37041,v1:172.21.15.100:6825/37041] conn(0x7f37a006d3e0 0x7f37a006f7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.892+0000 7f6408600640 1 -- 172.21.15.100:0/3546900809 shutdown_connections 2024-08-17T02:45:47.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.892+0000 7f6408600640 1 -- 172.21.15.100:0/3546900809 wait complete. 2024-08-17T02:45:47.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.891+0000 7f2bb6200640 1 -- 172.21.15.100:0/3088564028 >> [v2:172.21.15.123:6808/37278,v1:172.21.15.123:6809/37278] conn(0x7f2b8c06d4e0 msgr2=0x7f2b8c06f8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.891+0000 7f2bb6200640 1 --2- 172.21.15.100:0/3088564028 >> [v2:172.21.15.123:6808/37278,v1:172.21.15.123:6809/37278] conn(0x7f2b8c06d4e0 0x7f2b8c06f8f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.943 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:45:47.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.892+0000 7f2bb6200640 1 -- 172.21.15.100:0/3088564028 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f2b8c0652d0 msgr2=0x7f2b8c067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.892+0000 7f2bb6200640 1 --2- 172.21.15.100:0/3088564028 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f2b8c0652d0 0x7f2b8c067780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0009d70 tx=0x7f2ba0008040 comp rx=0 tx=0).stop 2024-08-17T02:45:47.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.892+0000 7f2bb6200640 1 -- 172.21.15.100:0/3088564028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bb00cd700 msgr2=0x7f2bb00b47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.892+0000 7f2bb6200640 1 --2- 172.21.15.100:0/3088564028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bb00cd700 0x7f2bb00b47a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2b98031000 tx=0x7f2b98032000 comp rx=0 tx=0).stop 2024-08-17T02:45:47.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.892+0000 7f37bfe00640 1 -- 172.21.15.100:0/3310143620 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f37a00651d0 msgr2=0x7f37a0067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.892+0000 7f37bfe00640 1 --2- 172.21.15.100:0/3310143620 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f37a00651d0 0x7f37a0067680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f37c016c0c0 tx=0x7f37ac007ac0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.893+0000 7f37bfe00640 1 -- 172.21.15.100:0/3310143620 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f37c00ce6d0 msgr2=0x7f37c00c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.893+0000 7f37bfe00640 1 --2- 172.21.15.100:0/3310143620 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f37c00ce6d0 0x7f37c00c5c00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f37b000b4c0 tx=0x7f37b0006f50 comp rx=0 tx=0).stop 2024-08-17T02:45:47.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.893+0000 7f2bb5800640 1 -- 172.21.15.100:0/3088564028 reap_dead start 2024-08-17T02:45:47.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.893+0000 7f2bb6200640 1 -- 172.21.15.100:0/3088564028 shutdown_connections 2024-08-17T02:45:47.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.893+0000 7f2bb6200640 1 -- 172.21.15.100:0/3088564028 >> 172.21.15.100:0/3088564028 conn(0x7f2bb0098e30 msgr2=0x7f2bb00ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:47.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.893+0000 7f37bf400640 1 -- 172.21.15.100:0/3310143620 reap_dead start 2024-08-17T02:45:47.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.893+0000 7f37bfe00640 1 -- 172.21.15.100:0/3310143620 shutdown_connections 2024-08-17T02:45:47.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.893+0000 7f37bfe00640 1 -- 172.21.15.100:0/3310143620 >> 172.21.15.100:0/3310143620 conn(0x7f37c0098e30 msgr2=0x7f37c00acd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:47.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.893+0000 7f2bb6200640 1 -- 172.21.15.100:0/3088564028 shutdown_connections 2024-08-17T02:45:47.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.893+0000 7f37bfe00640 1 -- 172.21.15.100:0/3310143620 shutdown_connections 2024-08-17T02:45:47.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.893+0000 7f2bb6200640 1 -- 172.21.15.100:0/3088564028 wait complete. 2024-08-17T02:45:47.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.893+0000 7f37bfe00640 1 -- 172.21.15.100:0/3310143620 wait complete. 2024-08-17T02:45:47.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.897+0000 7f5a0de00640 1 -- 172.21.15.100:0/893222622 --> [v2:172.21.15.123:6816/37289,v1:172.21.15.123:6818/37289] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f59e0002ca0 con 0x7f59e806d3c0 2024-08-17T02:45:47.948 INFO:teuthology.orchestra.run.smithi100.stdout:60129542149 2024-08-17T02:45:47.949 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:45:47.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.901+0000 7f59fe000640 1 -- 172.21.15.100:0/893222622 <== osd.7 v2:172.21.15.123:6816/37289 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f59e0002ca0 con 0x7f59e806d3c0 2024-08-17T02:45:47.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.902+0000 7f5a0de00640 1 -- 172.21.15.100:0/893222622 >> [v2:172.21.15.123:6816/37289,v1:172.21.15.123:6818/37289] conn(0x7f59e806d3c0 msgr2=0x7f59e806f7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.902+0000 7f5a0de00640 1 --2- 172.21.15.100:0/893222622 >> [v2:172.21.15.123:6816/37289,v1:172.21.15.123:6818/37289] conn(0x7f59e806d3c0 0x7f59e806f7d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.902+0000 7f5a0de00640 1 -- 172.21.15.100:0/893222622 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f59e8065230 msgr2=0x7f59e80676e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.902+0000 7f5a0de00640 1 --2- 172.21.15.100:0/893222622 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f59e8065230 0x7f59e80676e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f59f8034000 tx=0x7f59f8037000 comp rx=0 tx=0).stop 2024-08-17T02:45:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.902+0000 7f5a0de00640 1 -- 172.21.15.100:0/893222622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a08140580 msgr2=0x7f5a0816d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.902+0000 7f5a0de00640 1 --2- 172.21.15.100:0/893222622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a08140580 0x7f5a0816d5d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000b510 tx=0x7f5a000090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.902+0000 7f5a07400640 1 -- 172.21.15.100:0/893222622 reap_dead start 2024-08-17T02:45:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.903+0000 7f5a0de00640 1 -- 172.21.15.100:0/893222622 shutdown_connections 2024-08-17T02:45:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.903+0000 7f5a0de00640 1 -- 172.21.15.100:0/893222622 >> 172.21.15.100:0/893222622 conn(0x7f5a080cb9b0 msgr2=0x7f5a080ac220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.903+0000 7f5a0de00640 1 -- 172.21.15.100:0/893222622 shutdown_connections 2024-08-17T02:45:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:47.903+0000 7f5a0de00640 1 -- 172.21.15.100:0/893222622 wait complete. 2024-08-17T02:45:47.952 INFO:teuthology.orchestra.run.smithi100.stdout:60129542148 2024-08-17T02:45:47.952 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:45:47.953 INFO:teuthology.orchestra.run.smithi100.stdout:60129542149 2024-08-17T02:45:47.953 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:45:47.954 INFO:teuthology.orchestra.run.smithi100.stdout:60129542149 2024-08-17T02:45:47.954 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:45:47.955 INFO:teuthology.orchestra.run.smithi100.stdout:60129542149 2024-08-17T02:45:47.956 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:45:47.956 INFO:teuthology.orchestra.run.smithi100.stdout:60129542148 2024-08-17T02:45:47.957 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:45:47.957 INFO:teuthology.orchestra.run.smithi100.stdout:60129542148 2024-08-17T02:45:47.958 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:45:48.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.246+0000 7f84a4a00640 1 Processor -- start 2024-08-17T02:45:48.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.248+0000 7fb3c5400640 1 Processor -- start 2024-08-17T02:45:48.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.248+0000 7fb3c5400640 1 -- start start 2024-08-17T02:45:48.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.246+0000 7f84a4a00640 1 -- start start 2024-08-17T02:45:48.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.248+0000 7f84a4a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f84980e1bd0 0x7f84980e1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.248+0000 7f84a4a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84980e24e0 con 0x7f8498006150 2024-08-17T02:45:48.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.248+0000 7f84a4a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8498006c10 con 0x7f84980e6340 2024-08-17T02:45:48.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.248+0000 7f84a4a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8498006ef0 con 0x7f84980e1bd0 2024-08-17T02:45:48.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.250+0000 7fb3c5400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb3c00ca160 0x7fb3c00ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.250+0000 7fb3c5400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb3c00acc70 0x7fb3c00ad070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.250+0000 7fb3c5400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c00ce7a0 con 0x7fb3c0158fb0 2024-08-17T02:45:48.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.250+0000 7fb3c5400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c0159380 con 0x7fb3c00ca160 2024-08-17T02:45:48.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.250+0000 7fb3c5400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c00cab20 con 0x7fb3c00acc70 2024-08-17T02:45:48.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.250+0000 7f849f400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f84980e1bd0 0x7f84980e1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.250+0000 7f849f400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f84980e1bd0 0x7f84980e1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:52726/0 (socket says 172.21.15.100:52726) 2024-08-17T02:45:48.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.250+0000 7f849f400640 1 -- 172.21.15.100:0/1089243858 learned_addr learned my addr 172.21.15.100:0/1089243858 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:48.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.250+0000 7fb3be800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb3c0158fb0 0x7fb3c00d02d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37440/0 (socket says 172.21.15.100:37440) 2024-08-17T02:45:48.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.250+0000 7fb3be800640 1 -- 172.21.15.100:0/3784035208 learned_addr learned my addr 172.21.15.100:0/3784035208 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:48.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.251+0000 7f849f400640 1 -- 172.21.15.100:0/1089243858 >> v1:172.21.15.123:6789/0 conn(0x7f84980e6340 legacy=0x7f84980378a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:48.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.251+0000 7fb3bde00640 1 --2- 172.21.15.100:0/3784035208 >> v2:172.21.15.100:3300/0 conn(0x7fb3c00ca160 0x7fb3c00ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.251+0000 7fb3bf200640 1 --2- 172.21.15.100:0/3784035208 >> v2:172.21.15.123:3300/0 conn(0x7fb3c00acc70 0x7fb3c00ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.250+0000 7f849ea00640 1 --1- 172.21.15.100:0/1089243858 >> v1:172.21.15.100:6789/0 conn(0x7f8498006150 0x7f84980e5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37434/0 (socket says 172.21.15.100:37434) 2024-08-17T02:45:48.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.252+0000 7f849f400640 1 -- 172.21.15.100:0/1089243858 >> v1:172.21.15.100:6789/0 conn(0x7f8498006150 legacy=0x7f84980e5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:48.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.252+0000 7fb3bde00640 1 -- 172.21.15.100:0/3784035208 >> v2:172.21.15.123:3300/0 conn(0x7fb3c00acc70 msgr2=0x7fb3c00ad070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:48.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.252+0000 7fb3bde00640 1 --2- 172.21.15.100:0/3784035208 >> v2:172.21.15.123:3300/0 conn(0x7fb3c00acc70 0x7fb3c00ad070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.252+0000 7fb3bde00640 1 -- 172.21.15.100:0/3784035208 >> v1:172.21.15.100:6789/0 conn(0x7fb3c0158fb0 legacy=0x7fb3c00d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.252+0000 7fb3bde00640 1 -- 172.21.15.100:0/3784035208 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c00cea80 con 0x7fb3c00ca160 2024-08-17T02:45:48.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.252+0000 7fb3bf200640 1 --2- 172.21.15.100:0/3784035208 >> v2:172.21.15.123:3300/0 conn(0x7fb3c00acc70 0x7fb3c00ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:48.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.253+0000 7f849f400640 1 -- 172.21.15.100:0/1089243858 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84980071d0 con 0x7f84980e1bd0 2024-08-17T02:45:48.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.254+0000 7fb3bde00640 1 --2- 172.21.15.100:0/3784035208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c00ca160 0x7fb3c00ca5e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb3c009d890 tx=0x7fb3b00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9a2430b114fd1c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.255+0000 7fb3bd400640 1 -- 172.21.15.100:0/3784035208 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b002ac20 con 0x7fb3c00ca160 2024-08-17T02:45:48.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.255+0000 7fb3bd400640 1 -- 172.21.15.100:0/3784035208 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b002ad80 con 0x7fb3c00ca160 2024-08-17T02:45:48.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.255+0000 7fb3bd400640 1 -- 172.21.15.100:0/3784035208 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0032670 con 0x7fb3c00ca160 2024-08-17T02:45:48.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.256+0000 7f849f400640 1 --2- 172.21.15.100:0/1089243858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84980e1bd0 0x7f84980e1fa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8494009910 tx=0x7f84940091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48d01e658bb80b20 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.256+0000 7f849e000640 1 -- 172.21.15.100:0/1089243858 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8494032440 con 0x7f84980e1bd0 2024-08-17T02:45:48.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.256+0000 7f849e000640 1 -- 172.21.15.100:0/1089243858 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84940325a0 con 0x7f84980e1bd0 2024-08-17T02:45:48.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.256+0000 7f849e000640 1 -- 172.21.15.100:0/1089243858 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8494032980 con 0x7f84980e1bd0 2024-08-17T02:45:48.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.257+0000 7fb3c5400640 1 -- 172.21.15.100:0/3784035208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c00ca160 msgr2=0x7fb3c00ca5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.257+0000 7fb3c5400640 1 --2- 172.21.15.100:0/3784035208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c00ca160 0x7fb3c00ca5e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb3c009d890 tx=0x7fb3b00090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.257+0000 7fb3c5400640 1 -- 172.21.15.100:0/3784035208 shutdown_connections 2024-08-17T02:45:48.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.257+0000 7fb3c5400640 1 --2- 172.21.15.100:0/3784035208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c00ca160 0x7fb3c00ca5e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.258+0000 7f6730800640 1 Processor -- start 2024-08-17T02:45:48.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.258+0000 7f5480800640 1 Processor -- start 2024-08-17T02:45:48.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.258+0000 7f84a4a00640 1 -- 172.21.15.100:0/1089243858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84980e1bd0 msgr2=0x7f84980e1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.258+0000 7f84a4a00640 1 --2- 172.21.15.100:0/1089243858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84980e1bd0 0x7f84980e1fa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8494009910 tx=0x7f84940091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.258+0000 7f5480800640 1 -- start start 2024-08-17T02:45:48.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.259+0000 7f84a4a00640 1 -- 172.21.15.100:0/1089243858 shutdown_connections 2024-08-17T02:45:48.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.259+0000 7f84a4a00640 1 --2- 172.21.15.100:0/1089243858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84980e1bd0 0x7f84980e1fa0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.259+0000 7f84a4a00640 1 -- 172.21.15.100:0/1089243858 >> 172.21.15.100:0/1089243858 conn(0x7f849800f070 msgr2=0x7f8498058f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:48.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.259+0000 7f84a4a00640 1 -- 172.21.15.100:0/1089243858 shutdown_connections 2024-08-17T02:45:48.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.259+0000 7f84a4a00640 1 -- 172.21.15.100:0/1089243858 wait complete. 2024-08-17T02:45:48.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.257+0000 7fb3c5400640 1 --2- 172.21.15.100:0/3784035208 >> v2:172.21.15.123:3300/0 conn(0x7fb3c00acc70 0x7fb3c00ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.258+0000 7fb3c5400640 1 -- 172.21.15.100:0/3784035208 >> 172.21.15.100:0/3784035208 conn(0x7fb3c006eb90 msgr2=0x7fb3c00cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:48.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.260+0000 7fb3c5400640 1 -- 172.21.15.100:0/3784035208 shutdown_connections 2024-08-17T02:45:48.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.258+0000 7f6730800640 1 -- start start 2024-08-17T02:45:48.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.260+0000 7f6730800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f67280ada10 0x7f67280b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.260+0000 7f6730800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f67280b38b0 0x7f67280aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.260+0000 7f6730800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67280d0ab0 con 0x7f67280b1120 2024-08-17T02:45:48.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.261+0000 7f5480800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f547815d830 0x7f547806e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.260+0000 7f6730800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67280b00c0 con 0x7f67280ada10 2024-08-17T02:45:48.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.260+0000 7f6730800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67280af330 con 0x7f67280b38b0 2024-08-17T02:45:48.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.260+0000 7f672de00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f67280ada10 0x7f67280b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.261+0000 7f672de00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f67280ada10 0x7f67280b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33058/0 (socket says 172.21.15.100:33058) 2024-08-17T02:45:48.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.261+0000 7f672de00640 1 -- 172.21.15.100:0/881233435 learned_addr learned my addr 172.21.15.100:0/881233435 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:48.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.261+0000 7f5480800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54780b0610 0x7f547815dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.261+0000 7f5480800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54780b1690 con 0x7f547815e140 2024-08-17T02:45:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.261+0000 7f5480800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54780b1b20 con 0x7f547815d830 2024-08-17T02:45:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.261+0000 7f5480800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54780ae4a0 con 0x7f54780b0610 2024-08-17T02:45:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.261+0000 7f672de00640 1 -- 172.21.15.100:0/881233435 >> v2:172.21.15.123:3300/0 conn(0x7f67280b38b0 msgr2=0x7f67280aedf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:45:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.261+0000 7f672de00640 1 --2- 172.21.15.100:0/881233435 >> v2:172.21.15.123:3300/0 conn(0x7f67280b38b0 0x7f67280aedf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.261+0000 7f672de00640 1 -- 172.21.15.100:0/881233435 >> v1:172.21.15.100:6789/0 conn(0x7f67280b1120 legacy=0x7f67280b31a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:45:48.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.261+0000 7f547de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f547815d830 0x7f547806e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.261+0000 7f547de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f547815d830 0x7f547806e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:52746/0 (socket says 172.21.15.100:52746) 2024-08-17T02:45:48.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.261+0000 7f547de00640 1 -- 172.21.15.100:0/307370919 learned_addr learned my addr 172.21.15.100:0/307370919 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:48.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.262+0000 7f84a4a00640 1 Processor -- start 2024-08-17T02:45:48.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.262+0000 7fb3c5400640 1 -- 172.21.15.100:0/3784035208 wait complete. 2024-08-17T02:45:48.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.262+0000 7f672de00640 1 -- 172.21.15.100:0/881233435 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67280b0360 con 0x7f67280ada10 2024-08-17T02:45:48.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.262+0000 7f84a4a00640 1 -- start start 2024-08-17T02:45:48.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.263+0000 7fe1f5c00640 1 Processor -- start 2024-08-17T02:45:48.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.262+0000 7f547d400640 1 --2- 172.21.15.100:0/307370919 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54780b0610 0x7f547815dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.262+0000 7f547ca00640 1 -- 172.21.15.100:0/307370919 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532165660 0 0) 0x7f54780b1690 con 0x7f547815e140 2024-08-17T02:45:48.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.263+0000 7f547ca00640 1 -- 172.21.15.100:0/307370919 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54600034e0 con 0x7f547815e140 2024-08-17T02:45:48.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.263+0000 7f547de00640 1 -- 172.21.15.100:0/307370919 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54780b0610 msgr2=0x7f547815dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:48.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.263+0000 7f547de00640 1 --2- 172.21.15.100:0/307370919 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54780b0610 0x7f547815dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.263+0000 7f547de00640 1 -- 172.21.15.100:0/307370919 >> v1:172.21.15.123:6789/0 conn(0x7f547815e140 legacy=0x7f547815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.263+0000 7f547de00640 1 -- 172.21.15.100:0/307370919 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547815b200 con 0x7f547815d830 2024-08-17T02:45:48.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.264+0000 7f672de00640 1 --2- 172.21.15.100:0/881233435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67280ada10 0x7f67280b2c60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f67280d0dd0 tx=0x7f671c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a9b0267632002c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.264+0000 7f9a7c600640 1 Processor -- start 2024-08-17T02:45:48.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.264+0000 7fb3c5400640 1 Processor -- start 2024-08-17T02:45:48.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.264+0000 7f9a7c600640 1 -- start start 2024-08-17T02:45:48.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.264+0000 7f84a4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8498006150 0x7f84980d5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.264+0000 7fb3c5400640 1 -- start start 2024-08-17T02:45:48.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.265+0000 7f84a4a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84980e1bd0 0x7f84980f2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.265+0000 7f84a4a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84980e6340 0x7f84980e4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.265+0000 7f84a4a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8498052c70 con 0x7f8498006150 2024-08-17T02:45:48.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.265+0000 7f84a4a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84980e35f0 con 0x7f84980e6340 2024-08-17T02:45:48.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.265+0000 7f84a4a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84980e3a80 con 0x7f84980e1bd0 2024-08-17T02:45:48.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.263+0000 7fe1f5c00640 1 -- start start 2024-08-17T02:45:48.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.265+0000 7f849f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8498006150 0x7f84980d5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.265+0000 7fe1f5c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1f00b0610 0x7fe1f015dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.265+0000 7fe1f5c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe1f015e140 0x7fe1f0166e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.265+0000 7fe1f5c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f00b1690 con 0x7fe1f015d830 2024-08-17T02:45:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.265+0000 7fe1f5c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f006e8c0 con 0x7fe1f015e140 2024-08-17T02:45:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.265+0000 7fe1f5c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f00b1b20 con 0x7fe1f00b0610 2024-08-17T02:45:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7f849ea00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84980e1bd0 0x7f84980f2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7f849f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8498006150 0x7f84980d5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33068/0 (socket says 172.21.15.100:33068) 2024-08-17T02:45:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7f849f400640 1 -- 172.21.15.100:0/3687224706 learned_addr learned my addr 172.21.15.100:0/3687224706 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:48.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7fb3c5400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3c00acc70 0x7fb3c00c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7fb3c5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c00ca160 0x7fb3c0153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7fb3c5400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3c0158fb0 0x7fb3c0146a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7fb3c5400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c0069020 con 0x7fb3c00ca160 2024-08-17T02:45:48.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7fb3c5400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c0156720 con 0x7fb3c0158fb0 2024-08-17T02:45:48.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7fb3c5400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c0155ae0 con 0x7fb3c00acc70 2024-08-17T02:45:48.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7f849fe00640 1 --2- 172.21.15.100:0/3687224706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84980e6340 0x7f84980e4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7fe1eea00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe1f015d830 0x7fe1f006e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37458/0 (socket says 172.21.15.100:37458) 2024-08-17T02:45:48.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7f9a7c600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9a7415cfb0 0x7f9a740aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7f9a7c600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9a7406b360 0x7f9a74066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.264+0000 7f672ca00640 1 -- 172.21.15.100:0/881233435 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c032440 con 0x7f67280ada10 2024-08-17T02:45:48.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.264+0000 7f672ca00640 1 -- 172.21.15.100:0/881233435 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c0325a0 con 0x7f67280ada10 2024-08-17T02:45:48.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.264+0000 7f672ca00640 1 -- 172.21.15.100:0/881233435 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c032980 con 0x7f67280ada10 2024-08-17T02:45:48.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7fb3bde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c00ca160 0x7fb3c0153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.265+0000 7f6730800640 1 -- 172.21.15.100:0/881233435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67280ada10 msgr2=0x7f67280b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.265+0000 7f6730800640 1 --2- 172.21.15.100:0/881233435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67280ada10 0x7f67280b2c60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f67280d0dd0 tx=0x7f671c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7fe1ee000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1f00b0610 0x7fe1f015dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7fb3be800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3c00acc70 0x7fb3c00c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7fe1ee000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1f00b0610 0x7fe1f015dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:32980/0 (socket says 172.21.15.100:32980) 2024-08-17T02:45:48.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7fb3be800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3c00acc70 0x7fb3c00c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:32974/0 (socket says 172.21.15.100:32974) 2024-08-17T02:45:48.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7fb3be800640 1 -- 172.21.15.100:0/963155916 learned_addr learned my addr 172.21.15.100:0/963155916 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:48.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7f6730800640 1 -- 172.21.15.100:0/881233435 shutdown_connections 2024-08-17T02:45:48.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7f6730800640 1 --2- 172.21.15.100:0/881233435 >> v2:172.21.15.123:3300/0 conn(0x7f67280b38b0 0x7f67280aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7fe1ee000640 1 -- 172.21.15.100:0/2248459667 learned_addr learned my addr 172.21.15.100:0/2248459667 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:48.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7fe1ef400640 1 --2- 172.21.15.100:0/2248459667 >> v2:172.21.15.100:3300/0 conn(0x7fe1f015e140 0x7fe1f0166e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7f6730800640 1 --2- 172.21.15.100:0/881233435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67280ada10 0x7f67280b2c60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.266+0000 7f6730800640 1 -- 172.21.15.100:0/881233435 >> 172.21.15.100:0/881233435 conn(0x7f67280cfdf0 msgr2=0x7f67280d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:48.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.267+0000 7fb3bf200640 1 --2- 172.21.15.100:0/963155916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3c0158fb0 0x7fb3c0146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.267+0000 7f6730800640 1 -- 172.21.15.100:0/881233435 shutdown_connections 2024-08-17T02:45:48.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.267+0000 7fe1ee000640 1 -- 172.21.15.100:0/2248459667 >> v2:172.21.15.100:3300/0 conn(0x7fe1f015e140 msgr2=0x7fe1f0166e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:48.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.267+0000 7fe1ee000640 1 --2- 172.21.15.100:0/2248459667 >> v2:172.21.15.100:3300/0 conn(0x7fe1f015e140 0x7fe1f0166e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.267+0000 7fe1ee000640 1 -- 172.21.15.100:0/2248459667 >> v1:172.21.15.100:6789/0 conn(0x7fe1f015d830 legacy=0x7fe1f006e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.267+0000 7fe1ee000640 1 -- 172.21.15.100:0/2248459667 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f00ae4a0 con 0x7fe1f00b0610 2024-08-17T02:45:48.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.267+0000 7f547de00640 1 --2- 172.21.15.100:0/307370919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f547815d830 0x7f547806e1b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f546c009910 tx=0x7f546c0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=927a669bf9e5dee3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.268+0000 7f849f400640 1 -- 172.21.15.100:0/3687224706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84980e1bd0 msgr2=0x7f84980f2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.268+0000 7f849f400640 1 --2- 172.21.15.100:0/3687224706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84980e1bd0 0x7f84980f2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.268+0000 7f849f400640 1 -- 172.21.15.100:0/3687224706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84980e6340 msgr2=0x7f84980e4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.268+0000 7f849f400640 1 --2- 172.21.15.100:0/3687224706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84980e6340 0x7f84980e4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.268+0000 7f849f400640 1 -- 172.21.15.100:0/3687224706 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8494009450 con 0x7f8498006150 2024-08-17T02:45:48.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.268+0000 7f9a7c600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a740af600 con 0x7f9a7415d380 2024-08-17T02:45:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.268+0000 7f9a7c600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a74069ec0 con 0x7f9a7415cfb0 2024-08-17T02:45:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.268+0000 7f9a7c600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a740af320 con 0x7f9a7406b360 2024-08-17T02:45:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.268+0000 7f9a7a600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9a7406b360 0x7f9a74066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.268+0000 7f9a7a600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9a7406b360 0x7f9a74066cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:32996/0 (socket says 172.21.15.100:32996) 2024-08-17T02:45:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.268+0000 7f9a7a600640 1 -- 172.21.15.100:0/3416716912 learned_addr learned my addr 172.21.15.100:0/3416716912 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.268+0000 7fb3bf200640 1 -- 172.21.15.100:0/963155916 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3c00acc70 msgr2=0x7fb3c00c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.268+0000 7fb3bf200640 1 --2- 172.21.15.100:0/963155916 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3c00acc70 0x7fb3c00c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.268+0000 7fb3bf200640 1 -- 172.21.15.100:0/963155916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c00ca160 msgr2=0x7fb3c0153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.268+0000 7fb3bf200640 1 --2- 172.21.15.100:0/963155916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c00ca160 0x7fb3c0153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.268+0000 7fb3bf200640 1 -- 172.21.15.100:0/963155916 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b0009390 con 0x7fb3c0158fb0 2024-08-17T02:45:48.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.268+0000 7f9a7a600640 1 -- 172.21.15.100:0/3416716912 >> v2:172.21.15.123:3300/0 conn(0x7f9a7415cfb0 msgr2=0x7f9a740aec30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:45:48.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.268+0000 7fb3bf200640 1 --2- 172.21.15.100:0/963155916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3c0158fb0 0x7fb3c0146a50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009fa0 tx=0x7fb3b8009990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.268+0000 7f849f400640 1 --2- 172.21.15.100:0/3687224706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8498006150 0x7f84980d5450 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8494035040 tx=0x7f8494032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.269+0000 7fb3b6000640 1 -- 172.21.15.100:0/963155916 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b800de50 con 0x7fb3c0158fb0 2024-08-17T02:45:48.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.269+0000 7fb3b6000640 1 -- 172.21.15.100:0/963155916 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b800f040 con 0x7fb3c0158fb0 2024-08-17T02:45:48.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.269+0000 7fb3b6000640 1 -- 172.21.15.100:0/963155916 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8015690 con 0x7fb3c0158fb0 2024-08-17T02:45:48.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.269+0000 7f547ca00640 1 -- 172.21.15.100:0/307370919 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c02ae40 con 0x7f547815d830 2024-08-17T02:45:48.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.269+0000 7f547ca00640 1 -- 172.21.15.100:0/307370919 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546c032440 con 0x7f547815d830 2024-08-17T02:45:48.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.269+0000 7f547ca00640 1 -- 172.21.15.100:0/307370919 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c032820 con 0x7f547815d830 2024-08-17T02:45:48.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.269+0000 7f9a79c00640 1 --2- 172.21.15.100:0/3416716912 >> v2:172.21.15.123:3300/0 conn(0x7f9a7415cfb0 0x7f9a740aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.269+0000 7f9a73e00640 1 -- 172.21.15.100:0/3416716912 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96974860 0 0) 0x7f9a740af600 con 0x7f9a7415d380 2024-08-17T02:45:48.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.267+0000 7f6730800640 1 -- 172.21.15.100:0/881233435 wait complete. 2024-08-17T02:45:48.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.270+0000 7f6730800640 1 Processor -- start 2024-08-17T02:45:48.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.270+0000 7f5480800640 1 -- 172.21.15.100:0/307370919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f547815d830 msgr2=0x7f547806e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.270+0000 7f5480800640 1 --2- 172.21.15.100:0/307370919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f547815d830 0x7f547806e1b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f546c009910 tx=0x7f546c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.270+0000 7fe1ee000640 1 --2- 172.21.15.100:0/2248459667 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1f00b0610 0x7fe1f015dc00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0009910 tx=0x7fe1e00091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bbdcd3124de02eb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.269+0000 7f9a7a600640 1 --2- 172.21.15.100:0/3416716912 >> v2:172.21.15.123:3300/0 conn(0x7f9a7415cfb0 0x7f9a740aec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.270+0000 7fb3c5400640 1 -- 172.21.15.100:0/963155916 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c0155de0 con 0x7fb3c0158fb0 2024-08-17T02:45:48.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.270+0000 7fb3c5400640 1 -- 172.21.15.100:0/963155916 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c00c7a90 con 0x7fb3c0158fb0 2024-08-17T02:45:48.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.270+0000 7f8492a00640 1 -- 172.21.15.100:0/3687224706 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8494031ca0 con 0x7f8498006150 2024-08-17T02:45:48.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.270+0000 7f8492a00640 1 -- 172.21.15.100:0/3687224706 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8494031e00 con 0x7f8498006150 2024-08-17T02:45:48.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.270+0000 7f8492a00640 1 -- 172.21.15.100:0/3687224706 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849403d670 con 0x7f8498006150 2024-08-17T02:45:48.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.270+0000 7f84a4a00640 1 -- 172.21.15.100:0/3687224706 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84980e2700 con 0x7f8498006150 2024-08-17T02:45:48.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.270+0000 7f6730800640 1 -- start start 2024-08-17T02:45:48.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.270+0000 7f5480800640 1 -- 172.21.15.100:0/307370919 shutdown_connections 2024-08-17T02:45:48.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.270+0000 7f5480800640 1 --2- 172.21.15.100:0/307370919 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54780b0610 0x7f547815dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.270+0000 7f5480800640 1 --2- 172.21.15.100:0/307370919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f547815d830 0x7f547806e1b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.270+0000 7f5480800640 1 -- 172.21.15.100:0/307370919 >> 172.21.15.100:0/307370919 conn(0x7f54780cb9b0 msgr2=0x7f54780cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:48.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.270+0000 7f84a4a00640 1 -- 172.21.15.100:0/3687224706 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84980e2cc0 con 0x7f8498006150 2024-08-17T02:45:48.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.269+0000 7f9a7a600640 1 -- 172.21.15.100:0/3416716912 >> v1:172.21.15.100:6789/0 conn(0x7f9a7415d380 legacy=0x7f9a740cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.269+0000 7f9a7a600640 1 -- 172.21.15.100:0/3416716912 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a74069870 con 0x7f9a7406b360 2024-08-17T02:45:48.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.270+0000 7f9a79c00640 1 --2- 172.21.15.100:0/3416716912 >> v2:172.21.15.123:3300/0 conn(0x7f9a7415cfb0 0x7f9a740aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:45:48.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.271+0000 7fe1ed600640 1 -- 172.21.15.100:0/2248459667 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e002ae40 con 0x7fe1f00b0610 2024-08-17T02:45:48.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.271+0000 7fe1ed600640 1 -- 172.21.15.100:0/2248459667 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e0032440 con 0x7fe1f00b0610 2024-08-17T02:45:48.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.271+0000 7fe1ed600640 1 -- 172.21.15.100:0/2248459667 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00327e0 con 0x7fe1f00b0610 2024-08-17T02:45:48.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.271+0000 7f5480800640 1 -- 172.21.15.100:0/307370919 shutdown_connections 2024-08-17T02:45:48.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.271+0000 7f5480800640 1 -- 172.21.15.100:0/307370919 wait complete. 2024-08-17T02:45:48.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.271+0000 7f6730800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67280b1120 0x7f67280ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.271+0000 7f6730800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67280b38b0 0x7f6728149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.271+0000 7f6730800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f672809d0d0 0x7f672814a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.271+0000 7f6730800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672809b9d0 con 0x7f67280b38b0 2024-08-17T02:45:48.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.271+0000 7f6730800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672809b0e0 con 0x7f67280b1120 2024-08-17T02:45:48.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.271+0000 7f6730800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6728149ec0 con 0x7f672809d0d0 2024-08-17T02:45:48.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.272+0000 7f672de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67280b1120 0x7f67280ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.272+0000 7f672d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67280b38b0 0x7f6728149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.272+0000 7f84a4a00640 1 -- 172.21.15.100:0/3687224706 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f847c005210 con 0x7f8498006150 2024-08-17T02:45:48.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.272+0000 7f672de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67280b1120 0x7f67280ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:52790/0 (socket says 172.21.15.100:52790) 2024-08-17T02:45:48.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.272+0000 7f672de00640 1 -- 172.21.15.100:0/152471835 learned_addr learned my addr 172.21.15.100:0/152471835 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:48.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.272+0000 7fb3c5400640 1 -- 172.21.15.100:0/963155916 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c0071050 con 0x7fb3c0158fb0 2024-08-17T02:45:48.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.273+0000 7f672de00640 1 -- 172.21.15.100:0/152471835 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f672809d0d0 msgr2=0x7f672814a140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:45:48.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.273+0000 7f672de00640 1 --2- 172.21.15.100:0/152471835 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f672809d0d0 0x7f672814a140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.273+0000 7f672de00640 1 -- 172.21.15.100:0/152471835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67280b38b0 msgr2=0x7f6728149980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.273+0000 7f8016800640 1 Processor -- start 2024-08-17T02:45:48.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.273+0000 7fe1f5c00640 1 -- 172.21.15.100:0/2248459667 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1f00b0610 msgr2=0x7fe1f015dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.273+0000 7fe1f5c00640 1 --2- 172.21.15.100:0/2248459667 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1f00b0610 0x7fe1f015dc00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0009910 tx=0x7fe1e00091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.273+0000 7f672de00640 1 --2- 172.21.15.100:0/152471835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67280b38b0 0x7f6728149980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.273+0000 7f672de00640 1 -- 172.21.15.100:0/152471835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671c009450 con 0x7f67280b1120 2024-08-17T02:45:48.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.273+0000 7f672de00640 1 --2- 172.21.15.100:0/152471835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67280b1120 0x7f67280ce840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f671c02a890 tx=0x7f671c032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.273+0000 7f6721600640 1 -- 172.21.15.100:0/152471835 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c0319e0 con 0x7f67280b1120 2024-08-17T02:45:48.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.274+0000 7f6721600640 1 -- 172.21.15.100:0/152471835 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c031b40 con 0x7f67280b1120 2024-08-17T02:45:48.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.274+0000 7f6721600640 1 -- 172.21.15.100:0/152471835 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c0319e0 con 0x7f67280b1120 2024-08-17T02:45:48.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.274+0000 7f6730800640 1 -- 172.21.15.100:0/152471835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672809b380 con 0x7f67280b1120 2024-08-17T02:45:48.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.274+0000 7f5480800640 1 Processor -- start 2024-08-17T02:45:48.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.274+0000 7f6730800640 1 -- 172.21.15.100:0/152471835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672809d9b0 con 0x7f67280b1120 2024-08-17T02:45:48.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.274+0000 7f5480800640 1 -- start start 2024-08-17T02:45:48.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.273+0000 7f9a7a600640 1 --2- 172.21.15.100:0/3416716912 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9a7406b360 0x7f9a74066cd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9a64009910 tx=0x7f9a640091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8cc4c1295ff150 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.274+0000 7f9a73e00640 1 -- 172.21.15.100:0/3416716912 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6402adb0 con 0x7f9a7406b360 2024-08-17T02:45:48.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.274+0000 7f9a73e00640 1 -- 172.21.15.100:0/3416716912 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a64032440 con 0x7f9a7406b360 2024-08-17T02:45:48.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.275+0000 7f9a7c600640 1 -- 172.21.15.100:0/3416716912 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9a7406b360 msgr2=0x7f9a74066cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.275+0000 7f9a7c600640 1 --2- 172.21.15.100:0/3416716912 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9a7406b360 0x7f9a74066cd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9a64009910 tx=0x7f9a640091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.275+0000 7fe1f5c00640 1 -- 172.21.15.100:0/2248459667 shutdown_connections 2024-08-17T02:45:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.275+0000 7fe1f5c00640 1 --2- 172.21.15.100:0/2248459667 >> v2:172.21.15.100:3300/0 conn(0x7fe1f015e140 0x7fe1f0166e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.275+0000 7fe1f5c00640 1 --2- 172.21.15.100:0/2248459667 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1f00b0610 0x7fe1f015dc00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.275+0000 7fe1f5c00640 1 -- 172.21.15.100:0/2248459667 >> 172.21.15.100:0/2248459667 conn(0x7fe1f00cb9b0 msgr2=0x7fe1f00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.275+0000 7f8492a00640 1 -- 172.21.15.100:0/3687224706 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8494039040 con 0x7f8498006150 2024-08-17T02:45:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.277+0000 7fe1f5c00640 1 -- 172.21.15.100:0/2248459667 shutdown_connections 2024-08-17T02:45:48.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.277+0000 7fe1f5c00640 1 -- 172.21.15.100:0/2248459667 wait complete. 2024-08-17T02:45:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.276+0000 7f9a7c600640 1 -- 172.21.15.100:0/3416716912 shutdown_connections 2024-08-17T02:45:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.276+0000 7f9a7c600640 1 --2- 172.21.15.100:0/3416716912 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9a7406b360 0x7f9a74066cd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.276+0000 7f9a7c600640 1 --2- 172.21.15.100:0/3416716912 >> v2:172.21.15.123:3300/0 conn(0x7f9a7415cfb0 0x7f9a740aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.276+0000 7f9a7c600640 1 -- 172.21.15.100:0/3416716912 >> 172.21.15.100:0/3416716912 conn(0x7f9a74068820 msgr2=0x7f9a740cca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.277+0000 7f9a7c600640 1 -- 172.21.15.100:0/3416716912 shutdown_connections 2024-08-17T02:45:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.277+0000 7f9a7c600640 1 -- 172.21.15.100:0/3416716912 wait complete. 2024-08-17T02:45:48.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.274+0000 7f8016800640 1 -- start start 2024-08-17T02:45:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.275+0000 7f8016800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f801006db70 0x7f80100acf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.276+0000 7f8016800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80100ae250 con 0x7f801006d7a0 2024-08-17T02:45:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.276+0000 7f8016800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80100ad640 con 0x7f801015ccc0 2024-08-17T02:45:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.276+0000 7f8016800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80100ad450 con 0x7f801006db70 2024-08-17T02:45:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.276+0000 7f8015400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f801006d7a0 0x7f801006e2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37464/0 (socket says 172.21.15.100:37464) 2024-08-17T02:45:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.276+0000 7f8015400640 1 -- 172.21.15.100:0/91951836 learned_addr learned my addr 172.21.15.100:0/91951836 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:48.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.276+0000 7f8014a00640 1 --2- 172.21.15.100:0/91951836 >> v2:172.21.15.100:3300/0 conn(0x7f801006db70 0x7f80100acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.276+0000 7f5480800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54780b0610 0x7f5478140a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.276+0000 7f5480800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f547815d830 0x7f547816d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.277+0000 7f5480800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f547815e140 0x7f547816d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.277+0000 7f547de00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54780b0610 0x7f5478140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.277+0000 7f547de00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54780b0610 0x7f5478140a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:33008/0 (socket says 172.21.15.100:33008) 2024-08-17T02:45:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.277+0000 7f547d400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f547815d830 0x7f547816d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.277+0000 7f547d400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f547815d830 0x7f547816d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:52798/0 (socket says 172.21.15.100:52798) 2024-08-17T02:45:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.277+0000 7f547de00640 1 -- 172.21.15.100:0/3234865965 learned_addr learned my addr 172.21.15.100:0/3234865965 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:48.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.277+0000 7f5480800640 1 -- 172.21.15.100:0/3234865965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547816ee00 con 0x7f547815e140 2024-08-17T02:45:48.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.277+0000 7f5480800640 1 -- 172.21.15.100:0/3234865965 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547816e540 con 0x7f547815d830 2024-08-17T02:45:48.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.277+0000 7f547e800640 1 --2- 172.21.15.100:0/3234865965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f547815e140 0x7f547816d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.277+0000 7f5480800640 1 -- 172.21.15.100:0/3234865965 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5478151fc0 con 0x7f54780b0610 2024-08-17T02:45:48.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.276+0000 7f8492a00640 1 --2- 172.21.15.100:0/3687224706 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f84800652d0 0x7f8480067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.278+0000 7f800fe00640 1 -- 172.21.15.100:0/91951836 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873205411 0 0) 0x7f80100ad640 con 0x7f801015ccc0 2024-08-17T02:45:48.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.278+0000 7f800fe00640 1 -- 172.21.15.100:0/91951836 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ff80034e0 con 0x7f801015ccc0 2024-08-17T02:45:48.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.278+0000 7f8014a00640 1 -- 172.21.15.100:0/91951836 >> v1:172.21.15.123:6789/0 conn(0x7f801015ccc0 legacy=0x7f801015d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.278+0000 7f8014a00640 1 -- 172.21.15.100:0/91951836 >> v1:172.21.15.100:6789/0 conn(0x7f801006d7a0 legacy=0x7f801006e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.279+0000 7f849ea00640 1 --2- 172.21.15.100:0/3687224706 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f84800652d0 0x7f8480067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.279+0000 7f9a7c600640 1 Processor -- start 2024-08-17T02:45:48.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.278+0000 7f8014a00640 1 -- 172.21.15.100:0/91951836 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80100ad920 con 0x7f801006db70 2024-08-17T02:45:48.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.279+0000 7f8492a00640 1 -- 172.21.15.100:0/3687224706 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f84940a29c0 con 0x7f8498006150 2024-08-17T02:45:48.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.278+0000 7f547de00640 1 -- 172.21.15.100:0/3234865965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f547815d830 msgr2=0x7f547816d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.278+0000 7f547de00640 1 --2- 172.21.15.100:0/3234865965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f547815d830 0x7f547816d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.278+0000 7f547de00640 1 -- 172.21.15.100:0/3234865965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f547815e140 msgr2=0x7f547816d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.278+0000 7f547de00640 1 --2- 172.21.15.100:0/3234865965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f547815e140 0x7f547816d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.278+0000 7f547de00640 1 -- 172.21.15.100:0/3234865965 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546c009450 con 0x7f54780b0610 2024-08-17T02:45:48.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.278+0000 7f6721600640 1 -- 172.21.15.100:0/152471835 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f671c039040 con 0x7f67280b1120 2024-08-17T02:45:48.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.278+0000 7f6730800640 1 -- 172.21.15.100:0/152471835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6704005210 con 0x7f67280b1120 2024-08-17T02:45:48.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.279+0000 7f547e800640 1 --2- 172.21.15.100:0/3234865965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f547815e140 0x7f547816d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:48.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.279+0000 7fe1f5c00640 1 Processor -- start 2024-08-17T02:45:48.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.279+0000 7f547de00640 1 --2- 172.21.15.100:0/3234865965 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54780b0610 0x7f5478140a40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f546c009210 tx=0x7f546c032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.279+0000 7f6721600640 1 --2- 172.21.15.100:0/152471835 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f670c0651b0 0x7f670c067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.279+0000 7f9a7c600640 1 -- start start 2024-08-17T02:45:48.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.279+0000 7fe1f5c00640 1 -- start start 2024-08-17T02:45:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.280+0000 7f6721600640 1 -- 172.21.15.100:0/152471835 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f671c041030 con 0x7f67280b1120 2024-08-17T02:45:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.280+0000 7fb3b6000640 1 -- 172.21.15.100:0/963155916 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb3b801e3b0 con 0x7fb3c0158fb0 2024-08-17T02:45:48.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.280+0000 7f8014a00640 1 --2- 172.21.15.100:0/91951836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801006db70 0x7f80100acf10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc009850 tx=0x7f7ffc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91caca50ea5115a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.280+0000 7f5471600640 1 -- 172.21.15.100:0/3234865965 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c031ae0 con 0x7f54780b0610 2024-08-17T02:45:48.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.280+0000 7f5471600640 1 -- 172.21.15.100:0/3234865965 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546c031c80 con 0x7f54780b0610 2024-08-17T02:45:48.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.280+0000 7f5471600640 1 -- 172.21.15.100:0/3234865965 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c03d420 con 0x7f54780b0610 2024-08-17T02:45:48.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.280+0000 7f5480800640 1 -- 172.21.15.100:0/3234865965 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547816e7b0 con 0x7f54780b0610 2024-08-17T02:45:48.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.280+0000 7f5480800640 1 -- 172.21.15.100:0/3234865965 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5478140f80 con 0x7f54780b0610 2024-08-17T02:45:48.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.281+0000 7f672d400640 1 --2- 172.21.15.100:0/152471835 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f670c0651b0 0x7f670c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.281+0000 7fe1f5c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f00b0610 0x7fe1f00a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.281+0000 7fe1f5c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1f015d830 0x7fe1f00a7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.281+0000 7fe1f5c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1f015e140 0x7fe1f00a6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.281+0000 7fe1f5c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f00a7ea0 con 0x7fe1f015d830 2024-08-17T02:45:48.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.281+0000 7fe1f5c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f00a71b0 con 0x7fe1f00b0610 2024-08-17T02:45:48.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.281+0000 7fe1f5c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f00a5bd0 con 0x7fe1f015e140 2024-08-17T02:45:48.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.281+0000 7fe1eea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f00b0610 0x7fe1f00a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.281+0000 7fe1ee000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1f015d830 0x7fe1f00a7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.281+0000 7fe1eea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f00b0610 0x7fe1f00a54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:52812/0 (socket says 172.21.15.100:52812) 2024-08-17T02:45:48.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.281+0000 7fe1eea00640 1 -- 172.21.15.100:0/3896423493 learned_addr learned my addr 172.21.15.100:0/3896423493 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:48.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.281+0000 7fe1ef400640 1 --2- 172.21.15.100:0/3896423493 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1f015e140 0x7fe1f00a6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.281+0000 7fb3b6000640 1 --2- 172.21.15.100:0/963155916 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb3a0065220 0x7fb3a00676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.281+0000 7fb3b6000640 1 -- 172.21.15.100:0/963155916 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb3b8082890 con 0x7fb3c0158fb0 2024-08-17T02:45:48.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.282+0000 7fe1eea00640 1 -- 172.21.15.100:0/3896423493 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1f015e140 msgr2=0x7fe1f00a6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.282+0000 7fe1eea00640 1 --2- 172.21.15.100:0/3896423493 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1f015e140 0x7fe1f00a6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.282+0000 7fe1eea00640 1 -- 172.21.15.100:0/3896423493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1f015d830 msgr2=0x7fe1f00a7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.282+0000 7fe1eea00640 1 --2- 172.21.15.100:0/3896423493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1f015d830 0x7fe1f00a7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.282+0000 7fe1eea00640 1 -- 172.21.15.100:0/3896423493 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e0009450 con 0x7fe1f00b0610 2024-08-17T02:45:48.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.282+0000 7f849ea00640 1 --2- 172.21.15.100:0/3687224706 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f84800652d0 0x7f8480067780 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8498053440 tx=0x7f848c007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.282+0000 7f5480800640 1 -- 172.21.15.100:0/3234865965 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5478064db0 con 0x7f54780b0610 2024-08-17T02:45:48.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.282+0000 7f500d000640 1 Processor -- start 2024-08-17T02:45:48.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.282+0000 7fe1eea00640 1 --2- 172.21.15.100:0/3896423493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f00b0610 0x7fe1f00a54d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00c590 tx=0x7fe1dc007ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.282+0000 7f500d000640 1 -- start start 2024-08-17T02:45:48.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.283+0000 7fb3be800640 1 --2- 172.21.15.100:0/963155916 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb3a0065220 0x7fb3a00676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.283+0000 7f9a7c600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9a7406b360 0x7f9a74163250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.283+0000 7f672d400640 1 --2- 172.21.15.100:0/152471835 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f670c0651b0 0x7f670c067660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6728157fc0 tx=0x7f6718009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.283+0000 7f5471600640 1 -- 172.21.15.100:0/3234865965 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f546c039040 con 0x7f54780b0610 2024-08-17T02:45:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.283+0000 7f9a7c600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a7415cfb0 0x7f9a7415d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.283+0000 7f9a7c600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a7415d380 0x7f9a74154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.283+0000 7f800fe00640 1 -- 172.21.15.100:0/91951836 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc02ae40 con 0x7f801006db70 2024-08-17T02:45:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.283+0000 7f800fe00640 1 -- 172.21.15.100:0/91951836 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc032440 con 0x7f801006db70 2024-08-17T02:45:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.283+0000 7f800fe00640 1 -- 172.21.15.100:0/91951836 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc032820 con 0x7f801006db70 2024-08-17T02:45:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.283+0000 7f9a79c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9a7406b360 0x7f9a74163250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.284+0000 7f9a79c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9a7406b360 0x7f9a74163250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:33030/0 (socket says 172.21.15.100:33030) 2024-08-17T02:45:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.284+0000 7f500d000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f500815d440 0x7f50080cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.284+0000 7f9a7c600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7415dfc0 con 0x7f9a7415cfb0 2024-08-17T02:45:48.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.284+0000 7f9a79c00640 1 -- 172.21.15.100:0/3928435746 learned_addr learned my addr 172.21.15.100:0/3928435746 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:48.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.284+0000 7f9a79200640 1 --2- 172.21.15.100:0/3928435746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a7415cfb0 0x7f9a7415d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.284+0000 7f9a7c600640 1 -- 172.21.15.100:0/3928435746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7416e1b0 con 0x7f9a7415d380 2024-08-17T02:45:48.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.284+0000 7f9a7c600640 1 -- 172.21.15.100:0/3928435746 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7416dd20 con 0x7f9a7406b360 2024-08-17T02:45:48.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.284+0000 7f9a7a600640 1 --2- 172.21.15.100:0/3928435746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a7415d380 0x7f9a74154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.284+0000 7f500d000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f50080ac890 0x7f50080cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.284+0000 7f500d000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50080cb640 con 0x7f50080d0980 2024-08-17T02:45:48.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.284+0000 7f500d000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50080c4d20 con 0x7f50080ac890 2024-08-17T02:45:48.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.284+0000 7f500d000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50080c5000 con 0x7f500815d440 2024-08-17T02:45:48.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.284+0000 7f8016800640 1 -- 172.21.15.100:0/91951836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801006db70 msgr2=0x7f80100acf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.284+0000 7f8016800640 1 --2- 172.21.15.100:0/91951836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801006db70 0x7f80100acf10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc009850 tx=0x7f7ffc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.284+0000 7f8492a00640 1 -- 172.21.15.100:0/3687224706 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8494070c50 con 0x7f8498006150 2024-08-17T02:45:48.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.284+0000 7f5471600640 1 --2- 172.21.15.100:0/3234865965 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5458065250 0x7f5458067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.284+0000 7f5006800640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f50080d0980 0x7f50080c5dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.100:37016/0 (socket says 172.21.15.100:37016) 2024-08-17T02:45:48.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.284+0000 7f5006800640 1 -- 172.21.15.100:0/908142585 learned_addr learned my addr 172.21.15.100:0/908142585 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:48.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.284+0000 7f5005e00640 1 --2- 172.21.15.100:0/908142585 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f500815d440 0x7f50080cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.285+0000 7f5471600640 1 -- 172.21.15.100:0/3234865965 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f546c02ae40 con 0x7f54780b0610 2024-08-17T02:45:48.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.285+0000 7f8016800640 1 -- 172.21.15.100:0/91951836 shutdown_connections 2024-08-17T02:45:48.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.285+0000 7f8016800640 1 --2- 172.21.15.100:0/91951836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801006db70 0x7f80100acf10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.285+0000 7f8016800640 1 -- 172.21.15.100:0/91951836 >> 172.21.15.100:0/91951836 conn(0x7f8010067750 msgr2=0x7f80100cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:48.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.285+0000 7f8016800640 1 -- 172.21.15.100:0/91951836 shutdown_connections 2024-08-17T02:45:48.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.285+0000 7f5005400640 1 --2- 172.21.15.100:0/908142585 >> v2:172.21.15.123:3300/0 conn(0x7f50080ac890 0x7f50080cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.285+0000 7f9a7a600640 1 -- 172.21.15.100:0/3928435746 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9a7406b360 msgr2=0x7f9a74163250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.285+0000 7f8016800640 1 -- 172.21.15.100:0/91951836 wait complete. 2024-08-17T02:45:48.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.285+0000 7f9a7a600640 1 --2- 172.21.15.100:0/3928435746 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9a7406b360 0x7f9a74163250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.285+0000 7f9a7a600640 1 -- 172.21.15.100:0/3928435746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a7415cfb0 msgr2=0x7f9a7415d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.285+0000 7f9a7a600640 1 --2- 172.21.15.100:0/3928435746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a7415cfb0 0x7f9a7415d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.285+0000 7f9a7a600640 1 -- 172.21.15.100:0/3928435746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a64009450 con 0x7f9a7415d380 2024-08-17T02:45:48.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.285+0000 7f9a7a600640 1 --2- 172.21.15.100:0/3928435746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a7415d380 0x7f9a74154d20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a64031000 tx=0x7f9a64032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.285+0000 7fb3be800640 1 --2- 172.21.15.100:0/963155916 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb3a0065220 0x7fb3a00676d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac007fd0 tx=0x7fb3ac007f00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.285+0000 7f5005e00640 1 -- 172.21.15.100:0/908142585 >> v2:172.21.15.123:3300/0 conn(0x7f50080ac890 msgr2=0x7f50080cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:48.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.285+0000 7f5005e00640 1 --2- 172.21.15.100:0/908142585 >> v2:172.21.15.123:3300/0 conn(0x7f50080ac890 0x7f50080cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.285+0000 7f5005e00640 1 -- 172.21.15.100:0/908142585 >> v1:172.21.15.123:6789/0 conn(0x7f50080d0980 legacy=0x7f50080c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.285+0000 7f5005e00640 1 -- 172.21.15.100:0/908142585 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50080c52e0 con 0x7f500815d440 2024-08-17T02:45:48.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.285+0000 7f547d400640 1 --2- 172.21.15.100:0/3234865965 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5458065250 0x7f5458067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.286+0000 7f6721600640 1 -- 172.21.15.100:0/152471835 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f671c0704d0 con 0x7f67280b1120 2024-08-17T02:45:48.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.286+0000 7f547d400640 1 --2- 172.21.15.100:0/3234865965 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5458065250 0x7f5458067700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f54780b0fd0 tx=0x7f54640090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.287+0000 7f8016800640 1 Processor -- start 2024-08-17T02:45:48.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.287+0000 7f5005e00640 1 --2- 172.21.15.100:0/908142585 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f500815d440 0x7f50080cabc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5000009850 tx=0x7f50000090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ba3e14479a6e1f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.287+0000 7f8016800640 1 -- start start 2024-08-17T02:45:48.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.288+0000 7f8016800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801006d7a0 0x7f80100a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.288+0000 7f8016800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f801006db70 0x7f80100c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.288+0000 7f8016800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f801015ccc0 0x7f8010179820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.288+0000 7f8016800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80100c97b0 con 0x7f801006d7a0 2024-08-17T02:45:48.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.288+0000 7f8016800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80100c8ba0 con 0x7f801006db70 2024-08-17T02:45:48.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.288+0000 7f8016800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80100c8e80 con 0x7f801015ccc0 2024-08-17T02:45:48.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.288+0000 7f8015400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801006d7a0 0x7f80100a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.288+0000 7f8015400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801006d7a0 0x7f80100a5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33146/0 (socket says 172.21.15.100:33146) 2024-08-17T02:45:48.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.288+0000 7f8015400640 1 -- 172.21.15.100:0/2482478678 learned_addr learned my addr 172.21.15.100:0/2482478678 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:48.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.288+0000 7f8015e00640 1 --2- 172.21.15.100:0/2482478678 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f801015ccc0 0x7f8010179820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.288+0000 7f8014a00640 1 --2- 172.21.15.100:0/2482478678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f801006db70 0x7f80100c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.289+0000 7f8015400640 1 -- 172.21.15.100:0/2482478678 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f801015ccc0 msgr2=0x7f8010179820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.289+0000 7f8015400640 1 --2- 172.21.15.100:0/2482478678 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f801015ccc0 0x7f8010179820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.289+0000 7f8015400640 1 -- 172.21.15.100:0/2482478678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f801006db70 msgr2=0x7f80100c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.289+0000 7f8015400640 1 --2- 172.21.15.100:0/2482478678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f801006db70 0x7f80100c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.289+0000 7f8015400640 1 -- 172.21.15.100:0/2482478678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc009390 con 0x7f801006d7a0 2024-08-17T02:45:48.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.289+0000 7f8015400640 1 --2- 172.21.15.100:0/2482478678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801006d7a0 0x7f80100a5980 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f800400c590 tx=0x7f8004007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.289+0000 7f800cc00640 1 -- 172.21.15.100:0/2482478678 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004005aa0 con 0x7f801006d7a0 2024-08-17T02:45:48.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.289+0000 7f800cc00640 1 -- 172.21.15.100:0/2482478678 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8004005c20 con 0x7f801006d7a0 2024-08-17T02:45:48.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.289+0000 7f800cc00640 1 -- 172.21.15.100:0/2482478678 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80040070f0 con 0x7f801006d7a0 2024-08-17T02:45:48.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.289+0000 7f8016800640 1 -- 172.21.15.100:0/2482478678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80100c9160 con 0x7f801006d7a0 2024-08-17T02:45:48.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.289+0000 7f8016800640 1 -- 172.21.15.100:0/2482478678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80101527d0 con 0x7f801006d7a0 2024-08-17T02:45:48.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.290+0000 7f5471600640 1 -- 172.21.15.100:0/3234865965 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f546c0704a0 con 0x7f54780b0610 2024-08-17T02:45:48.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.290+0000 7f5004a00640 1 -- 172.21.15.100:0/908142585 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500002ae20 con 0x7f500815d440 2024-08-17T02:45:48.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.290+0000 7f5004a00640 1 -- 172.21.15.100:0/908142585 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5000032440 con 0x7f500815d440 2024-08-17T02:45:48.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.290+0000 7f5004a00640 1 -- 172.21.15.100:0/908142585 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000032820 con 0x7f500815d440 2024-08-17T02:45:48.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.290+0000 7fe1e6000640 1 -- 172.21.15.100:0/3896423493 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc007300 con 0x7fe1f00b0610 2024-08-17T02:45:48.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.291+0000 7fe1e6000640 1 -- 172.21.15.100:0/3896423493 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc007460 con 0x7fe1f00b0610 2024-08-17T02:45:48.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.291+0000 7fe1e6000640 1 -- 172.21.15.100:0/3896423493 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc0047a0 con 0x7fe1f00b0610 2024-08-17T02:45:48.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.291+0000 7fb3b6000640 1 -- 172.21.15.100:0/963155916 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb3b8050a80 con 0x7fb3c0158fb0 2024-08-17T02:45:48.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.291+0000 7fe1f5c00640 1 -- 172.21.15.100:0/3896423493 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f00a5eb0 con 0x7fe1f00b0610 2024-08-17T02:45:48.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.291+0000 7fe1f5c00640 1 -- 172.21.15.100:0/3896423493 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f00a6470 con 0x7fe1f00b0610 2024-08-17T02:45:48.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.291+0000 7f9a70c00640 1 -- 172.21.15.100:0/3928435746 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6403e660 con 0x7f9a7415d380 2024-08-17T02:45:48.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.291+0000 7f9a70c00640 1 -- 172.21.15.100:0/3928435746 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6403e800 con 0x7f9a7415d380 2024-08-17T02:45:48.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.291+0000 7f9a70c00640 1 -- 172.21.15.100:0/3928435746 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6403ebc0 con 0x7f9a7415d380 2024-08-17T02:45:48.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.291+0000 7f9a7c600640 1 -- 172.21.15.100:0/3928435746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a7415dd40 con 0x7f9a7415d380 2024-08-17T02:45:48.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.291+0000 7f9a7c600640 1 -- 172.21.15.100:0/3928435746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7416d6d0 con 0x7f9a7415d380 2024-08-17T02:45:48.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.293+0000 7fe1f5c00640 1 -- 172.21.15.100:0/3896423493 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f0064db0 con 0x7fe1f00b0610 2024-08-17T02:45:48.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.292+0000 7f500d000640 1 -- 172.21.15.100:0/908142585 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f500815d440 msgr2=0x7f50080cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.292+0000 7f500d000640 1 --2- 172.21.15.100:0/908142585 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f500815d440 0x7f50080cabc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5000009850 tx=0x7f50000090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.293+0000 7f8016800640 1 -- 172.21.15.100:0/2482478678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8010071050 con 0x7f801006d7a0 2024-08-17T02:45:48.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.293+0000 7f500d000640 1 -- 172.21.15.100:0/908142585 shutdown_connections 2024-08-17T02:45:48.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.293+0000 7f500d000640 1 --2- 172.21.15.100:0/908142585 >> v2:172.21.15.123:3300/0 conn(0x7f50080ac890 0x7f50080cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.293+0000 7f9a7c600640 1 -- 172.21.15.100:0/3928435746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a50005210 con 0x7f9a7415d380 2024-08-17T02:45:48.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.294+0000 7f500d000640 1 --2- 172.21.15.100:0/908142585 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f500815d440 0x7f50080cabc0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.294+0000 7f500d000640 1 -- 172.21.15.100:0/908142585 >> 172.21.15.100:0/908142585 conn(0x7f50080cfde0 msgr2=0x7f50080d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:48.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.294+0000 7f800cc00640 1 -- 172.21.15.100:0/2482478678 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8004007540 con 0x7f801006d7a0 2024-08-17T02:45:48.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.295+0000 7f500d000640 1 -- 172.21.15.100:0/908142585 shutdown_connections 2024-08-17T02:45:48.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.295+0000 7f800cc00640 1 --2- 172.21.15.100:0/2482478678 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7ff0065150 0x7f7ff0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.297+0000 7f500d000640 1 -- 172.21.15.100:0/908142585 wait complete. 2024-08-17T02:45:48.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.296+0000 7f9a70c00640 1 -- 172.21.15.100:0/3928435746 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9a6403c400 con 0x7f9a7415d380 2024-08-17T02:45:48.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.297+0000 7f9a70c00640 1 --2- 172.21.15.100:0/3928435746 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9a580652a0 0x7f9a58067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.296+0000 7f800cc00640 1 -- 172.21.15.100:0/2482478678 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f80040814e0 con 0x7f801006d7a0 2024-08-17T02:45:48.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.297+0000 7f9a70c00640 1 -- 172.21.15.100:0/3928435746 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a640a2c10 con 0x7f9a7415d380 2024-08-17T02:45:48.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.297+0000 7f8014a00640 1 --2- 172.21.15.100:0/2482478678 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7ff0065150 0x7f7ff0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.299+0000 7fe1e6000640 1 -- 172.21.15.100:0/3896423493 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe1dc004b50 con 0x7fe1f00b0610 2024-08-17T02:45:48.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.300+0000 7fe1e6000640 1 --2- 172.21.15.100:0/3896423493 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe1d00652a0 0x7fe1d0067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.300+0000 7fe1e6000640 1 -- 172.21.15.100:0/3896423493 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe1dc081780 con 0x7fe1f00b0610 2024-08-17T02:45:48.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.300+0000 7fe1ee000640 1 --2- 172.21.15.100:0/3896423493 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe1d00652a0 0x7fe1d0067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.299+0000 7f9a79c00640 1 --2- 172.21.15.100:0/3928435746 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9a580652a0 0x7f9a58067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.300+0000 7f9a79c00640 1 --2- 172.21.15.100:0/3928435746 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9a580652a0 0x7f9a58067750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00e6d0 tx=0x7f9a6c0077d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.299+0000 7f8014a00640 1 --2- 172.21.15.100:0/2482478678 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7ff0065150 0x7f7ff0067600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc034000 tx=0x7f7ffc032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.301+0000 7fe1ee000640 1 --2- 172.21.15.100:0/3896423493 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe1d00652a0 0x7fe1d0067750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00ad8a0 tx=0x7fe1e0032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.299+0000 7f500d000640 1 Processor -- start 2024-08-17T02:45:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.299+0000 7f500d000640 1 -- start start 2024-08-17T02:45:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.301+0000 7f500d000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f50080ac890 0x7f50080c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.301+0000 7f500d000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50080d0980 0x7f5008182090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.301+0000 7f500d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500815d440 0x7f50081825d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.302+0000 7f5005400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50080d0980 0x7f5008182090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.302+0000 7f5005400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50080d0980 0x7f5008182090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:52842/0 (socket says 172.21.15.100:52842) 2024-08-17T02:45:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.302+0000 7f5005400640 1 -- 172.21.15.100:0/9284479 learned_addr learned my addr 172.21.15.100:0/9284479 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.302+0000 7f500d000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50080c80f0 con 0x7f500815d440 2024-08-17T02:45:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.302+0000 7f500d000640 1 -- 172.21.15.100:0/9284479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50080c83d0 con 0x7f50080d0980 2024-08-17T02:45:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.302+0000 7f500d000640 1 -- 172.21.15.100:0/9284479 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50080c86b0 con 0x7f50080ac890 2024-08-17T02:45:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.302+0000 7f5006800640 1 --2- 172.21.15.100:0/9284479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500815d440 0x7f50081825d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.302+0000 7f5005e00640 1 --2- 172.21.15.100:0/9284479 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f50080ac890 0x7f50080c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.302+0000 7f5005e00640 1 -- 172.21.15.100:0/9284479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50080d0980 msgr2=0x7f5008182090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.302+0000 7f5005e00640 1 --2- 172.21.15.100:0/9284479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50080d0980 0x7f5008182090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.302+0000 7f5005e00640 1 -- 172.21.15.100:0/9284479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500815d440 msgr2=0x7f50081825d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.302+0000 7f5005e00640 1 --2- 172.21.15.100:0/9284479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500815d440 0x7f50081825d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.303+0000 7f5005e00640 1 -- 172.21.15.100:0/9284479 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5000009390 con 0x7f50080ac890 2024-08-17T02:45:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.303+0000 7f800cc00640 1 -- 172.21.15.100:0/2482478678 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f800404f630 con 0x7f801006d7a0 2024-08-17T02:45:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.303+0000 7f5005e00640 1 --2- 172.21.15.100:0/9284479 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f50080ac890 0x7f50080c7850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5000031000 tx=0x7f5000032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.303+0000 7f9a70c00640 1 -- 172.21.15.100:0/3928435746 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9a64070d60 con 0x7f9a7415d380 2024-08-17T02:45:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.303+0000 7f4ffd600640 1 -- 172.21.15.100:0/9284479 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000000d10 con 0x7f50080ac890 2024-08-17T02:45:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.303+0000 7f4ffd600640 1 -- 172.21.15.100:0/9284479 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5000031de0 con 0x7f50080ac890 2024-08-17T02:45:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.304+0000 7f4ffd600640 1 -- 172.21.15.100:0/9284479 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500003e680 con 0x7f50080ac890 2024-08-17T02:45:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.304+0000 7f500d000640 1 -- 172.21.15.100:0/9284479 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500817fc60 con 0x7f50080ac890 2024-08-17T02:45:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.304+0000 7f500d000640 1 -- 172.21.15.100:0/9284479 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50080c7d90 con 0x7f50080ac890 2024-08-17T02:45:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.306+0000 7f500d000640 1 -- 172.21.15.100:0/9284479 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5008180160 con 0x7f50080ac890 2024-08-17T02:45:48.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.308+0000 7fe1e6000640 1 -- 172.21.15.100:0/3896423493 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe1dc04ce40 con 0x7fe1f00b0610 2024-08-17T02:45:48.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.308+0000 7f4ffd600640 1 -- 172.21.15.100:0/9284479 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f500003c400 con 0x7f50080ac890 2024-08-17T02:45:48.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.309+0000 7f4ffd600640 1 --2- 172.21.15.100:0/9284479 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4fe8065220 0x7f4fe80676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:48.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.309+0000 7f4ffd600640 1 -- 172.21.15.100:0/9284479 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50000a2c50 con 0x7f50080ac890 2024-08-17T02:45:48.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.309+0000 7f5005400640 1 --2- 172.21.15.100:0/9284479 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4fe8065220 0x7f4fe80676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.310+0000 7f5005400640 1 --2- 172.21.15.100:0/9284479 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4fe8065220 0x7f4fe80676d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f50080895d0 tx=0x7f4ff40090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:48.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.313+0000 7f4ffd600640 1 -- 172.21.15.100:0/9284479 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5000070da0 con 0x7f50080ac890 2024-08-17T02:45:48.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.677+0000 7f84a4a00640 1 -- 172.21.15.100:0/3687224706 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f847c005790 con 0x7f8498006150 2024-08-17T02:45:48.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.678+0000 7f8492a00640 1 -- 172.21.15.100:0/3687224706 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8494074270 con 0x7f8498006150 2024-08-17T02:45:48.680 INFO:teuthology.orchestra.run.smithi100.stdout:60129542147 2024-08-17T02:45:48.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.682+0000 7f84a4a00640 1 -- 172.21.15.100:0/3687224706 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f84800652d0 msgr2=0x7f8480067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.682+0000 7f84a4a00640 1 --2- 172.21.15.100:0/3687224706 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f84800652d0 0x7f8480067780 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8498053440 tx=0x7f848c007de0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.682+0000 7f84a4a00640 1 -- 172.21.15.100:0/3687224706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8498006150 msgr2=0x7f84980d5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.682+0000 7f84a4a00640 1 --2- 172.21.15.100:0/3687224706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8498006150 0x7f84980d5450 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8494035040 tx=0x7f8494032000 comp rx=0 tx=0).stop 2024-08-17T02:45:48.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.683+0000 7f84a4a00640 1 -- 172.21.15.100:0/3687224706 shutdown_connections 2024-08-17T02:45:48.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.683+0000 7f84a4a00640 1 --2- 172.21.15.100:0/3687224706 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f84800652d0 0x7f8480067780 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.683+0000 7f84a4a00640 1 --2- 172.21.15.100:0/3687224706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84980e6340 0x7f84980e4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.683+0000 7f84a4a00640 1 --2- 172.21.15.100:0/3687224706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84980e1bd0 0x7f84980f2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.683+0000 7f84a4a00640 1 --2- 172.21.15.100:0/3687224706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8498006150 0x7f84980d5450 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.683+0000 7f84a4a00640 1 -- 172.21.15.100:0/3687224706 >> 172.21.15.100:0/3687224706 conn(0x7f849800f070 msgr2=0x7f84980586b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:48.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.684+0000 7f84a4a00640 1 -- 172.21.15.100:0/3687224706 shutdown_connections 2024-08-17T02:45:48.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.684+0000 7f84a4a00640 1 -- 172.21.15.100:0/3687224706 wait complete. 2024-08-17T02:45:48.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.697+0000 7f5480800640 1 -- 172.21.15.100:0/3234865965 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f547806a5e0 con 0x7f54780b0610 2024-08-17T02:45:48.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.698+0000 7f6730800640 1 -- 172.21.15.100:0/152471835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f67040054c0 con 0x7f67280b1120 2024-08-17T02:45:48.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.698+0000 7f5471600640 1 -- 172.21.15.100:0/3234865965 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f546c037020 con 0x7f54780b0610 2024-08-17T02:45:48.699 INFO:teuthology.orchestra.run.smithi100.stdout:60129542147 2024-08-17T02:45:48.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.699+0000 7f6721600640 1 -- 172.21.15.100:0/152471835 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f671c073af0 con 0x7f67280b1120 2024-08-17T02:45:48.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.702+0000 7fb3c5400640 1 -- 172.21.15.100:0/963155916 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb3c01560c0 con 0x7fb3c0158fb0 2024-08-17T02:45:48.703 INFO:teuthology.orchestra.run.smithi100.stdout:60129542147 2024-08-17T02:45:48.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.702+0000 7f5480800640 1 -- 172.21.15.100:0/3234865965 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5458065250 msgr2=0x7f5458067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.702+0000 7f5480800640 1 --2- 172.21.15.100:0/3234865965 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5458065250 0x7f5458067700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f54780b0fd0 tx=0x7f54640090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.702+0000 7f5480800640 1 -- 172.21.15.100:0/3234865965 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54780b0610 msgr2=0x7f5478140a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.702+0000 7f5480800640 1 --2- 172.21.15.100:0/3234865965 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54780b0610 0x7f5478140a40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f546c009210 tx=0x7f546c032000 comp rx=0 tx=0).stop 2024-08-17T02:45:48.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.702+0000 7f5480800640 1 -- 172.21.15.100:0/3234865965 shutdown_connections 2024-08-17T02:45:48.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.703+0000 7f5480800640 1 --2- 172.21.15.100:0/3234865965 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5458065250 0x7f5458067700 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.703+0000 7f5480800640 1 --2- 172.21.15.100:0/3234865965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f547815e140 0x7f547816d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.703+0000 7f5480800640 1 --2- 172.21.15.100:0/3234865965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f547815d830 0x7f547816d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.703+0000 7f5480800640 1 --2- 172.21.15.100:0/3234865965 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54780b0610 0x7f5478140a40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.703+0000 7f5480800640 1 -- 172.21.15.100:0/3234865965 >> 172.21.15.100:0/3234865965 conn(0x7f54780cb9b0 msgr2=0x7f5478069640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:48.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.703+0000 7f6730800640 1 -- 172.21.15.100:0/152471835 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f670c0651b0 msgr2=0x7f670c067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.703+0000 7f5480800640 1 -- 172.21.15.100:0/3234865965 shutdown_connections 2024-08-17T02:45:48.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.703+0000 7f5480800640 1 -- 172.21.15.100:0/3234865965 wait complete. 2024-08-17T02:45:48.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.703+0000 7f6730800640 1 --2- 172.21.15.100:0/152471835 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f670c0651b0 0x7f670c067660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6728157fc0 tx=0x7f6718009040 comp rx=0 tx=0).stop 2024-08-17T02:45:48.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.703+0000 7f6730800640 1 -- 172.21.15.100:0/152471835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67280b1120 msgr2=0x7f67280ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.703+0000 7f6730800640 1 --2- 172.21.15.100:0/152471835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67280b1120 0x7f67280ce840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f671c02a890 tx=0x7f671c032000 comp rx=0 tx=0).stop 2024-08-17T02:45:48.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.703+0000 7f6730800640 1 -- 172.21.15.100:0/152471835 shutdown_connections 2024-08-17T02:45:48.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.703+0000 7f6730800640 1 --2- 172.21.15.100:0/152471835 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f670c0651b0 0x7f670c067660 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.703+0000 7f6730800640 1 --2- 172.21.15.100:0/152471835 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f672809d0d0 0x7f672814a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.703+0000 7f6730800640 1 --2- 172.21.15.100:0/152471835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67280b38b0 0x7f6728149980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.703+0000 7f6730800640 1 --2- 172.21.15.100:0/152471835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67280b1120 0x7f67280ce840 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.703+0000 7f6730800640 1 -- 172.21.15.100:0/152471835 >> 172.21.15.100:0/152471835 conn(0x7f67280cfdf0 msgr2=0x7f6728067510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:48.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.703+0000 7fb3b6000640 1 -- 172.21.15.100:0/963155916 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb3b80540a0 con 0x7fb3c0158fb0 2024-08-17T02:45:48.707 INFO:teuthology.orchestra.run.smithi100.stdout:60129542148 2024-08-17T02:45:48.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.704+0000 7f6730800640 1 -- 172.21.15.100:0/152471835 shutdown_connections 2024-08-17T02:45:48.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.704+0000 7f6730800640 1 -- 172.21.15.100:0/152471835 wait complete. 2024-08-17T02:45:48.708 INFO:teuthology.orchestra.run.smithi100.stdout:60129542148 2024-08-17T02:45:48.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.704+0000 7f9a7c600640 1 -- 172.21.15.100:0/3928435746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9a500054c0 con 0x7f9a7415d380 2024-08-17T02:45:48.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.705+0000 7f9a70c00640 1 -- 172.21.15.100:0/3928435746 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a64037090 con 0x7f9a7415d380 2024-08-17T02:45:48.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.708+0000 7fb3c5400640 1 -- 172.21.15.100:0/963155916 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb3a0065220 msgr2=0x7fb3a00676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.708+0000 7f9a7c600640 1 -- 172.21.15.100:0/3928435746 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9a580652a0 msgr2=0x7f9a58067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.708+0000 7f9a7c600640 1 --2- 172.21.15.100:0/3928435746 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9a580652a0 0x7f9a58067750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00e6d0 tx=0x7f9a6c0077d0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.708+0000 7f9a7c600640 1 -- 172.21.15.100:0/3928435746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a7415d380 msgr2=0x7f9a74154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.708+0000 7f9a7c600640 1 --2- 172.21.15.100:0/3928435746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a7415d380 0x7f9a74154d20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a64031000 tx=0x7f9a64032000 comp rx=0 tx=0).stop 2024-08-17T02:45:48.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.1 2024-08-17T02:45:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.708+0000 7fb3c5400640 1 --2- 172.21.15.100:0/963155916 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb3a0065220 0x7fb3a00676d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac007fd0 tx=0x7fb3ac007f00 comp rx=0 tx=0).stop 2024-08-17T02:45:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.708+0000 7fb3c5400640 1 -- 172.21.15.100:0/963155916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3c0158fb0 msgr2=0x7fb3c0146a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.708+0000 7fb3c5400640 1 --2- 172.21.15.100:0/963155916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3c0158fb0 0x7fb3c0146a50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009fa0 tx=0x7fb3b8009990 comp rx=0 tx=0).stop 2024-08-17T02:45:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.709+0000 7fb3c5400640 1 -- 172.21.15.100:0/963155916 shutdown_connections 2024-08-17T02:45:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.709+0000 7fb3c5400640 1 --2- 172.21.15.100:0/963155916 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb3a0065220 0x7fb3a00676d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.709+0000 7fb3c5400640 1 --2- 172.21.15.100:0/963155916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3c0158fb0 0x7fb3c0146a50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.709+0000 7fb3c5400640 1 --2- 172.21.15.100:0/963155916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c00ca160 0x7fb3c0153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.709+0000 7fb3c5400640 1 --2- 172.21.15.100:0/963155916 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3c00acc70 0x7fb3c00c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.709+0000 7fb3c5400640 1 -- 172.21.15.100:0/963155916 >> 172.21.15.100:0/963155916 conn(0x7fb3c006eb90 msgr2=0x7fb3c0153310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:48.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.709+0000 7f9a7c600640 1 -- 172.21.15.100:0/3928435746 shutdown_connections 2024-08-17T02:45:48.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.709+0000 7f9a7c600640 1 --2- 172.21.15.100:0/3928435746 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9a580652a0 0x7f9a58067750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.709+0000 7f9a7c600640 1 --2- 172.21.15.100:0/3928435746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a7415d380 0x7f9a74154d20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.709+0000 7f9a7c600640 1 --2- 172.21.15.100:0/3928435746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a7415cfb0 0x7f9a7415d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.709+0000 7f9a7c600640 1 --2- 172.21.15.100:0/3928435746 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9a7406b360 0x7f9a74163250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.709+0000 7f9a7c600640 1 -- 172.21.15.100:0/3928435746 >> 172.21.15.100:0/3928435746 conn(0x7f9a74068820 msgr2=0x7f9a74158170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:48.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.709+0000 7fb3c5400640 1 -- 172.21.15.100:0/963155916 shutdown_connections 2024-08-17T02:45:48.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.709+0000 7fb3c5400640 1 -- 172.21.15.100:0/963155916 wait complete. 2024-08-17T02:45:48.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.709+0000 7f9a7c600640 1 -- 172.21.15.100:0/3928435746 shutdown_connections 2024-08-17T02:45:48.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.709+0000 7f9a7c600640 1 -- 172.21.15.100:0/3928435746 wait complete. 2024-08-17T02:45:48.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.717+0000 7fe1f5c00640 1 -- 172.21.15.100:0/3896423493 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe1f00ae280 con 0x7fe1f00b0610 2024-08-17T02:45:48.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.717+0000 7f8016800640 1 -- 172.21.15.100:0/2482478678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f80100b0b30 con 0x7f801006d7a0 2024-08-17T02:45:48.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.718+0000 7f800cc00640 1 -- 172.21.15.100:0/2482478678 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8004052c50 con 0x7f801006d7a0 2024-08-17T02:45:48.720 INFO:teuthology.orchestra.run.smithi100.stdout:60129542148 2024-08-17T02:45:48.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.718+0000 7fe1e6000640 1 -- 172.21.15.100:0/3896423493 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe1dc018090 con 0x7fe1f00b0610 2024-08-17T02:45:48.720 INFO:teuthology.orchestra.run.smithi100.stdout:60129542148 2024-08-17T02:45:48.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.719+0000 7f500d000640 1 -- 172.21.15.100:0/9284479 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f50080c87f0 con 0x7f50080ac890 2024-08-17T02:45:48.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.720+0000 7f4ffd600640 1 -- 172.21.15.100:0/9284479 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f50080c87f0 con 0x7f50080ac890 2024-08-17T02:45:48.721 INFO:teuthology.orchestra.run.smithi100.stdout:60129542147 2024-08-17T02:45:48.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.722+0000 7f8016800640 1 -- 172.21.15.100:0/2482478678 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7ff0065150 msgr2=0x7f7ff0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.722+0000 7f8016800640 1 --2- 172.21.15.100:0/2482478678 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7ff0065150 0x7f7ff0067600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc034000 tx=0x7f7ffc032000 comp rx=0 tx=0).stop 2024-08-17T02:45:48.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.722+0000 7f8016800640 1 -- 172.21.15.100:0/2482478678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801006d7a0 msgr2=0x7f80100a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.722+0000 7f8016800640 1 --2- 172.21.15.100:0/2482478678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801006d7a0 0x7f80100a5980 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f800400c590 tx=0x7f8004007ee0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.722+0000 7f8016800640 1 -- 172.21.15.100:0/2482478678 shutdown_connections 2024-08-17T02:45:48.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.722+0000 7fe1f5c00640 1 -- 172.21.15.100:0/3896423493 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe1d00652a0 msgr2=0x7fe1d0067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.722+0000 7fe1f5c00640 1 --2- 172.21.15.100:0/3896423493 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe1d00652a0 0x7fe1d0067750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00ad8a0 tx=0x7fe1e0032000 comp rx=0 tx=0).stop 2024-08-17T02:45:48.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.723+0000 7fe1f5c00640 1 -- 172.21.15.100:0/3896423493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f00b0610 msgr2=0x7fe1f00a54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.723+0000 7fe1f5c00640 1 --2- 172.21.15.100:0/3896423493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f00b0610 0x7fe1f00a54d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00c590 tx=0x7fe1dc007ee0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.722+0000 7f8016800640 1 --2- 172.21.15.100:0/2482478678 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7ff0065150 0x7f7ff0067600 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.723+0000 7f8016800640 1 --2- 172.21.15.100:0/2482478678 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f801015ccc0 0x7f8010179820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.723+0000 7f8016800640 1 --2- 172.21.15.100:0/2482478678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f801006db70 0x7f80100c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.723+0000 7f8016800640 1 --2- 172.21.15.100:0/2482478678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801006d7a0 0x7f80100a5980 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.723+0000 7f8016800640 1 -- 172.21.15.100:0/2482478678 >> 172.21.15.100:0/2482478678 conn(0x7f8010067750 msgr2=0x7f8010160530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:48.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.723+0000 7fe1f5c00640 1 -- 172.21.15.100:0/3896423493 shutdown_connections 2024-08-17T02:45:48.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.723+0000 7fe1f5c00640 1 --2- 172.21.15.100:0/3896423493 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe1d00652a0 0x7fe1d0067750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.723+0000 7fe1f5c00640 1 --2- 172.21.15.100:0/3896423493 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1f015e140 0x7fe1f00a6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.723+0000 7fe1f5c00640 1 --2- 172.21.15.100:0/3896423493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1f015d830 0x7fe1f00a7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.723+0000 7fe1f5c00640 1 --2- 172.21.15.100:0/3896423493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f00b0610 0x7fe1f00a54d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.723+0000 7fe1f5c00640 1 -- 172.21.15.100:0/3896423493 >> 172.21.15.100:0/3896423493 conn(0x7fe1f00cb9b0 msgr2=0x7fe1f015c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:48.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.723+0000 7f500d000640 1 -- 172.21.15.100:0/9284479 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4fe8065220 msgr2=0x7f4fe80676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.723+0000 7f500d000640 1 --2- 172.21.15.100:0/9284479 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4fe8065220 0x7f4fe80676d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f50080895d0 tx=0x7f4ff40090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.723+0000 7f500d000640 1 -- 172.21.15.100:0/9284479 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f50080ac890 msgr2=0x7f50080c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:48.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.723+0000 7f500d000640 1 --2- 172.21.15.100:0/9284479 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f50080ac890 0x7f50080c7850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5000031000 tx=0x7f5000032000 comp rx=0 tx=0).stop 2024-08-17T02:45:48.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.723+0000 7f8016800640 1 -- 172.21.15.100:0/2482478678 shutdown_connections 2024-08-17T02:45:48.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.723+0000 7f8016800640 1 -- 172.21.15.100:0/2482478678 wait complete. 2024-08-17T02:45:48.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.724+0000 7f500d000640 1 -- 172.21.15.100:0/9284479 shutdown_connections 2024-08-17T02:45:48.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.724+0000 7fe1f5c00640 1 -- 172.21.15.100:0/3896423493 shutdown_connections 2024-08-17T02:45:48.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.724+0000 7fe1f5c00640 1 -- 172.21.15.100:0/3896423493 wait complete. 2024-08-17T02:45:48.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.724+0000 7f500d000640 1 --2- 172.21.15.100:0/9284479 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4fe8065220 0x7f4fe80676d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.724+0000 7f500d000640 1 --2- 172.21.15.100:0/9284479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500815d440 0x7f50081825d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.724+0000 7f500d000640 1 --2- 172.21.15.100:0/9284479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50080d0980 0x7f5008182090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.724+0000 7f500d000640 1 --2- 172.21.15.100:0/9284479 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f50080ac890 0x7f50080c7850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:48.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.724+0000 7f500d000640 1 -- 172.21.15.100:0/9284479 >> 172.21.15.100:0/9284479 conn(0x7f50080cfde0 msgr2=0x7f5008068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:48.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.724+0000 7f500d000640 1 -- 172.21.15.100:0/9284479 shutdown_connections 2024-08-17T02:45:48.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:48.724+0000 7f500d000640 1 -- 172.21.15.100:0/9284479 wait complete. 2024-08-17T02:45:48.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.2 2024-08-17T02:45:48.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.6 2024-08-17T02:45:48.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2024-08-17T02:45:48.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.0 2024-08-17T02:45:48.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.7 2024-08-17T02:45:48.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2024-08-17T02:45:48.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.3 2024-08-17T02:45:49.711 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:45:49.731 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:45:49.732 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:45:49.733 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:45:49.736 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:45:49.747 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:45:49.747 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:45:49.747 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:45:49.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.939+0000 7f9086e00640 1 Processor -- start 2024-08-17T02:45:49.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.940+0000 7f9086e00640 1 -- start start 2024-08-17T02:45:49.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.942+0000 7f9086e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9078038b50 0x7f9078038fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:49.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.943+0000 7f907fe00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f90780e2020 0x7f907803aeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.100:37026/0 (socket says 172.21.15.100:37026) 2024-08-17T02:45:49.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.943+0000 7f907fe00640 1 -- 172.21.15.100:0/1953164838 learned_addr learned my addr 172.21.15.100:0/1953164838 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:49.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.943+0000 7f907f400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9078038b50 0x7f9078038fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:49.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.944+0000 7f9086e00640 1 -- 172.21.15.100:0/1953164838 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9078007a30 con 0x7f90780378a0 2024-08-17T02:45:49.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.944+0000 7f9086e00640 1 -- 172.21.15.100:0/1953164838 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9078006e20 con 0x7f90780e2020 2024-08-17T02:45:49.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.944+0000 7f9086e00640 1 -- 172.21.15.100:0/1953164838 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9078039510 con 0x7f9078038b50 2024-08-17T02:45:49.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.945+0000 7f907ea00640 1 -- 172.21.15.100:0/1953164838 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472663311 0 0) 0x7f9078006e20 con 0x7f90780e2020 2024-08-17T02:45:49.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.945+0000 7f907ea00640 1 -- 172.21.15.100:0/1953164838 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90680034e0 con 0x7f90780e2020 2024-08-17T02:45:49.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.945+0000 7f907ea00640 1 -- 172.21.15.100:0/1953164838 <== mon.1 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2163067723 0 0) 0x7f90680034e0 con 0x7f90780e2020 2024-08-17T02:45:49.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.945+0000 7f907ea00640 1 -- 172.21.15.100:0/1953164838 >> v2:172.21.15.123:3300/0 conn(0x7f9078038b50 msgr2=0x7f9078038fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:49.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.946+0000 7f907ea00640 1 --2- 172.21.15.100:0/1953164838 >> v2:172.21.15.123:3300/0 conn(0x7f9078038b50 0x7f9078038fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:49.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.946+0000 7f907ea00640 1 -- 172.21.15.100:0/1953164838 >> v1:172.21.15.100:6789/0 conn(0x7f90780378a0 legacy=0x7f9078037cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:49.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.946+0000 7f907ea00640 1 -- 172.21.15.100:0/1953164838 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9078007100 con 0x7f90780e2020 2024-08-17T02:45:49.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.946+0000 7f907ea00640 1 -- 172.21.15.100:0/1953164838 <== mon.1 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1817143124 0 0) 0x7f906c001470 con 0x7f90780e2020 2024-08-17T02:45:49.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.946+0000 7f907ea00640 1 -- 172.21.15.100:0/1953164838 >> v1:172.21.15.123:6789/0 conn(0x7f90780e2020 legacy=0x7f907803aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:49.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.946+0000 7f907ea00640 1 --2- 172.21.15.100:0/1953164838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90680039d0 0x7f9068003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:49.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.946+0000 7f907ea00640 1 --2- 172.21.15.100:0/1953164838 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9068004780 0x7f9068004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:49.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.946+0000 7f907ea00640 1 --2- 172.21.15.100:0/1953164838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9068005130 0x7f90680141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:49.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.946+0000 7f907ea00640 1 -- 172.21.15.100:0/1953164838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9078039510 con 0x7f9068005130 2024-08-17T02:45:49.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.946+0000 7f907ea00640 1 -- 172.21.15.100:0/1953164838 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90680147d0 con 0x7f90680039d0 2024-08-17T02:45:49.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.946+0000 7f907ea00640 1 -- 172.21.15.100:0/1953164838 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9068014990 con 0x7f9068004780 2024-08-17T02:45:49.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.946+0000 7f907f400640 1 --2- 172.21.15.100:0/1953164838 >> v2:172.21.15.123:3300/0 conn(0x7f9078038b50 0x7f9078038fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:49.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.947+0000 7f907fe00640 1 --2- 172.21.15.100:0/1953164838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90680039d0 0x7f9068003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:49.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.947+0000 7f907f400640 1 --2- 172.21.15.100:0/1953164838 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9068004780 0x7f9068004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:49.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.947+0000 7f907fe00640 1 -- 172.21.15.100:0/1953164838 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9068004780 msgr2=0x7f9068004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:49.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.947+0000 7f907fe00640 1 --2- 172.21.15.100:0/1953164838 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9068004780 0x7f9068004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:49.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.947+0000 7f907fe00640 1 -- 172.21.15.100:0/1953164838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9068005130 msgr2=0x7f90680141e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:45:49.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.948+0000 7f9084e00640 1 --2- 172.21.15.100:0/1953164838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9068005130 0x7f90680141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:49.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.948+0000 7f907fe00640 1 --2- 172.21.15.100:0/1953164838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9068005130 0x7f90680141e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:49.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.948+0000 7f907fe00640 1 -- 172.21.15.100:0/1953164838 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9078007100 con 0x7f90680039d0 2024-08-17T02:45:49.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.949+0000 7f9084e00640 1 --2- 172.21.15.100:0/1953164838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9068005130 0x7f90680141e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:45:49.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.949+0000 7f9084e00640 1 -- 172.21.15.100:0/1953164838 reap_dead start 2024-08-17T02:45:49.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.950+0000 7f907fe00640 1 --2- 172.21.15.100:0/1953164838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90680039d0 0x7f9068003da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f906c01d420 tx=0x7f906c0078b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc8cdea096a78c23 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:49.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.951+0000 7f907ea00640 1 -- 172.21.15.100:0/1953164838 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c03d040 con 0x7f90680039d0 2024-08-17T02:45:49.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.951+0000 7f907ea00640 1 -- 172.21.15.100:0/1953164838 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c005890 con 0x7f90680039d0 2024-08-17T02:45:49.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.951+0000 7f907ea00640 1 -- 172.21.15.100:0/1953164838 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c005c70 con 0x7f90680039d0 2024-08-17T02:45:49.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.952+0000 7f9086e00640 1 -- 172.21.15.100:0/1953164838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90680039d0 msgr2=0x7f9068003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:49.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.952+0000 7f9086e00640 1 --2- 172.21.15.100:0/1953164838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90680039d0 0x7f9068003da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f906c01d420 tx=0x7f906c0078b0 comp rx=0 tx=0).stop 2024-08-17T02:45:49.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.952+0000 7f9086e00640 1 -- 172.21.15.100:0/1953164838 shutdown_connections 2024-08-17T02:45:49.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.952+0000 7f9086e00640 1 --2- 172.21.15.100:0/1953164838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90680039d0 0x7f9068003da0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:49.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.952+0000 7f9086e00640 1 -- 172.21.15.100:0/1953164838 >> 172.21.15.100:0/1953164838 conn(0x7f907800f050 msgr2=0x7f9078058f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:49.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.952+0000 7f9086e00640 1 -- 172.21.15.100:0/1953164838 shutdown_connections 2024-08-17T02:45:49.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.953+0000 7f9086e00640 1 -- 172.21.15.100:0/1953164838 wait complete. 2024-08-17T02:45:49.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.955+0000 7f9086e00640 1 Processor -- start 2024-08-17T02:45:49.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.955+0000 7f9086e00640 1 -- start start 2024-08-17T02:45:49.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.957+0000 7f9086e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90680039d0 0x7f907804c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:49.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.957+0000 7f9086e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f907804ef30 0x7f90780df330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:49.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.957+0000 7f9086e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90780dfd40 0x7f90780e0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:49.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.958+0000 7f9084e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90780dfd40 0x7f90780e0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:49.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.958+0000 7f9084e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90780dfd40 0x7f90780e0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33160/0 (socket says 172.21.15.100:33160) 2024-08-17T02:45:49.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.958+0000 7f907fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90680039d0 0x7f907804c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:49.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.958+0000 7f907fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90680039d0 0x7f907804c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:52874/0 (socket says 172.21.15.100:52874) 2024-08-17T02:45:49.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.959+0000 7f907f400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f907804ef30 0x7f90780df330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:49.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.959+0000 7f9084e00640 1 -- 172.21.15.100:0/3066096897 learned_addr learned my addr 172.21.15.100:0/3066096897 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:49.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.959+0000 7f9086e00640 1 -- 172.21.15.100:0/3066096897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90780e06d0 con 0x7f90780dfd40 2024-08-17T02:45:49.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.959+0000 7f9086e00640 1 -- 172.21.15.100:0/3066096897 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907804d020 con 0x7f90680039d0 2024-08-17T02:45:49.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.959+0000 7f9086e00640 1 -- 172.21.15.100:0/3066096897 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907804d300 con 0x7f907804ef30 2024-08-17T02:45:49.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.960+0000 7f907f400640 1 -- 172.21.15.100:0/3066096897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90680039d0 msgr2=0x7f907804c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:49.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.960+0000 7f907f400640 1 --2- 172.21.15.100:0/3066096897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90680039d0 0x7f907804c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:49.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.960+0000 7f907f400640 1 -- 172.21.15.100:0/3066096897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90780dfd40 msgr2=0x7f90780e0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:49.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.961+0000 7f907f400640 1 --2- 172.21.15.100:0/3066096897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90780dfd40 0x7f90780e0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:49.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.961+0000 7f907f400640 1 -- 172.21.15.100:0/3066096897 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907804d5e0 con 0x7f907804ef30 2024-08-17T02:45:49.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.961+0000 7f9084e00640 1 --2- 172.21.15.100:0/3066096897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90780dfd40 0x7f90780e0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:49.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.962+0000 7f907f400640 1 --2- 172.21.15.100:0/3066096897 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f907804ef30 0x7f90780df330 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9074011990 tx=0x7f9074008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:49.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.963+0000 7f9073400640 1 -- 172.21.15.100:0/3066096897 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9074011e60 con 0x7f907804ef30 2024-08-17T02:45:49.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.963+0000 7f9073400640 1 -- 172.21.15.100:0/3066096897 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907400f9d0 con 0x7f907804ef30 2024-08-17T02:45:49.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.963+0000 7f9086e00640 1 -- 172.21.15.100:0/3066096897 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907804d8c0 con 0x7f907804ef30 2024-08-17T02:45:49.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.963+0000 7f9086e00640 1 -- 172.21.15.100:0/3066096897 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907804f380 con 0x7f907804ef30 2024-08-17T02:45:49.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.965+0000 7f9073400640 1 -- 172.21.15.100:0/3066096897 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907400fd90 con 0x7f907804ef30 2024-08-17T02:45:49.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.968+0000 7f9086e00640 1 -- 172.21.15.100:0/3066096897 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9078005770 con 0x7f907804ef30 2024-08-17T02:45:49.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.969+0000 7f9073400640 1 -- 172.21.15.100:0/3066096897 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9074015670 con 0x7f907804ef30 2024-08-17T02:45:49.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.970+0000 7f9073400640 1 --2- 172.21.15.100:0/3066096897 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9060065200 0x7f90600676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:49.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.970+0000 7f9073400640 1 -- 172.21.15.100:0/3066096897 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9074082790 con 0x7f907804ef30 2024-08-17T02:45:49.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.974+0000 7f907fe00640 1 --2- 172.21.15.100:0/3066096897 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9060065200 0x7f90600676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:49.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.975+0000 7f907fe00640 1 --2- 172.21.15.100:0/3066096897 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9060065200 0x7f90600676b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f906c044000 tx=0x7f906c047000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:49.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:49.980+0000 7f9073400640 1 -- 172.21.15.100:0/3066096897 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9074019080 con 0x7f907804ef30 2024-08-17T02:45:50.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.019+0000 7fe386400640 1 Processor -- start 2024-08-17T02:45:50.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.020+0000 7fe386400640 1 -- start start 2024-08-17T02:45:50.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.021+0000 7fe386400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe3800ceb40 0x7fe3800cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.021+0000 7fe386400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe3800ccad0 0x7fe380162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.022+0000 7fe386400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3800cadc0 con 0x7fe380159ca0 2024-08-17T02:45:50.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.022+0000 7fe386400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3800cd6e0 con 0x7fe3800ccad0 2024-08-17T02:45:50.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.022+0000 7fe386400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800ccf70 con 0x7fe3800ceb40 2024-08-17T02:45:50.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.022+0000 7fe385000640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe380159ca0 0x7fe3800ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.100:37030/0 (socket says 172.21.15.100:37030) 2024-08-17T02:45:50.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.022+0000 7fe385000640 1 -- 172.21.15.100:0/156921536 learned_addr learned my addr 172.21.15.100:0/156921536 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:50.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.022+0000 7fe385a00640 1 --2- 172.21.15.100:0/156921536 >> v2:172.21.15.100:3300/0 conn(0x7fe3800ccad0 0x7fe380162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.023+0000 7fe37f400640 1 -- 172.21.15.100:0/156921536 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289477191 0 0) 0x7fe3800cadc0 con 0x7fe380159ca0 2024-08-17T02:45:50.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.023+0000 7fe37f400640 1 -- 172.21.15.100:0/156921536 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3640034e0 con 0x7fe380159ca0 2024-08-17T02:45:50.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.023+0000 7fe385a00640 1 -- 172.21.15.100:0/156921536 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe3800ceb40 msgr2=0x7fe3800cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:50.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.023+0000 7fe385a00640 1 --2- 172.21.15.100:0/156921536 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe3800ceb40 0x7fe3800cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.023+0000 7fe385a00640 1 -- 172.21.15.100:0/156921536 >> v1:172.21.15.123:6789/0 conn(0x7fe380159ca0 legacy=0x7fe3800ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.023+0000 7fe385a00640 1 -- 172.21.15.100:0/156921536 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3800cb060 con 0x7fe3800ccad0 2024-08-17T02:45:50.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.024+0000 7f4c32200640 1 Processor -- start 2024-08-17T02:45:50.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.024+0000 7f9665c00640 1 Processor -- start 2024-08-17T02:45:50.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.025+0000 7fe385a00640 1 --2- 172.21.15.100:0/156921536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3800ccad0 0x7fe380162860 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009850 tx=0x7fe36c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef37440cedd01a45 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.025+0000 7f4c32200640 1 -- start start 2024-08-17T02:45:50.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.025+0000 7fe37f400640 1 -- 172.21.15.100:0/156921536 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c02ad90 con 0x7fe3800ccad0 2024-08-17T02:45:50.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.026+0000 7fe37f400640 1 -- 172.21.15.100:0/156921536 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c032440 con 0x7fe3800ccad0 2024-08-17T02:45:50.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.026+0000 7fe37f400640 1 -- 172.21.15.100:0/156921536 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c02ad90 con 0x7fe3800ccad0 2024-08-17T02:45:50.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.027+0000 7fe386400640 1 -- 172.21.15.100:0/156921536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3800ccad0 msgr2=0x7fe380162860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.027+0000 7fe386400640 1 --2- 172.21.15.100:0/156921536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3800ccad0 0x7fe380162860 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009850 tx=0x7fe36c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.027+0000 7f4c32200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4c2c0c6a30 0x7f4c2c0cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.027+0000 7f4c32200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4c2c159430 0x7f4c2c0c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.027+0000 7f4c32200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c2c0cbf40 con 0x7f4c2c159060 2024-08-17T02:45:50.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.027+0000 7f4c32200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2c0cb930 con 0x7f4c2c159430 2024-08-17T02:45:50.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.027+0000 7f4c32200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2c0ced10 con 0x7f4c2c0c6a30 2024-08-17T02:45:50.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.027+0000 7fe386400640 1 -- 172.21.15.100:0/156921536 shutdown_connections 2024-08-17T02:45:50.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.027+0000 7fe386400640 1 --2- 172.21.15.100:0/156921536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3800ccad0 0x7fe380162860 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.027+0000 7fe386400640 1 --2- 172.21.15.100:0/156921536 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe3800ceb40 0x7fe3800cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.027+0000 7fe386400640 1 -- 172.21.15.100:0/156921536 >> 172.21.15.100:0/156921536 conn(0x7fe380098e00 msgr2=0x7fe38006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:50.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.027+0000 7f4c2b400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4c2c159060 0x7f4c2c0cabc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.100:37060/0 (socket says 172.21.15.100:37060) 2024-08-17T02:45:50.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.027+0000 7f4c2be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4c2c159430 0x7f4c2c0c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.027+0000 7f4c2b400640 1 -- 172.21.15.100:0/1050601124 learned_addr learned my addr 172.21.15.100:0/1050601124 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:50.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.024+0000 7f9665c00640 1 -- start start 2024-08-17T02:45:50.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.026+0000 7f9665c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9660156130 0x7f96601565a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.026+0000 7f9665c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96600af7c0 0x7f96600afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.027+0000 7f9665c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9660159900 con 0x7f9660152960 2024-08-17T02:45:50.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.027+0000 7f9665c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96601590e0 con 0x7f9660156130 2024-08-17T02:45:50.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.027+0000 7f9665c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96600b0100 con 0x7f96600af7c0 2024-08-17T02:45:50.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.028+0000 7f4c2a000640 1 -- 172.21.15.100:0/1050601124 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546197726 0 0) 0x7f4c2c0cbf40 con 0x7f4c2c159060 2024-08-17T02:45:50.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.028+0000 7f4c2be00640 1 -- 172.21.15.100:0/1050601124 >> v2:172.21.15.123:3300/0 conn(0x7f4c2c0c6a30 msgr2=0x7f4c2c0cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:50.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.028+0000 7f4c2aa00640 1 --2- 172.21.15.100:0/1050601124 >> v2:172.21.15.123:3300/0 conn(0x7f4c2c0c6a30 0x7f4c2c0cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.028+0000 7fe386400640 1 -- 172.21.15.100:0/156921536 shutdown_connections 2024-08-17T02:45:50.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.028+0000 7f9665200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96600af7c0 0x7f96600afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.028+0000 7f965fe00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9660152960 0x7f96601589d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.100:37044/0 (socket says 172.21.15.100:37044) 2024-08-17T02:45:50.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.028+0000 7f9665200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96600af7c0 0x7f96600afbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:33078/0 (socket says 172.21.15.100:33078) 2024-08-17T02:45:50.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.028+0000 7f965fe00640 1 -- 172.21.15.100:0/3749902743 learned_addr learned my addr 172.21.15.100:0/3749902743 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:50.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.028+0000 7f4c2be00640 1 --2- 172.21.15.100:0/1050601124 >> v2:172.21.15.123:3300/0 conn(0x7f4c2c0c6a30 0x7f4c2c0cb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.028+0000 7f965f400640 1 --2- 172.21.15.100:0/3749902743 >> v2:172.21.15.100:3300/0 conn(0x7f9660156130 0x7f96601565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.028+0000 7f4c2be00640 1 -- 172.21.15.100:0/1050601124 >> v1:172.21.15.123:6789/0 conn(0x7f4c2c159060 legacy=0x7f4c2c0cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.028+0000 7f4c2be00640 1 -- 172.21.15.100:0/1050601124 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c0cbbd0 con 0x7f4c2c159430 2024-08-17T02:45:50.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.028+0000 7fe386400640 1 -- 172.21.15.100:0/156921536 wait complete. 2024-08-17T02:45:50.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.029+0000 7f9665200640 1 -- 172.21.15.100:0/3749902743 >> v2:172.21.15.100:3300/0 conn(0x7f9660156130 msgr2=0x7f96601565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.029+0000 7f9665200640 1 --2- 172.21.15.100:0/3749902743 >> v2:172.21.15.100:3300/0 conn(0x7f9660156130 0x7f96601565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.029+0000 7f9665200640 1 -- 172.21.15.100:0/3749902743 >> v1:172.21.15.123:6789/0 conn(0x7f9660152960 legacy=0x7f96601589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.029+0000 7f9665200640 1 -- 172.21.15.100:0/3749902743 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9660159340 con 0x7f96600af7c0 2024-08-17T02:45:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.029+0000 7f965f400640 1 --2- 172.21.15.100:0/3749902743 >> v2:172.21.15.100:3300/0 conn(0x7f9660156130 0x7f96601565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.031+0000 7fe386400640 1 Processor -- start 2024-08-17T02:45:50.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.031+0000 7f4c2be00640 1 --2- 172.21.15.100:0/1050601124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c2c159430 0x7f4c2c0c6e90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0b5de0 tx=0x7f4c1c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94b812852ee2c87 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.031+0000 7f9665200640 1 --2- 172.21.15.100:0/3749902743 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96600af7c0 0x7f96600afbc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f96580060f0 tx=0x7f9658007ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f95ef9532f0d9e91 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.031+0000 7fe386400640 1 -- start start 2024-08-17T02:45:50.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.032+0000 7f4c2a000640 1 -- 172.21.15.100:0/1050601124 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c02ad20 con 0x7f4c2c159430 2024-08-17T02:45:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.032+0000 7f4c2a000640 1 -- 172.21.15.100:0/1050601124 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c02ae80 con 0x7f4c2c159430 2024-08-17T02:45:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.032+0000 7f4c2a000640 1 -- 172.21.15.100:0/1050601124 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c032670 con 0x7f4c2c159430 2024-08-17T02:45:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.032+0000 7f965ea00640 1 -- 172.21.15.100:0/3749902743 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965802f510 con 0x7f96600af7c0 2024-08-17T02:45:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.032+0000 7f965ea00640 1 -- 172.21.15.100:0/3749902743 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965802d050 con 0x7f96600af7c0 2024-08-17T02:45:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.032+0000 7fe386400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3800ccad0 0x7fe3801510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.032+0000 7fe386400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe3800ceb40 0x7fe3801547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.032+0000 7fe386400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe380159ca0 0x7fe3800b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.032+0000 7fe386400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38015c3c0 con 0x7fe3800ccad0 2024-08-17T02:45:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.032+0000 7fe386400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38015c6a0 con 0x7fe380159ca0 2024-08-17T02:45:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.032+0000 7fe386400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38015c980 con 0x7fe3800ceb40 2024-08-17T02:45:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.033+0000 7f965ea00640 1 -- 172.21.15.100:0/3749902743 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965802f8a0 con 0x7f96600af7c0 2024-08-17T02:45:50.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.033+0000 7f4c32200640 1 -- 172.21.15.100:0/1050601124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c2c159430 msgr2=0x7f4c2c0c6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.033+0000 7f618a600640 1 Processor -- start 2024-08-17T02:45:50.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.033+0000 7fe385000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3800ccad0 0x7fe3801510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.033+0000 7fe37fe00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe3800ceb40 0x7fe3801547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.033+0000 7fe37fe00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe3800ceb40 0x7fe3801547f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:33090/0 (socket says 172.21.15.100:33090) 2024-08-17T02:45:50.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.033+0000 7fe37fe00640 1 -- 172.21.15.100:0/2555816916 learned_addr learned my addr 172.21.15.100:0/2555816916 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:50.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.033+0000 7fe385a00640 1 --2- 172.21.15.100:0/2555816916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe380159ca0 0x7fe3800b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.033+0000 7f4c32200640 1 --2- 172.21.15.100:0/1050601124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c2c159430 0x7f4c2c0c6e90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0b5de0 tx=0x7f4c1c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.034+0000 7f9665c00640 1 -- 172.21.15.100:0/3749902743 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96600af7c0 msgr2=0x7f96600afbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.034+0000 7f4c32200640 1 -- 172.21.15.100:0/1050601124 shutdown_connections 2024-08-17T02:45:50.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.034+0000 7f4c32200640 1 --2- 172.21.15.100:0/1050601124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c2c159430 0x7f4c2c0c6e90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.034+0000 7f4c32200640 1 --2- 172.21.15.100:0/1050601124 >> v2:172.21.15.123:3300/0 conn(0x7f4c2c0c6a30 0x7f4c2c0cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.034+0000 7f4c32200640 1 -- 172.21.15.100:0/1050601124 >> 172.21.15.100:0/1050601124 conn(0x7f4c2c0cfde0 msgr2=0x7f4c2c0d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:50.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.034+0000 7f9665c00640 1 --2- 172.21.15.100:0/3749902743 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96600af7c0 0x7f96600afbc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f96580060f0 tx=0x7f9658007ca0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.034+0000 7fe385000640 1 -- 172.21.15.100:0/2555816916 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe3800ceb40 msgr2=0x7fe3801547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.034+0000 7fe385000640 1 --2- 172.21.15.100:0/2555816916 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe3800ceb40 0x7fe3801547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.034+0000 7fe385000640 1 -- 172.21.15.100:0/2555816916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe380159ca0 msgr2=0x7fe3800b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.034+0000 7fe385000640 1 --2- 172.21.15.100:0/2555816916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe380159ca0 0x7fe3800b3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.034+0000 7fe385000640 1 -- 172.21.15.100:0/2555816916 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c009390 con 0x7fe3800ccad0 2024-08-17T02:45:50.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.034+0000 7f4c32200640 1 -- 172.21.15.100:0/1050601124 shutdown_connections 2024-08-17T02:45:50.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.035+0000 7f4c32200640 1 -- 172.21.15.100:0/1050601124 wait complete. 2024-08-17T02:45:50.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.035+0000 7f9665c00640 1 -- 172.21.15.100:0/3749902743 shutdown_connections 2024-08-17T02:45:50.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.035+0000 7f9665c00640 1 --2- 172.21.15.100:0/3749902743 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96600af7c0 0x7f96600afbc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.035+0000 7f9665c00640 1 --2- 172.21.15.100:0/3749902743 >> v2:172.21.15.100:3300/0 conn(0x7f9660156130 0x7f96601565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.035+0000 7f9665c00640 1 -- 172.21.15.100:0/3749902743 >> 172.21.15.100:0/3749902743 conn(0x7f96600cb790 msgr2=0x7f96600cbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:50.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.034+0000 7f618a600640 1 -- start start 2024-08-17T02:45:50.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.035+0000 7fe385000640 1 --2- 172.21.15.100:0/2555816916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3800ccad0 0x7fe3801510d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe37800cb90 tx=0x7fe3780019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.035+0000 7f9665c00640 1 -- 172.21.15.100:0/3749902743 shutdown_connections 2024-08-17T02:45:50.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.035+0000 7fe377e00640 1 -- 172.21.15.100:0/2555816916 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37800a640 con 0x7fe3800ccad0 2024-08-17T02:45:50.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.036+0000 7fe377e00640 1 -- 172.21.15.100:0/2555816916 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37800a7c0 con 0x7fe3800ccad0 2024-08-17T02:45:50.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.036+0000 7fe377e00640 1 -- 172.21.15.100:0/2555816916 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37800abc0 con 0x7fe3800ccad0 2024-08-17T02:45:50.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.036+0000 7fe386400640 1 -- 172.21.15.100:0/2555816916 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38015cc60 con 0x7fe3800ccad0 2024-08-17T02:45:50.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.036+0000 7f618a600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6184159ca0 0x7f61840ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.036+0000 7fe386400640 1 -- 172.21.15.100:0/2555816916 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38015c0b0 con 0x7fe3800ccad0 2024-08-17T02:45:50.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.036+0000 7f618a600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f61840ca8a0 0x7f61840cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.036+0000 7f618a600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61840cadc0 con 0x7f61840ccad0 2024-08-17T02:45:50.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.036+0000 7f618a600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61840cd6e0 con 0x7f6184159ca0 2024-08-17T02:45:50.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.036+0000 7f618a600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61840ccf70 con 0x7f61840ca8a0 2024-08-17T02:45:50.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.036+0000 7f6189200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6184159ca0 0x7f61840ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.037+0000 7f6189200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6184159ca0 0x7f61840ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:52898/0 (socket says 172.21.15.100:52898) 2024-08-17T02:45:50.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.037+0000 7f6189200640 1 -- 172.21.15.100:0/3283195163 learned_addr learned my addr 172.21.15.100:0/3283195163 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:50.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.037+0000 7f9665c00640 1 -- 172.21.15.100:0/3749902743 wait complete. 2024-08-17T02:45:50.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.037+0000 7f4c32200640 1 Processor -- start 2024-08-17T02:45:50.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.037+0000 7f4c32200640 1 -- start start 2024-08-17T02:45:50.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.037+0000 7f6189200640 1 -- 172.21.15.100:0/3283195163 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f61840ca8a0 msgr2=0x7f61840cc590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:45:50.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.038+0000 7f6189200640 1 --2- 172.21.15.100:0/3283195163 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f61840ca8a0 0x7f61840cc590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.038+0000 7f6189200640 1 -- 172.21.15.100:0/3283195163 >> v1:172.21.15.100:6789/0 conn(0x7f61840ccad0 legacy=0x7f61840cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:50.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.038+0000 7f6189200640 1 -- 172.21.15.100:0/3283195163 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61840cb060 con 0x7f6184159ca0 2024-08-17T02:45:50.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.038+0000 7fe386400640 1 -- 172.21.15.100:0/2555816916 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe380071050 con 0x7fe3800ccad0 2024-08-17T02:45:50.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.038+0000 7f4c32200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c2c0c6a30 0x7f4c2c152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.039+0000 7f4c32200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c2c159060 0x7f4c2c157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.039+0000 7f4c32200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c2c159430 0x7f4c2c157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.039+0000 7f4c32200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c0b5a70 con 0x7f4c2c0c6a30 2024-08-17T02:45:50.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.039+0000 7f4c32200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c09a460 con 0x7f4c2c159060 2024-08-17T02:45:50.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.039+0000 7f4c32200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c099b30 con 0x7f4c2c159430 2024-08-17T02:45:50.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.039+0000 7f4c2b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c2c0c6a30 0x7f4c2c152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.039+0000 7f4c2b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c2c0c6a30 0x7f4c2c152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33212/0 (socket says 172.21.15.100:33212) 2024-08-17T02:45:50.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.039+0000 7f4c2b400640 1 -- 172.21.15.100:0/3289232181 learned_addr learned my addr 172.21.15.100:0/3289232181 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:50.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.039+0000 7f9665c00640 1 Processor -- start 2024-08-17T02:45:50.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.039+0000 7f9665c00640 1 -- start start 2024-08-17T02:45:50.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.039+0000 7f7c8be00640 1 Processor -- start 2024-08-17T02:45:50.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.039+0000 7f7c8be00640 1 -- start start 2024-08-17T02:45:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.040+0000 7fe377e00640 1 -- 172.21.15.100:0/2555816916 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe3780070f0 con 0x7fe3800ccad0 2024-08-17T02:45:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.039+0000 7f4c2be00640 1 --2- 172.21.15.100:0/3289232181 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c2c159430 0x7f4c2c157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.039+0000 7f4c2aa00640 1 --2- 172.21.15.100:0/3289232181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c2c159060 0x7f4c2c157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.040+0000 7f4c2be00640 1 -- 172.21.15.100:0/3289232181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c2c159060 msgr2=0x7f4c2c157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.040+0000 7f4c2be00640 1 --2- 172.21.15.100:0/3289232181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c2c159060 0x7f4c2c157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.040+0000 7f4c2be00640 1 -- 172.21.15.100:0/3289232181 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c2c0c6a30 msgr2=0x7f4c2c152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.040+0000 7f4c2be00640 1 --2- 172.21.15.100:0/3289232181 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c2c0c6a30 0x7f4c2c152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.040+0000 7f4c2be00640 1 -- 172.21.15.100:0/3289232181 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c009390 con 0x7f4c2c159430 2024-08-17T02:45:50.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.040+0000 7f6189200640 1 --2- 172.21.15.100:0/3283195163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6184159ca0 0x7f61840ca360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6174009910 tx=0x7f61740091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95c0de14fb6714a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.041+0000 7f9665c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96600af7c0 0x7f966014e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.041+0000 7f9665c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9660152960 0x7f966006cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.041+0000 7f9665c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9660156130 0x7f96600c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.041+0000 7f9665c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9660153150 con 0x7f9660152960 2024-08-17T02:45:50.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.041+0000 7f6183e00640 1 -- 172.21.15.100:0/3283195163 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617402add0 con 0x7f6184159ca0 2024-08-17T02:45:50.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.041+0000 7f6183e00640 1 -- 172.21.15.100:0/3283195163 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6174032440 con 0x7f6184159ca0 2024-08-17T02:45:50.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.041+0000 7f6183e00640 1 -- 172.21.15.100:0/3283195163 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174032820 con 0x7f6184159ca0 2024-08-17T02:45:50.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.041+0000 7f9665c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966014e9a0 con 0x7f9660156130 2024-08-17T02:45:50.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.041+0000 7f9665c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966006d7c0 con 0x7f96600af7c0 2024-08-17T02:45:50.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.040+0000 7f4c2be00640 1 --2- 172.21.15.100:0/3289232181 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c2c159430 0x7f4c2c157940 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c031000 tx=0x7f4c1c032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.041+0000 7f965fe00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96600af7c0 0x7f966014e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.041+0000 7fe377e00640 1 --2- 172.21.15.100:0/2555816916 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe3600652d0 0x7fe360067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.041+0000 7fe377e00640 1 -- 172.21.15.100:0/2555816916 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe378082520 con 0x7fe3800ccad0 2024-08-17T02:45:50.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.041+0000 7f965fe00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96600af7c0 0x7f966014e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:33116/0 (socket says 172.21.15.100:33116) 2024-08-17T02:45:50.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.041+0000 7f965fe00640 1 -- 172.21.15.100:0/1602193257 learned_addr learned my addr 172.21.15.100:0/1602193257 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:50.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.041+0000 7f9665200640 1 --2- 172.21.15.100:0/1602193257 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9660156130 0x7f96600c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.041+0000 7f4c22a00640 1 -- 172.21.15.100:0/3289232181 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c031a60 con 0x7f4c2c159430 2024-08-17T02:45:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.042+0000 7f4c22a00640 1 -- 172.21.15.100:0/3289232181 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c031bc0 con 0x7f4c2c159430 2024-08-17T02:45:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.042+0000 7f4c22a00640 1 -- 172.21.15.100:0/3289232181 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c03d480 con 0x7f4c2c159430 2024-08-17T02:45:50.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.042+0000 7f4c32200640 1 -- 172.21.15.100:0/3289232181 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c2c099e10 con 0x7f4c2c159430 2024-08-17T02:45:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.042+0000 7f965f400640 1 --2- 172.21.15.100:0/1602193257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9660152960 0x7f966006cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.042+0000 7f965fe00640 1 -- 172.21.15.100:0/1602193257 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9660156130 msgr2=0x7f96600c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.042+0000 7f965fe00640 1 --2- 172.21.15.100:0/1602193257 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9660156130 0x7f96600c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.042+0000 7f965fe00640 1 -- 172.21.15.100:0/1602193257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9660152960 msgr2=0x7f966006cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.042+0000 7f965fe00640 1 --2- 172.21.15.100:0/1602193257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9660152960 0x7f966006cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.042+0000 7f7c89400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7c84158ce0 0x7f7c840cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.100:37074/0 (socket says 172.21.15.100:37074) 2024-08-17T02:45:50.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.042+0000 7f7c89400640 1 -- 172.21.15.100:0/901465686 learned_addr learned my addr 172.21.15.100:0/901465686 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.042+0000 7f965fe00640 1 -- 172.21.15.100:0/1602193257 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964c009390 con 0x7f96600af7c0 2024-08-17T02:45:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.042+0000 7f7c8be00640 1 --2- 172.21.15.100:0/901465686 >> v2:172.21.15.100:3300/0 conn(0x7f7c840d08d0 0x7f7c840c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.042+0000 7f618a600640 1 -- 172.21.15.100:0/3283195163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6184159ca0 msgr2=0x7f61840ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.042+0000 7f618a600640 1 --2- 172.21.15.100:0/3283195163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6184159ca0 0x7f61840ca360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6174009910 tx=0x7f61740091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.043+0000 7f7c8be00640 1 -- 172.21.15.100:0/901465686 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c840cb7c0 con 0x7f7c840cb340 2024-08-17T02:45:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.043+0000 7f7c8be00640 1 -- 172.21.15.100:0/901465686 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c840ceb20 con 0x7f7c84158ce0 2024-08-17T02:45:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.043+0000 7f965f400640 1 --2- 172.21.15.100:0/1602193257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9660152960 0x7f966006cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:45:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.043+0000 7f7c8be00640 1 -- 172.21.15.100:0/901465686 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c840cf0c0 con 0x7f7c840d08d0 2024-08-17T02:45:50.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.043+0000 7f7c88a00640 1 --2- 172.21.15.100:0/901465686 >> v2:172.21.15.100:3300/0 conn(0x7f7c840d08d0 0x7f7c840c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.043+0000 7f1927200640 1 Processor -- start 2024-08-17T02:45:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.043+0000 7f9665200640 1 --2- 172.21.15.100:0/1602193257 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9660156130 0x7f96600c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:50.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.043+0000 7f1927200640 1 -- start start 2024-08-17T02:45:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.043+0000 7f7c83e00640 1 -- 172.21.15.100:0/901465686 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479901772 0 0) 0x7f7c840ceb20 con 0x7f7c84158ce0 2024-08-17T02:45:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.043+0000 7f7c83e00640 1 -- 172.21.15.100:0/901465686 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c6c0034e0 con 0x7f7c84158ce0 2024-08-17T02:45:50.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.043+0000 7f965fe00640 1 --2- 172.21.15.100:0/1602193257 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96600af7c0 0x7f966014e460 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f965000c810 tx=0x7f9650007f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.044+0000 7f7c83e00640 1 -- 172.21.15.100:0/901465686 <== mon.1 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3949486522 0 0) 0x7f7c6c0034e0 con 0x7f7c84158ce0 2024-08-17T02:45:50.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.044+0000 7f7c83e00640 1 -- 172.21.15.100:0/901465686 >> v2:172.21.15.100:3300/0 conn(0x7f7c840d08d0 msgr2=0x7f7c840c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:50.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.044+0000 7f4c32200640 1 -- 172.21.15.100:0/3289232181 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2c1526b0 con 0x7f4c2c159430 2024-08-17T02:45:50.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.044+0000 7f7c83e00640 1 --2- 172.21.15.100:0/901465686 >> v2:172.21.15.100:3300/0 conn(0x7f7c840d08d0 0x7f7c840c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.044+0000 7f7c83e00640 1 -- 172.21.15.100:0/901465686 >> v1:172.21.15.100:6789/0 conn(0x7f7c840cb340 legacy=0x7f7c840c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:50.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.044+0000 7f7c83e00640 1 -- 172.21.15.100:0/901465686 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c840cede0 con 0x7f7c84158ce0 2024-08-17T02:45:50.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.044+0000 7f7c88a00640 1 --2- 172.21.15.100:0/901465686 >> v2:172.21.15.100:3300/0 conn(0x7f7c840d08d0 0x7f7c840c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:50.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.044+0000 7f9657400640 1 -- 172.21.15.100:0/1602193257 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500058b0 con 0x7f96600af7c0 2024-08-17T02:45:50.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.044+0000 7f9665c00640 1 -- 172.21.15.100:0/1602193257 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9658005cf0 con 0x7f96600af7c0 2024-08-17T02:45:50.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.044+0000 7f7c83e00640 1 -- 172.21.15.100:0/901465686 <== mon.1 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1817143124 0 0) 0x7f7c78001470 con 0x7f7c84158ce0 2024-08-17T02:45:50.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.044+0000 7f7c83e00640 1 -- 172.21.15.100:0/901465686 >> v1:172.21.15.123:6789/0 conn(0x7f7c84158ce0 legacy=0x7f7c840cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.044+0000 7f7c83e00640 1 --2- 172.21.15.100:0/901465686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c6c003aa0 0x7f7c6c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.044+0000 7f7c83e00640 1 --2- 172.21.15.100:0/901465686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c6c004780 0x7f7c6c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.044+0000 7f7c83e00640 1 --2- 172.21.15.100:0/901465686 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7c6c005330 0x7f7c6c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.044+0000 7f7c83e00640 1 -- 172.21.15.100:0/901465686 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c840cf0c0 con 0x7f7c6c004780 2024-08-17T02:45:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.044+0000 7f7c83e00640 1 -- 172.21.15.100:0/901465686 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c00c1a0 con 0x7f7c6c003aa0 2024-08-17T02:45:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.044+0000 7f7c83e00640 1 -- 172.21.15.100:0/901465686 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c00c360 con 0x7f7c6c005330 2024-08-17T02:45:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.044+0000 7f9665c00640 1 -- 172.21.15.100:0/1602193257 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966006dd80 con 0x7f96600af7c0 2024-08-17T02:45:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.044+0000 7f9657400640 1 -- 172.21.15.100:0/1602193257 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9650005a10 con 0x7f96600af7c0 2024-08-17T02:45:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.044+0000 7f9657400640 1 -- 172.21.15.100:0/1602193257 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500058b0 con 0x7f96600af7c0 2024-08-17T02:45:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.045+0000 7f1927200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1928158c80 0x7f19280ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.045+0000 7f1927200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f19280cd700 0x7f19280cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.045+0000 7f1927200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19280cf9d0 con 0x7f19280cc800 2024-08-17T02:45:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.045+0000 7f1927200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19280ceb60 con 0x7f19280cd700 2024-08-17T02:45:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.045+0000 7f1927200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19280cedc0 con 0x7f1928158c80 2024-08-17T02:45:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.045+0000 7f7c89400640 1 --2- 172.21.15.100:0/901465686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c6c003aa0 0x7f7c6c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.045+0000 7f7c88a00640 1 --2- 172.21.15.100:0/901465686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c6c004780 0x7f7c6c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.045+0000 7f1925e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1928158c80 0x7f19280ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.045+0000 7f1925e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1928158c80 0x7f19280ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:33128/0 (socket says 172.21.15.100:33128) 2024-08-17T02:45:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.045+0000 7f1925e00640 1 -- 172.21.15.100:0/1827911074 learned_addr learned my addr 172.21.15.100:0/1827911074 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:50.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.045+0000 7f1925400640 1 --2- 172.21.15.100:0/1827911074 >> v2:172.21.15.123:3300/0 conn(0x7f19280cd700 0x7f19280cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.046+0000 7f1925e00640 1 -- 172.21.15.100:0/1827911074 >> v2:172.21.15.123:3300/0 conn(0x7f19280cd700 msgr2=0x7f19280cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.046+0000 7f7c89400640 1 -- 172.21.15.100:0/901465686 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7c6c005330 msgr2=0x7f7c6c00b9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:45:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.046+0000 7f7c89400640 1 --2- 172.21.15.100:0/901465686 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7c6c005330 0x7f7c6c00b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.046+0000 7f7c89400640 1 -- 172.21.15.100:0/901465686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c6c004780 msgr2=0x7f7c6c004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.046+0000 7f7c89400640 1 --2- 172.21.15.100:0/901465686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c6c004780 0x7f7c6c004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.046+0000 7f7c89400640 1 -- 172.21.15.100:0/901465686 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c0034e0 con 0x7f7c6c003aa0 2024-08-17T02:45:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.046+0000 7fe37fe00640 1 --2- 172.21.15.100:0/2555816916 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe3600652d0 0x7fe360067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.047+0000 7fe37fe00640 1 --2- 172.21.15.100:0/2555816916 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe3600652d0 0x7fe360067780 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe380154400 tx=0x7fe3700091d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.047+0000 7f7c89e00640 1 -- 172.21.15.100:0/901465686 reap_dead start 2024-08-17T02:45:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.047+0000 7f618a600640 1 -- 172.21.15.100:0/3283195163 shutdown_connections 2024-08-17T02:45:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.047+0000 7f618a600640 1 --2- 172.21.15.100:0/3283195163 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f61840ca8a0 0x7f61840cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.047+0000 7f618a600640 1 --2- 172.21.15.100:0/3283195163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6184159ca0 0x7f61840ca360 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.047+0000 7f618a600640 1 -- 172.21.15.100:0/3283195163 >> 172.21.15.100:0/3283195163 conn(0x7f6184098e00 msgr2=0x7f618406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.048+0000 7f618a600640 1 -- 172.21.15.100:0/3283195163 shutdown_connections 2024-08-17T02:45:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.048+0000 7f618a600640 1 -- 172.21.15.100:0/3283195163 wait complete. 2024-08-17T02:45:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.048+0000 7f7c89400640 1 --2- 172.21.15.100:0/901465686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c6c003aa0 0x7f7c6c003e90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7c78001eb0 tx=0x7f7c840cbcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=322630c309fe981b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.046+0000 7f1925e00640 1 --2- 172.21.15.100:0/1827911074 >> v2:172.21.15.123:3300/0 conn(0x7f19280cd700 0x7f19280cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.047+0000 7f4c22a00640 1 -- 172.21.15.100:0/3289232181 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4c1c039040 con 0x7f4c2c159430 2024-08-17T02:45:50.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.047+0000 7f4c32200640 1 -- 172.21.15.100:0/3289232181 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2c09a5d0 con 0x7f4c2c159430 2024-08-17T02:45:50.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.048+0000 7f4c22a00640 1 --2- 172.21.15.100:0/3289232181 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4c0c065220 0x7f4c0c0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.048+0000 7fe377e00640 1 -- 172.21.15.100:0/2555816916 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe378050700 con 0x7fe3800ccad0 2024-08-17T02:45:50.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.049+0000 7f4c22a00640 1 -- 172.21.15.100:0/3289232181 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4c1c074330 con 0x7f4c2c159430 2024-08-17T02:45:50.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.049+0000 7f9657400640 1 -- 172.21.15.100:0/1602193257 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f96500070f0 con 0x7f96600af7c0 2024-08-17T02:45:50.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.049+0000 7f9665c00640 1 -- 172.21.15.100:0/1602193257 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9638005210 con 0x7f96600af7c0 2024-08-17T02:45:50.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.046+0000 7f1925e00640 1 -- 172.21.15.100:0/1827911074 >> v1:172.21.15.100:6789/0 conn(0x7f19280cc800 legacy=0x7f19280ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:50.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.046+0000 7f1925e00640 1 -- 172.21.15.100:0/1827911074 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19280cf0a0 con 0x7f1928158c80 2024-08-17T02:45:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.049+0000 7f7c83e00640 1 -- 172.21.15.100:0/901465686 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78005890 con 0x7f7c6c003aa0 2024-08-17T02:45:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.049+0000 7f7c83e00640 1 -- 172.21.15.100:0/901465686 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7802d070 con 0x7f7c6c003aa0 2024-08-17T02:45:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.049+0000 7f7c83e00640 1 -- 172.21.15.100:0/901465686 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78005ab0 con 0x7f7c6c003aa0 2024-08-17T02:45:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.049+0000 7f1925e00640 1 --2- 172.21.15.100:0/1827911074 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1928158c80 0x7f19280ce620 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1918009910 tx=0x7f19180091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=834922c45ff0aadd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.049+0000 7f4c2b400640 1 --2- 172.21.15.100:0/3289232181 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4c0c065220 0x7f4c0c0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.050+0000 7f618a600640 1 Processor -- start 2024-08-17T02:45:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.050+0000 7f9657400640 1 --2- 172.21.15.100:0/1602193257 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f96400651b0 0x7f9640067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.050+0000 7f618a600640 1 -- start start 2024-08-17T02:45:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.050+0000 7f7c8be00640 1 -- 172.21.15.100:0/901465686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c6c003aa0 msgr2=0x7f7c6c003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.050+0000 7f7c8be00640 1 --2- 172.21.15.100:0/901465686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c6c003aa0 0x7f7c6c003e90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7c78001eb0 tx=0x7f7c840cbcf0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.050+0000 7f9657400640 1 -- 172.21.15.100:0/1602193257 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9650081bf0 con 0x7f96600af7c0 2024-08-17T02:45:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.051+0000 7f7c8be00640 1 -- 172.21.15.100:0/901465686 shutdown_connections 2024-08-17T02:45:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.051+0000 7f7c8be00640 1 --2- 172.21.15.100:0/901465686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c6c003aa0 0x7f7c6c003e90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.051+0000 7f7c8be00640 1 -- 172.21.15.100:0/901465686 >> 172.21.15.100:0/901465686 conn(0x7f7c840cfdc0 msgr2=0x7f7c840d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.051+0000 7f7c8be00640 1 -- 172.21.15.100:0/901465686 shutdown_connections 2024-08-17T02:45:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.051+0000 7f7c8be00640 1 -- 172.21.15.100:0/901465686 wait complete. 2024-08-17T02:45:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.051+0000 7f965f400640 1 --2- 172.21.15.100:0/1602193257 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f96400651b0 0x7f9640067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.052+0000 7f4c2b400640 1 --2- 172.21.15.100:0/3289232181 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4c0c065220 0x7f4c0c0676d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4c24002250 tx=0x7f4c24009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.052+0000 7f618a600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61840ca8a0 0x7f61840c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.052+0000 7f618a600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61840ccad0 0x7f618409b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.052+0000 7f618a600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6184159ca0 0x7f618409bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.052+0000 7f618a600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618409c3e0 con 0x7f61840ccad0 2024-08-17T02:45:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.052+0000 7f618a600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618409c6c0 con 0x7f61840ca8a0 2024-08-17T02:45:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.052+0000 7f618a600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618409c9a0 con 0x7f6184159ca0 2024-08-17T02:45:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.052+0000 7f965f400640 1 --2- 172.21.15.100:0/1602193257 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f96400651b0 0x7f9640067660 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f964c009360 tx=0x7f964c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.052+0000 7f617be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61840ccad0 0x7f618409b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.052+0000 7f6189200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61840ca8a0 0x7f61840c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.052+0000 7f6189200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61840ca8a0 0x7f61840c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:52942/0 (socket says 172.21.15.100:52942) 2024-08-17T02:45:50.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.052+0000 7f6189200640 1 -- 172.21.15.100:0/1933864374 learned_addr learned my addr 172.21.15.100:0/1933864374 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:50.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.052+0000 7f6189c00640 1 --2- 172.21.15.100:0/1933864374 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6184159ca0 0x7f618409bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.053+0000 7f7c8be00640 1 Processor -- start 2024-08-17T02:45:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.053+0000 7f6189c00640 1 -- 172.21.15.100:0/1933864374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61840ca8a0 msgr2=0x7f61840c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.053+0000 7f6189c00640 1 --2- 172.21.15.100:0/1933864374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61840ca8a0 0x7f61840c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.053+0000 7f6189c00640 1 -- 172.21.15.100:0/1933864374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61840ccad0 msgr2=0x7f618409b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.053+0000 7f6189c00640 1 --2- 172.21.15.100:0/1933864374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61840ccad0 0x7f618409b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.053+0000 7f6189c00640 1 -- 172.21.15.100:0/1933864374 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6174009450 con 0x7f6184159ca0 2024-08-17T02:45:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.053+0000 7f7c8be00640 1 -- start start 2024-08-17T02:45:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.053+0000 7fea75c00640 1 Processor -- start 2024-08-17T02:45:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.054+0000 7f6189c00640 1 --2- 172.21.15.100:0/1933864374 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6184159ca0 0x7f618409bbb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f617c00c810 tx=0x7f617c002580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.054+0000 7fea75c00640 1 -- start start 2024-08-17T02:45:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.054+0000 7f4c22a00640 1 -- 172.21.15.100:0/3289232181 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4c1c070670 con 0x7f4c2c159430 2024-08-17T02:45:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.054+0000 7f7c8be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c6c003aa0 0x7f7c840b5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.055+0000 7f7c8be00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7c84154fd0 0x7f7c841546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.055+0000 7f7c89400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c6c003aa0 0x7f7c840b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.055+0000 7f7c8be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c8415b480 0x7f7c8415b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.055+0000 7f7c8be00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8415a770 con 0x7f7c6c003aa0 2024-08-17T02:45:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.055+0000 7f7c8be00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8415be30 con 0x7f7c8415b480 2024-08-17T02:45:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.055+0000 7f7c8be00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c84155860 con 0x7f7c84154fd0 2024-08-17T02:45:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.055+0000 7f7c89400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c6c003aa0 0x7f7c840b5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33242/0 (socket says 172.21.15.100:33242) 2024-08-17T02:45:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.055+0000 7f7c89400640 1 -- 172.21.15.100:0/3401967848 learned_addr learned my addr 172.21.15.100:0/3401967848 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.055+0000 7f7c89e00640 1 --2- 172.21.15.100:0/3401967848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c8415b480 0x7f7c8415b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.055+0000 7f7c88a00640 1 --2- 172.21.15.100:0/3401967848 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7c84154fd0 0x7f7c841546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.056+0000 7f7c89400640 1 -- 172.21.15.100:0/3401967848 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7c84154fd0 msgr2=0x7f7c841546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.056+0000 7f7c89400640 1 --2- 172.21.15.100:0/3401967848 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7c84154fd0 0x7f7c841546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.056+0000 7f7c89400640 1 -- 172.21.15.100:0/3401967848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c8415b480 msgr2=0x7f7c8415b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.056+0000 7f7c89400640 1 --2- 172.21.15.100:0/3401967848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c8415b480 0x7f7c8415b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.056+0000 7f7c89400640 1 -- 172.21.15.100:0/3401967848 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c84159b60 con 0x7f7c6c003aa0 2024-08-17T02:45:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.056+0000 7fea75c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fea70159ca0 0x7fea700ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.056+0000 7fea75c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fea700ca8a0 0x7fea700cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.056+0000 7fea6fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fea70159ca0 0x7fea700ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.056+0000 7fea75c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea700cadc0 con 0x7fea700ccad0 2024-08-17T02:45:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.056+0000 7fea75c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea700cd6e0 con 0x7fea70159ca0 2024-08-17T02:45:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.056+0000 7fea75c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea700ccf70 con 0x7fea700ca8a0 2024-08-17T02:45:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.056+0000 7fea6fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fea70159ca0 0x7fea700ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33244/0 (socket says 172.21.15.100:33244) 2024-08-17T02:45:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.056+0000 7fea6fe00640 1 -- 172.21.15.100:0/220236322 learned_addr learned my addr 172.21.15.100:0/220236322 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.056+0000 7fea6f400640 1 --2- 172.21.15.100:0/220236322 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fea700ca8a0 0x7fea700cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.056+0000 7fea6fe00640 1 -- 172.21.15.100:0/220236322 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fea700ca8a0 msgr2=0x7fea700cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.056+0000 7fea6fe00640 1 --2- 172.21.15.100:0/220236322 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fea700ca8a0 0x7fea700cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.057+0000 7fea6fe00640 1 -- 172.21.15.100:0/220236322 >> v1:172.21.15.123:6789/0 conn(0x7fea700ccad0 legacy=0x7fea700cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.057+0000 7fea6fe00640 1 -- 172.21.15.100:0/220236322 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea700cb060 con 0x7fea70159ca0 2024-08-17T02:45:50.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.057+0000 7f7c89400640 1 --2- 172.21.15.100:0/3401967848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c6c003aa0 0x7f7c840b5680 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7c7800c210 tx=0x7f7c78033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.057+0000 7f7c80c00640 1 -- 172.21.15.100:0/3401967848 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78005a10 con 0x7f7c6c003aa0 2024-08-17T02:45:50.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.057+0000 7f7c80c00640 1 -- 172.21.15.100:0/3401967848 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c78032430 con 0x7f7c6c003aa0 2024-08-17T02:45:50.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.057+0000 7f7c80c00640 1 -- 172.21.15.100:0/3401967848 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78005b70 con 0x7f7c6c003aa0 2024-08-17T02:45:50.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.057+0000 7f7c8be00640 1 -- 172.21.15.100:0/3401967848 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c84159e40 con 0x7f7c6c003aa0 2024-08-17T02:45:50.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.057+0000 7f7c8be00640 1 -- 172.21.15.100:0/3401967848 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c8415a400 con 0x7f7c6c003aa0 2024-08-17T02:45:50.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.058+0000 7f6180c00640 1 -- 172.21.15.100:0/1933864374 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c00a640 con 0x7f6184159ca0 2024-08-17T02:45:50.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.057+0000 7fea6f400640 1 --2- 172.21.15.100:0/220236322 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fea700ca8a0 0x7fea700cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:45:50.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.058+0000 7f6180c00640 1 -- 172.21.15.100:0/1933864374 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617c00a7c0 con 0x7f6184159ca0 2024-08-17T02:45:50.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.058+0000 7f6180c00640 1 -- 172.21.15.100:0/1933864374 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c00ab80 con 0x7f6184159ca0 2024-08-17T02:45:50.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.059+0000 7f1924a00640 1 -- 172.21.15.100:0/1827911074 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191802ad30 con 0x7f1928158c80 2024-08-17T02:45:50.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.059+0000 7f1924a00640 1 -- 172.21.15.100:0/1827911074 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191802ae90 con 0x7f1928158c80 2024-08-17T02:45:50.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.059+0000 7f1924a00640 1 -- 172.21.15.100:0/1827911074 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1918032670 con 0x7f1928158c80 2024-08-17T02:45:50.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.059+0000 7f7c8be00640 1 -- 172.21.15.100:0/3401967848 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c84064db0 con 0x7f7c6c003aa0 2024-08-17T02:45:50.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.059+0000 7f9657400640 1 -- 172.21.15.100:0/1602193257 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f965004fd50 con 0x7f96600af7c0 2024-08-17T02:45:50.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.059+0000 7f618a600640 1 -- 172.21.15.100:0/1933864374 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618409cc80 con 0x7f6184159ca0 2024-08-17T02:45:50.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.059+0000 7f618a600640 1 -- 172.21.15.100:0/1933864374 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f618409c0f0 con 0x7f6184159ca0 2024-08-17T02:45:50.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.059+0000 7fea6fe00640 1 --2- 172.21.15.100:0/220236322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea70159ca0 0x7fea700ca360 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fea60009910 tx=0x7fea600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7398df0f2456e627 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.060+0000 7f1927200640 1 -- 172.21.15.100:0/1827911074 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1928158c80 msgr2=0x7f19280ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.060+0000 7f1927200640 1 --2- 172.21.15.100:0/1827911074 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1928158c80 0x7f19280ce620 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1918009910 tx=0x7f19180091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.060+0000 7f1927200640 1 -- 172.21.15.100:0/1827911074 shutdown_connections 2024-08-17T02:45:50.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.060+0000 7f1927200640 1 --2- 172.21.15.100:0/1827911074 >> v2:172.21.15.123:3300/0 conn(0x7f19280cd700 0x7f19280cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.060+0000 7f1927200640 1 --2- 172.21.15.100:0/1827911074 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1928158c80 0x7f19280ce620 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.060+0000 7f1927200640 1 -- 172.21.15.100:0/1827911074 >> 172.21.15.100:0/1827911074 conn(0x7f1928098e30 msgr2=0x7f192806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:50.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.060+0000 7fea6ea00640 1 -- 172.21.15.100:0/220236322 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6002ae40 con 0x7fea70159ca0 2024-08-17T02:45:50.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.060+0000 7fea6ea00640 1 -- 172.21.15.100:0/220236322 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea60032440 con 0x7fea70159ca0 2024-08-17T02:45:50.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.060+0000 7fea6ea00640 1 -- 172.21.15.100:0/220236322 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea60032820 con 0x7fea70159ca0 2024-08-17T02:45:50.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.061+0000 7f618a600640 1 -- 172.21.15.100:0/1933864374 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f618409d160 con 0x7f6184159ca0 2024-08-17T02:45:50.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.061+0000 7f7c80c00640 1 -- 172.21.15.100:0/3401967848 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7c7802f030 con 0x7f7c6c003aa0 2024-08-17T02:45:50.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.061+0000 7fea75c00640 1 -- 172.21.15.100:0/220236322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea70159ca0 msgr2=0x7fea700ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.061+0000 7fea75c00640 1 --2- 172.21.15.100:0/220236322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea70159ca0 0x7fea700ca360 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fea60009910 tx=0x7fea600091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.061+0000 7fea75c00640 1 -- 172.21.15.100:0/220236322 shutdown_connections 2024-08-17T02:45:50.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.061+0000 7fea75c00640 1 --2- 172.21.15.100:0/220236322 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fea700ca8a0 0x7fea700cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.061+0000 7fea75c00640 1 --2- 172.21.15.100:0/220236322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea70159ca0 0x7fea700ca360 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.061+0000 7fea75c00640 1 -- 172.21.15.100:0/220236322 >> 172.21.15.100:0/220236322 conn(0x7fea70098e00 msgr2=0x7fea7006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:50.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.062+0000 7fea75c00640 1 -- 172.21.15.100:0/220236322 shutdown_connections 2024-08-17T02:45:50.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.062+0000 7fea75c00640 1 -- 172.21.15.100:0/220236322 wait complete. 2024-08-17T02:45:50.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.062+0000 7f7c80c00640 1 --2- 172.21.15.100:0/3401967848 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7c64065180 0x7f7c64067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.063+0000 7f7c80c00640 1 -- 172.21.15.100:0/3401967848 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7c780a2e60 con 0x7f7c6c003aa0 2024-08-17T02:45:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.060+0000 7f1927200640 1 -- 172.21.15.100:0/1827911074 shutdown_connections 2024-08-17T02:45:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.060+0000 7f1927200640 1 -- 172.21.15.100:0/1827911074 wait complete. 2024-08-17T02:45:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.062+0000 7f1927200640 1 Processor -- start 2024-08-17T02:45:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.062+0000 7f1927200640 1 -- start start 2024-08-17T02:45:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.064+0000 7f7c88a00640 1 --2- 172.21.15.100:0/3401967848 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7c64065180 0x7f7c64067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.064+0000 7fea75c00640 1 Processor -- start 2024-08-17T02:45:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.063+0000 7f1927200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f19280cc800 0x7f1928087880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.063+0000 7f1927200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19280cd700 0x7f19280c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.064+0000 7fea75c00640 1 -- start start 2024-08-17T02:45:50.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.063+0000 7f1927200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1928158c80 0x7f19280b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.064+0000 7f1927200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1928156d70 con 0x7f1928158c80 2024-08-17T02:45:50.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.064+0000 7f1927200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192815c2d0 con 0x7f19280cd700 2024-08-17T02:45:50.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.064+0000 7f1927200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1928157010 con 0x7f19280cc800 2024-08-17T02:45:50.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.065+0000 7f7c88a00640 1 --2- 172.21.15.100:0/3401967848 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7c64065180 0x7f7c64067630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7c8409ddd0 tx=0x7f7c70008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.066+0000 7fea75c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fea700ca8a0 0x7fea700c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.066+0000 7fea75c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea700ccad0 0x7fea700ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.066+0000 7fea75c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea700cef00 0x7fea70168ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.066+0000 7f1926800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1928158c80 0x7f19280b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.066+0000 7f1925e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f19280cc800 0x7f1928087880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.066+0000 7f1925e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f19280cc800 0x7f1928087880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:33168/0 (socket says 172.21.15.100:33168) 2024-08-17T02:45:50.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.066+0000 7f1925e00640 1 -- 172.21.15.100:0/1603790734 learned_addr learned my addr 172.21.15.100:0/1603790734 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:50.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.066+0000 7fea75c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea70069160 con 0x7fea700ccad0 2024-08-17T02:45:50.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.066+0000 7fea75c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea700cf370 con 0x7fea700cef00 2024-08-17T02:45:50.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.066+0000 7fea75c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea70068e80 con 0x7fea700ca8a0 2024-08-17T02:45:50.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.067+0000 7fea6fe00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fea700ca8a0 0x7fea700c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.067+0000 7fea75200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea700cef00 0x7fea70168ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.067+0000 7fea75200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea700cef00 0x7fea70168ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:52956/0 (socket says 172.21.15.100:52956) 2024-08-17T02:45:50.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.067+0000 7fea75200640 1 -- 172.21.15.100:0/3831588598 learned_addr learned my addr 172.21.15.100:0/3831588598 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:50.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.067+0000 7f1925e00640 1 -- 172.21.15.100:0/1603790734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19280cd700 msgr2=0x7f19280c6010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:45:50.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.067+0000 7fea75200640 1 -- 172.21.15.100:0/3831588598 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fea700ca8a0 msgr2=0x7fea700c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.067+0000 7fea75200640 1 --2- 172.21.15.100:0/3831588598 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fea700ca8a0 0x7fea700c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.067+0000 7fea75200640 1 -- 172.21.15.100:0/3831588598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea700ccad0 msgr2=0x7fea700ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.067+0000 7fea75200640 1 --2- 172.21.15.100:0/3831588598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea700ccad0 0x7fea700ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.067+0000 7fea75200640 1 -- 172.21.15.100:0/3831588598 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea60009450 con 0x7fea700cef00 2024-08-17T02:45:50.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.067+0000 7f1925e00640 1 --2- 172.21.15.100:0/1603790734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19280cd700 0x7f19280c6010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.067+0000 7f1925e00640 1 -- 172.21.15.100:0/1603790734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1928158c80 msgr2=0x7f19280b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.067+0000 7f1925e00640 1 --2- 172.21.15.100:0/1603790734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1928158c80 0x7f19280b06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.068+0000 7fea75200640 1 --2- 172.21.15.100:0/3831588598 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea700cef00 0x7fea70168ae0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fea6800c7c0 tx=0x7fea68001590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.068+0000 7fea6fe00640 1 --2- 172.21.15.100:0/3831588598 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fea700ca8a0 0x7fea700c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:50.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.067+0000 7f1925e00640 1 -- 172.21.15.100:0/1603790734 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1918009450 con 0x7f19280cc800 2024-08-17T02:45:50.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.068+0000 7fea67400640 1 -- 172.21.15.100:0/3831588598 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6800a5e0 con 0x7fea700cef00 2024-08-17T02:45:50.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.068+0000 7fea67400640 1 -- 172.21.15.100:0/3831588598 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6800a780 con 0x7fea700cef00 2024-08-17T02:45:50.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.068+0000 7fea75c00640 1 -- 172.21.15.100:0/3831588598 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea70169dc0 con 0x7fea700cef00 2024-08-17T02:45:50.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.068+0000 7f1925e00640 1 --2- 172.21.15.100:0/1603790734 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f19280cc800 0x7f1928087880 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1918035040 tx=0x7f1918032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.068+0000 7f191d600640 1 -- 172.21.15.100:0/1603790734 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191803b6e0 con 0x7f19280cc800 2024-08-17T02:45:50.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.068+0000 7f191d600640 1 -- 172.21.15.100:0/1603790734 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191803b880 con 0x7f19280cc800 2024-08-17T02:45:50.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.068+0000 7f191d600640 1 -- 172.21.15.100:0/1603790734 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191803bc40 con 0x7f19280cc800 2024-08-17T02:45:50.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.069+0000 7f1927200640 1 -- 172.21.15.100:0/1603790734 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19281572f0 con 0x7f19280cc800 2024-08-17T02:45:50.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.069+0000 7f1927200640 1 -- 172.21.15.100:0/1603790734 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19281578b0 con 0x7f19280cc800 2024-08-17T02:45:50.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.070+0000 7f7c80c00640 1 -- 172.21.15.100:0/3401967848 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7c78070fd0 con 0x7f7c6c003aa0 2024-08-17T02:45:50.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.068+0000 7fea67400640 1 -- 172.21.15.100:0/3831588598 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6800ab40 con 0x7fea700cef00 2024-08-17T02:45:50.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.068+0000 7fea75c00640 1 -- 172.21.15.100:0/3831588598 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7016a380 con 0x7fea700cef00 2024-08-17T02:45:50.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.070+0000 7fea75c00640 1 -- 172.21.15.100:0/3831588598 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea7016a570 con 0x7fea700cef00 2024-08-17T02:45:50.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.071+0000 7f1927200640 1 -- 172.21.15.100:0/1603790734 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1900005210 con 0x7f19280cc800 2024-08-17T02:45:50.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.071+0000 7f6180c00640 1 -- 172.21.15.100:0/1933864374 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f617c012420 con 0x7f6184159ca0 2024-08-17T02:45:50.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.072+0000 7f6180c00640 1 --2- 172.21.15.100:0/1933864374 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6160065150 0x7f6160067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.072+0000 7f6180c00640 1 -- 172.21.15.100:0/1933864374 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f617c0825f0 con 0x7f6184159ca0 2024-08-17T02:45:50.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.073+0000 7f6189200640 1 --2- 172.21.15.100:0/1933864374 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6160065150 0x7f6160067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.072+0000 7fea67400640 1 -- 172.21.15.100:0/3831588598 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fea68003030 con 0x7fea700cef00 2024-08-17T02:45:50.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.072+0000 7fea67400640 1 --2- 172.21.15.100:0/3831588598 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fea50065150 0x7fea50067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.073+0000 7fea67400640 1 -- 172.21.15.100:0/3831588598 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea68082370 con 0x7fea700cef00 2024-08-17T02:45:50.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.073+0000 7fea6fe00640 1 --2- 172.21.15.100:0/3831588598 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fea50065150 0x7fea50067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.076+0000 7fea6fe00640 1 --2- 172.21.15.100:0/3831588598 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fea50065150 0x7fea50067600 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fea60034000 tx=0x7fea60032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.076+0000 7f6189200640 1 --2- 172.21.15.100:0/1933864374 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6160065150 0x7f6160067600 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6174000e50 tx=0x7f6174032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.074+0000 7f191d600640 1 -- 172.21.15.100:0/1603790734 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1918043030 con 0x7f19280cc800 2024-08-17T02:45:50.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.075+0000 7f191d600640 1 --2- 172.21.15.100:0/1603790734 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f19080652a0 0x7f1908067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.075+0000 7f191d600640 1 -- 172.21.15.100:0/1603790734 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1918041070 con 0x7f19280cc800 2024-08-17T02:45:50.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.076+0000 7f6180c00640 1 -- 172.21.15.100:0/1933864374 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f617c050760 con 0x7f6184159ca0 2024-08-17T02:45:50.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.076+0000 7f1925400640 1 --2- 172.21.15.100:0/1603790734 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f19080652a0 0x7f1908067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.077+0000 7fea67400640 1 -- 172.21.15.100:0/3831588598 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fea68050390 con 0x7fea700cef00 2024-08-17T02:45:50.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.077+0000 7f1925400640 1 --2- 172.21.15.100:0/1603790734 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f19080652a0 0x7f1908067750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f19280b1d00 tx=0x7f19140090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.080+0000 7f191d600640 1 -- 172.21.15.100:0/1603790734 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1918070a20 con 0x7f19280cc800 2024-08-17T02:45:50.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.385+0000 7f9086e00640 1 -- 172.21.15.100:0/3066096897 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9078038620 con 0x7f907804ef30 2024-08-17T02:45:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.386+0000 7f9073400640 1 -- 172.21.15.100:0/3066096897 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9074023020 con 0x7f907804ef30 2024-08-17T02:45:50.388 INFO:teuthology.orchestra.run.smithi100.stdout:60129542148 2024-08-17T02:45:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.390+0000 7f9086e00640 1 -- 172.21.15.100:0/3066096897 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9060065200 msgr2=0x7f90600676b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.390+0000 7f9086e00640 1 --2- 172.21.15.100:0/3066096897 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9060065200 0x7f90600676b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f906c044000 tx=0x7f906c047000 comp rx=0 tx=0).stop 2024-08-17T02:45:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.390+0000 7f9086e00640 1 -- 172.21.15.100:0/3066096897 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f907804ef30 msgr2=0x7f90780df330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.390+0000 7f9086e00640 1 --2- 172.21.15.100:0/3066096897 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f907804ef30 0x7f90780df330 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9074011990 tx=0x7f9074008040 comp rx=0 tx=0).stop 2024-08-17T02:45:50.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.391+0000 7f9086e00640 1 -- 172.21.15.100:0/3066096897 shutdown_connections 2024-08-17T02:45:50.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.391+0000 7f9086e00640 1 --2- 172.21.15.100:0/3066096897 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9060065200 0x7f90600676b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.391+0000 7f9086e00640 1 --2- 172.21.15.100:0/3066096897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90780dfd40 0x7f90780e0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.391+0000 7f9086e00640 1 --2- 172.21.15.100:0/3066096897 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f907804ef30 0x7f90780df330 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.391+0000 7f9086e00640 1 --2- 172.21.15.100:0/3066096897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90680039d0 0x7f907804c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.392+0000 7f9086e00640 1 -- 172.21.15.100:0/3066096897 >> 172.21.15.100:0/3066096897 conn(0x7f907800f050 msgr2=0x7f907803db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.392+0000 7f9086e00640 1 -- 172.21.15.100:0/3066096897 shutdown_connections 2024-08-17T02:45:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.392+0000 7f9086e00640 1 -- 172.21.15.100:0/3066096897 wait complete. 2024-08-17T02:45:50.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2024-08-17T02:45:50.419 DEBUG:teuthology.parallel:result is None 2024-08-17T02:45:50.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.436+0000 7f4c32200640 1 -- 172.21.15.100:0/3289232181 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4c2c063d20 con 0x7f4c2c159430 2024-08-17T02:45:50.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.436+0000 7f4c22a00640 1 -- 172.21.15.100:0/3289232181 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4c1c041020 con 0x7f4c2c159430 2024-08-17T02:45:50.437 INFO:teuthology.orchestra.run.smithi100.stdout:60129542148 2024-08-17T02:45:50.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.439+0000 7f4c32200640 1 -- 172.21.15.100:0/3289232181 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4c0c065220 msgr2=0x7f4c0c0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.439+0000 7f4c32200640 1 --2- 172.21.15.100:0/3289232181 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4c0c065220 0x7f4c0c0676d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4c24002250 tx=0x7f4c24009040 comp rx=0 tx=0).stop 2024-08-17T02:45:50.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.439+0000 7f4c32200640 1 -- 172.21.15.100:0/3289232181 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c2c159430 msgr2=0x7f4c2c157940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.439+0000 7f4c32200640 1 --2- 172.21.15.100:0/3289232181 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c2c159430 0x7f4c2c157940 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c031000 tx=0x7f4c1c032000 comp rx=0 tx=0).stop 2024-08-17T02:45:50.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.439+0000 7f4c32200640 1 -- 172.21.15.100:0/3289232181 shutdown_connections 2024-08-17T02:45:50.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.439+0000 7f4c32200640 1 --2- 172.21.15.100:0/3289232181 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4c0c065220 0x7f4c0c0676d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.439+0000 7f4c32200640 1 --2- 172.21.15.100:0/3289232181 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c2c159430 0x7f4c2c157940 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.439+0000 7f4c32200640 1 --2- 172.21.15.100:0/3289232181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c2c159060 0x7f4c2c157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.439+0000 7f4c32200640 1 --2- 172.21.15.100:0/3289232181 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c2c0c6a30 0x7f4c2c152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.439+0000 7f4c32200640 1 -- 172.21.15.100:0/3289232181 >> 172.21.15.100:0/3289232181 conn(0x7f4c2c0cfde0 msgr2=0x7f4c2c155880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:50.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.439+0000 7f4c32200640 1 -- 172.21.15.100:0/3289232181 shutdown_connections 2024-08-17T02:45:50.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.440+0000 7f4c32200640 1 -- 172.21.15.100:0/3289232181 wait complete. 2024-08-17T02:45:50.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.6 2024-08-17T02:45:50.456 DEBUG:teuthology.parallel:result is None 2024-08-17T02:45:50.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.464+0000 7fe386400640 1 -- 172.21.15.100:0/2555816916 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe380062f80 con 0x7fe3800ccad0 2024-08-17T02:45:50.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.464+0000 7fe377e00640 1 -- 172.21.15.100:0/2555816916 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe378053d20 con 0x7fe3800ccad0 2024-08-17T02:45:50.465 INFO:teuthology.orchestra.run.smithi100.stdout:60129542148 2024-08-17T02:45:50.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.465+0000 7f9665c00640 1 -- 172.21.15.100:0/1602193257 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f96380054c0 con 0x7f96600af7c0 2024-08-17T02:45:50.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.465+0000 7f9657400640 1 -- 172.21.15.100:0/1602193257 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9650053370 con 0x7f96600af7c0 2024-08-17T02:45:50.466 INFO:teuthology.orchestra.run.smithi100.stdout:60129542149 2024-08-17T02:45:50.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.467+0000 7fe386400640 1 -- 172.21.15.100:0/2555816916 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe3600652d0 msgr2=0x7fe360067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.467+0000 7fe386400640 1 --2- 172.21.15.100:0/2555816916 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe3600652d0 0x7fe360067780 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe380154400 tx=0x7fe3700091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.467+0000 7fe386400640 1 -- 172.21.15.100:0/2555816916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3800ccad0 msgr2=0x7fe3801510d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.467+0000 7fe386400640 1 --2- 172.21.15.100:0/2555816916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3800ccad0 0x7fe3801510d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe37800cb90 tx=0x7fe3780019c0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.467+0000 7fe386400640 1 -- 172.21.15.100:0/2555816916 shutdown_connections 2024-08-17T02:45:50.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.467+0000 7fe386400640 1 --2- 172.21.15.100:0/2555816916 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe3600652d0 0x7fe360067780 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.467+0000 7fe386400640 1 --2- 172.21.15.100:0/2555816916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe380159ca0 0x7fe3800b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.467+0000 7fe386400640 1 --2- 172.21.15.100:0/2555816916 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe3800ceb40 0x7fe3801547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.467+0000 7fe386400640 1 --2- 172.21.15.100:0/2555816916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3800ccad0 0x7fe3801510d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.467+0000 7fe386400640 1 -- 172.21.15.100:0/2555816916 >> 172.21.15.100:0/2555816916 conn(0x7fe380098e00 msgr2=0x7fe380156e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:50.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.467+0000 7fe386400640 1 -- 172.21.15.100:0/2555816916 shutdown_connections 2024-08-17T02:45:50.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.467+0000 7fe386400640 1 -- 172.21.15.100:0/2555816916 wait complete. 2024-08-17T02:45:50.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.469+0000 7f9665c00640 1 -- 172.21.15.100:0/1602193257 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f96400651b0 msgr2=0x7f9640067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.469+0000 7f9665c00640 1 --2- 172.21.15.100:0/1602193257 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f96400651b0 0x7f9640067660 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f964c009360 tx=0x7f964c008040 comp rx=0 tx=0).stop 2024-08-17T02:45:50.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.469+0000 7f9665c00640 1 -- 172.21.15.100:0/1602193257 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96600af7c0 msgr2=0x7f966014e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.469+0000 7f9665c00640 1 --2- 172.21.15.100:0/1602193257 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96600af7c0 0x7f966014e460 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f965000c810 tx=0x7f9650007f90 comp rx=0 tx=0).stop 2024-08-17T02:45:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.470+0000 7f9665c00640 1 -- 172.21.15.100:0/1602193257 shutdown_connections 2024-08-17T02:45:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.470+0000 7f9665c00640 1 --2- 172.21.15.100:0/1602193257 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f96400651b0 0x7f9640067660 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.470+0000 7f9665c00640 1 --2- 172.21.15.100:0/1602193257 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9660156130 0x7f96600c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.470+0000 7f9665c00640 1 --2- 172.21.15.100:0/1602193257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9660152960 0x7f966006cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.470+0000 7f9665c00640 1 --2- 172.21.15.100:0/1602193257 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96600af7c0 0x7f966014e460 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.470+0000 7f9665c00640 1 -- 172.21.15.100:0/1602193257 >> 172.21.15.100:0/1602193257 conn(0x7f96600cb790 msgr2=0x7f9660155440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.470+0000 7f9665c00640 1 -- 172.21.15.100:0/1602193257 shutdown_connections 2024-08-17T02:45:50.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.470+0000 7f9665c00640 1 -- 172.21.15.100:0/1602193257 wait complete. 2024-08-17T02:45:50.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.480+0000 7f7c8be00640 1 -- 172.21.15.100:0/3401967848 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7c84064db0 con 0x7f7c6c003aa0 2024-08-17T02:45:50.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.480+0000 7f7c80c00640 1 -- 172.21.15.100:0/3401967848 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7c780745f0 con 0x7f7c6c003aa0 2024-08-17T02:45:50.481 INFO:teuthology.orchestra.run.smithi100.stdout:60129542148 2024-08-17T02:45:50.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.481+0000 7fea75c00640 1 -- 172.21.15.100:0/3831588598 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fea70071050 con 0x7fea700cef00 2024-08-17T02:45:50.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.482+0000 7fea67400640 1 -- 172.21.15.100:0/3831588598 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea680539b0 con 0x7fea700cef00 2024-08-17T02:45:50.483 INFO:teuthology.orchestra.run.smithi100.stdout:60129542149 2024-08-17T02:45:50.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.483+0000 7f7c8be00640 1 -- 172.21.15.100:0/3401967848 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7c64065180 msgr2=0x7f7c64067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.483+0000 7f7c8be00640 1 --2- 172.21.15.100:0/3401967848 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7c64065180 0x7f7c64067630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7c8409ddd0 tx=0x7f7c70008040 comp rx=0 tx=0).stop 2024-08-17T02:45:50.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.483+0000 7f7c8be00640 1 -- 172.21.15.100:0/3401967848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c6c003aa0 msgr2=0x7f7c840b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.483+0000 7f7c8be00640 1 --2- 172.21.15.100:0/3401967848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c6c003aa0 0x7f7c840b5680 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7c7800c210 tx=0x7f7c78033000 comp rx=0 tx=0).stop 2024-08-17T02:45:50.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.483+0000 7f7c8be00640 1 -- 172.21.15.100:0/3401967848 shutdown_connections 2024-08-17T02:45:50.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.483+0000 7f7c8be00640 1 --2- 172.21.15.100:0/3401967848 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7c64065180 0x7f7c64067630 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.483+0000 7f7c8be00640 1 --2- 172.21.15.100:0/3401967848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c8415b480 0x7f7c8415b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.483+0000 7f7c8be00640 1 --2- 172.21.15.100:0/3401967848 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7c84154fd0 0x7f7c841546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.483+0000 7f7c8be00640 1 --2- 172.21.15.100:0/3401967848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c6c003aa0 0x7f7c840b5680 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.483+0000 7f7c8be00640 1 -- 172.21.15.100:0/3401967848 >> 172.21.15.100:0/3401967848 conn(0x7f7c840cfdc0 msgr2=0x7f7c840c5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:50.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.484+0000 7f7c8be00640 1 -- 172.21.15.100:0/3401967848 shutdown_connections 2024-08-17T02:45:50.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.484+0000 7f7c8be00640 1 -- 172.21.15.100:0/3401967848 wait complete. 2024-08-17T02:45:50.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.484+0000 7f1927200640 1 -- 172.21.15.100:0/1603790734 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f19000054c0 con 0x7f19280cc800 2024-08-17T02:45:50.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.485+0000 7f191d600640 1 -- 172.21.15.100:0/1603790734 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1918037090 con 0x7f19280cc800 2024-08-17T02:45:50.486 INFO:teuthology.orchestra.run.smithi100.stdout:60129542149 2024-08-17T02:45:50.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.485+0000 7fea75c00640 1 -- 172.21.15.100:0/3831588598 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fea50065150 msgr2=0x7fea50067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.485+0000 7fea75c00640 1 --2- 172.21.15.100:0/3831588598 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fea50065150 0x7fea50067600 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fea60034000 tx=0x7fea60032000 comp rx=0 tx=0).stop 2024-08-17T02:45:50.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.485+0000 7fea75c00640 1 -- 172.21.15.100:0/3831588598 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea700cef00 msgr2=0x7fea70168ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.485+0000 7fea75c00640 1 --2- 172.21.15.100:0/3831588598 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea700cef00 0x7fea70168ae0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fea6800c7c0 tx=0x7fea68001590 comp rx=0 tx=0).stop 2024-08-17T02:45:50.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.486+0000 7fea75c00640 1 -- 172.21.15.100:0/3831588598 shutdown_connections 2024-08-17T02:45:50.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.486+0000 7fea75c00640 1 --2- 172.21.15.100:0/3831588598 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fea50065150 0x7fea50067600 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.486+0000 7fea75c00640 1 --2- 172.21.15.100:0/3831588598 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea700cef00 0x7fea70168ae0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.486+0000 7fea75c00640 1 --2- 172.21.15.100:0/3831588598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea700ccad0 0x7fea700ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.486+0000 7fea75c00640 1 --2- 172.21.15.100:0/3831588598 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fea700ca8a0 0x7fea700c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.486+0000 7fea75c00640 1 -- 172.21.15.100:0/3831588598 >> 172.21.15.100:0/3831588598 conn(0x7fea70098e00 msgr2=0x7fea700b1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:50.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.2 2024-08-17T02:45:50.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.487+0000 7fea75c00640 1 -- 172.21.15.100:0/3831588598 shutdown_connections 2024-08-17T02:45:50.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.487+0000 7fea75c00640 1 -- 172.21.15.100:0/3831588598 wait complete. 2024-08-17T02:45:50.489 DEBUG:teuthology.parallel:result is None 2024-08-17T02:45:50.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.487+0000 7f1927200640 1 -- 172.21.15.100:0/1603790734 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f19080652a0 msgr2=0x7f1908067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.487+0000 7f1927200640 1 --2- 172.21.15.100:0/1603790734 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f19080652a0 0x7f1908067750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f19280b1d00 tx=0x7f19140090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.487+0000 7f1927200640 1 -- 172.21.15.100:0/1603790734 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f19280cc800 msgr2=0x7f1928087880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.487+0000 7f1927200640 1 --2- 172.21.15.100:0/1603790734 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f19280cc800 0x7f1928087880 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1918035040 tx=0x7f1918032000 comp rx=0 tx=0).stop 2024-08-17T02:45:50.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.488+0000 7f1927200640 1 -- 172.21.15.100:0/1603790734 shutdown_connections 2024-08-17T02:45:50.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.488+0000 7f1927200640 1 --2- 172.21.15.100:0/1603790734 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f19080652a0 0x7f1908067750 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f19280b1d00 tx=0x7f19140090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.488+0000 7f1927200640 1 --2- 172.21.15.100:0/1603790734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1928158c80 0x7f19280b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.488+0000 7f1927200640 1 --2- 172.21.15.100:0/1603790734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19280cd700 0x7f19280c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.488+0000 7f1927200640 1 --2- 172.21.15.100:0/1603790734 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f19280cc800 0x7f1928087880 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.488+0000 7f1927200640 1 -- 172.21.15.100:0/1603790734 >> 172.21.15.100:0/1603790734 conn(0x7f1928098e30 msgr2=0x7f19280ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:50.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.488+0000 7f1927200640 1 -- 172.21.15.100:0/1603790734 shutdown_connections 2024-08-17T02:45:50.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.488+0000 7f1927200640 1 -- 172.21.15.100:0/1603790734 wait complete. 2024-08-17T02:45:50.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.489+0000 7f618a600640 1 -- 172.21.15.100:0/1933864374 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6184071050 con 0x7f6184159ca0 2024-08-17T02:45:50.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.490+0000 7f6180c00640 1 -- 172.21.15.100:0/1933864374 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f617c053d80 con 0x7f6184159ca0 2024-08-17T02:45:50.491 INFO:teuthology.orchestra.run.smithi100.stdout:60129542149 2024-08-17T02:45:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.494+0000 7f618a600640 1 -- 172.21.15.100:0/1933864374 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6160065150 msgr2=0x7f6160067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.494+0000 7f618a600640 1 --2- 172.21.15.100:0/1933864374 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6160065150 0x7f6160067600 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6174000e50 tx=0x7f6174032000 comp rx=0 tx=0).stop 2024-08-17T02:45:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.494+0000 7f618a600640 1 -- 172.21.15.100:0/1933864374 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6184159ca0 msgr2=0x7f618409bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.494+0000 7f618a600640 1 --2- 172.21.15.100:0/1933864374 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6184159ca0 0x7f618409bbb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f617c00c810 tx=0x7f617c002580 comp rx=0 tx=0).stop 2024-08-17T02:45:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.494+0000 7f618a600640 1 -- 172.21.15.100:0/1933864374 shutdown_connections 2024-08-17T02:45:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.494+0000 7f618a600640 1 --2- 172.21.15.100:0/1933864374 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6160065150 0x7f6160067600 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.494+0000 7f618a600640 1 --2- 172.21.15.100:0/1933864374 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6184159ca0 0x7f618409bbb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.494+0000 7f618a600640 1 --2- 172.21.15.100:0/1933864374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61840ccad0 0x7f618409b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.494+0000 7f618a600640 1 --2- 172.21.15.100:0/1933864374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61840ca8a0 0x7f61840c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.494+0000 7f618a600640 1 -- 172.21.15.100:0/1933864374 >> 172.21.15.100:0/1933864374 conn(0x7f6184098e00 msgr2=0x7f61840b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:50.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.494+0000 7f618a600640 1 -- 172.21.15.100:0/1933864374 shutdown_connections 2024-08-17T02:45:50.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.494+0000 7f618a600640 1 -- 172.21.15.100:0/1933864374 wait complete. 2024-08-17T02:45:50.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-08-17T02:45:50.499 DEBUG:teuthology.parallel:result is None 2024-08-17T02:45:50.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.7 2024-08-17T02:45:50.503 DEBUG:teuthology.parallel:result is None 2024-08-17T02:45:50.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2024-08-17T02:45:50.514 DEBUG:teuthology.parallel:result is None 2024-08-17T02:45:50.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-08-17T02:45:50.515 DEBUG:teuthology.parallel:result is None 2024-08-17T02:45:50.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2024-08-17T02:45:50.516 DEBUG:teuthology.parallel:result is None 2024-08-17T02:45:50.516 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:45:50.516 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:45:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.702+0000 7f8242600640 1 Processor -- start 2024-08-17T02:45:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.702+0000 7f8242600640 1 -- start start 2024-08-17T02:45:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.703+0000 7f8242600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f823c0ac780 0x7f823c0af410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.703+0000 7f8242600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823c067d60 con 0x7f823c158ea0 2024-08-17T02:45:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.703+0000 7f8242600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823c068600 con 0x7f823c158ad0 2024-08-17T02:45:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.703+0000 7f8242600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f823c0b01d0 con 0x7f823c0ac780 2024-08-17T02:45:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.703+0000 7f823be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f823c0ac780 0x7f823c0af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.703+0000 7f823be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f823c0ac780 0x7f823c0af410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33276/0 (socket says 172.21.15.100:33276) 2024-08-17T02:45:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.703+0000 7f823be00640 1 -- 172.21.15.100:0/3582236574 learned_addr learned my addr 172.21.15.100:0/3582236574 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:50.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.703+0000 7f8241c00640 1 --1- 172.21.15.100:0/3582236574 >> v1:172.21.15.100:6789/0 conn(0x7f823c158ea0 0x7f823c0af950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37500/0 (socket says 172.21.15.100:37500) 2024-08-17T02:45:50.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.704+0000 7f823be00640 1 -- 172.21.15.100:0/3582236574 >> v1:172.21.15.123:6789/0 conn(0x7f823c158ad0 legacy=0x7f823c0ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.704+0000 7f823be00640 1 -- 172.21.15.100:0/3582236574 >> v1:172.21.15.100:6789/0 conn(0x7f823c158ea0 legacy=0x7f823c0af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.704+0000 7f823be00640 1 -- 172.21.15.100:0/3582236574 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823c067fb0 con 0x7f823c0ac780 2024-08-17T02:45:50.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.704+0000 7f823b400640 1 -- 172.21.15.100:0/3582236574 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696268800 0 0) 0x7f823c067d60 con 0x7f823c158ea0 2024-08-17T02:45:50.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.705+0000 7f823be00640 1 --2- 172.21.15.100:0/3582236574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f823c0ac780 0x7f823c0af410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8228009910 tx=0x7f82280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0aebe4b1de6b8d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.705+0000 7f823b400640 1 -- 172.21.15.100:0/3582236574 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822802add0 con 0x7f823c0ac780 2024-08-17T02:45:50.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.705+0000 7f823b400640 1 -- 172.21.15.100:0/3582236574 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8228032440 con 0x7f823c0ac780 2024-08-17T02:45:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.705+0000 7f823b400640 1 -- 172.21.15.100:0/3582236574 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82280327e0 con 0x7f823c0ac780 2024-08-17T02:45:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.705+0000 7f8242600640 1 -- 172.21.15.100:0/3582236574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f823c0ac780 msgr2=0x7f823c0af410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.705+0000 7f8242600640 1 --2- 172.21.15.100:0/3582236574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f823c0ac780 0x7f823c0af410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8228009910 tx=0x7f82280091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.706+0000 7f8242600640 1 -- 172.21.15.100:0/3582236574 shutdown_connections 2024-08-17T02:45:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.706+0000 7f8242600640 1 --2- 172.21.15.100:0/3582236574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f823c0ac780 0x7f823c0af410 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.706+0000 7f8242600640 1 -- 172.21.15.100:0/3582236574 >> 172.21.15.100:0/3582236574 conn(0x7f823c096a70 msgr2=0x7f823c096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.706+0000 7f8242600640 1 -- 172.21.15.100:0/3582236574 shutdown_connections 2024-08-17T02:45:50.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.706+0000 7f8242600640 1 -- 172.21.15.100:0/3582236574 wait complete. 2024-08-17T02:45:50.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.707+0000 7f8242600640 1 Processor -- start 2024-08-17T02:45:50.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.707+0000 7f8242600640 1 -- start start 2024-08-17T02:45:50.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.708+0000 7f8242600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f823c0ac780 0x7f823c154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.708+0000 7f8242600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f823c158ad0 0x7f823c14e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.708+0000 7f8242600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f823c158ea0 0x7f823c0c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.708+0000 7f8242600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c155520 con 0x7f823c158ad0 2024-08-17T02:45:50.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.708+0000 7f8242600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c1541f0 con 0x7f823c158ea0 2024-08-17T02:45:50.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.708+0000 7f8242600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823c1535e0 con 0x7f823c0ac780 2024-08-17T02:45:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.708+0000 7f823be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f823c158ad0 0x7f823c14e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.708+0000 7f823be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f823c158ad0 0x7f823c14e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33278/0 (socket says 172.21.15.100:33278) 2024-08-17T02:45:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.708+0000 7f823be00640 1 -- 172.21.15.100:0/878935046 learned_addr learned my addr 172.21.15.100:0/878935046 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.708+0000 7f8241c00640 1 --2- 172.21.15.100:0/878935046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f823c158ea0 0x7f823c0c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.708+0000 7f8241200640 1 --2- 172.21.15.100:0/878935046 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f823c0ac780 0x7f823c154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.709+0000 7f823be00640 1 -- 172.21.15.100:0/878935046 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f823c0ac780 msgr2=0x7f823c154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.709+0000 7f823be00640 1 --2- 172.21.15.100:0/878935046 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f823c0ac780 0x7f823c154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.709+0000 7f823be00640 1 -- 172.21.15.100:0/878935046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f823c158ea0 msgr2=0x7f823c0c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.709+0000 7f823be00640 1 --2- 172.21.15.100:0/878935046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f823c158ea0 0x7f823c0c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.709+0000 7f823be00640 1 -- 172.21.15.100:0/878935046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8228009450 con 0x7f823c158ad0 2024-08-17T02:45:50.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.709+0000 7f823be00640 1 --2- 172.21.15.100:0/878935046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f823c158ad0 0x7f823c14e360 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8228035040 tx=0x7f8228032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.709+0000 7f822fe00640 1 -- 172.21.15.100:0/878935046 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8228031b30 con 0x7f823c158ad0 2024-08-17T02:45:50.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.709+0000 7f822fe00640 1 -- 172.21.15.100:0/878935046 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8228031cb0 con 0x7f823c158ad0 2024-08-17T02:45:50.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.709+0000 7f8242600640 1 -- 172.21.15.100:0/878935046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823c1538c0 con 0x7f823c158ad0 2024-08-17T02:45:50.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.709+0000 7f822fe00640 1 -- 172.21.15.100:0/878935046 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822803d670 con 0x7f823c158ad0 2024-08-17T02:45:50.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.709+0000 7f8242600640 1 -- 172.21.15.100:0/878935046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823c153f00 con 0x7f823c158ad0 2024-08-17T02:45:50.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.710+0000 7f8242600640 1 -- 172.21.15.100:0/878935046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823c154ce0 con 0x7f823c158ad0 2024-08-17T02:45:50.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.711+0000 7f822fe00640 1 -- 172.21.15.100:0/878935046 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8228039040 con 0x7f823c158ad0 2024-08-17T02:45:50.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.712+0000 7f822fe00640 1 --2- 172.21.15.100:0/878935046 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f821c065150 0x7f821c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.712+0000 7f822fe00640 1 -- 172.21.15.100:0/878935046 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f82280a25d0 con 0x7f823c158ad0 2024-08-17T02:45:50.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.712+0000 7f8241200640 1 --2- 172.21.15.100:0/878935046 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f821c065150 0x7f821c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.712+0000 7f8241200640 1 --2- 172.21.15.100:0/878935046 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f821c065150 0x7f821c067600 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f82300037c0 tx=0x7f8230009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.715+0000 7f822fe00640 1 -- 172.21.15.100:0/878935046 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f82280705f0 con 0x7f823c158ad0 2024-08-17T02:45:50.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.886+0000 7f8242600640 1 -- 172.21.15.100:0/878935046 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f823c071050 con 0x7f821c065150 2024-08-17T02:45:50.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.893+0000 7f822fe00640 1 -- 172.21.15.100:0/878935046 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264641 (secure 0 0 0) 0x7f823c071050 con 0x7f821c065150 2024-08-17T02:45:50.897 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:50.899 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-08-17T02:45:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.897+0000 7f8242600640 1 -- 172.21.15.100:0/878935046 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f821c065150 msgr2=0x7f821c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.897+0000 7f8242600640 1 --2- 172.21.15.100:0/878935046 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f821c065150 0x7f821c067600 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f82300037c0 tx=0x7f8230009040 comp rx=0 tx=0).stop 2024-08-17T02:45:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.897+0000 7f8242600640 1 -- 172.21.15.100:0/878935046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f823c158ad0 msgr2=0x7f823c14e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.897+0000 7f8242600640 1 --2- 172.21.15.100:0/878935046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f823c158ad0 0x7f823c14e360 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8228035040 tx=0x7f8228032000 comp rx=0 tx=0).stop 2024-08-17T02:45:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.897+0000 7f8242600640 1 -- 172.21.15.100:0/878935046 shutdown_connections 2024-08-17T02:45:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.897+0000 7f8242600640 1 --2- 172.21.15.100:0/878935046 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f821c065150 0x7f821c067600 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.897+0000 7f8242600640 1 --2- 172.21.15.100:0/878935046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f823c158ea0 0x7f823c0c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.897+0000 7f8242600640 1 --2- 172.21.15.100:0/878935046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f823c158ad0 0x7f823c14e360 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.897+0000 7f8242600640 1 --2- 172.21.15.100:0/878935046 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f823c0ac780 0x7f823c154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.897+0000 7f8242600640 1 -- 172.21.15.100:0/878935046 >> 172.21.15.100:0/878935046 conn(0x7f823c096a70 msgr2=0x7f823c0cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:50.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.897+0000 7f8242600640 1 -- 172.21.15.100:0/878935046 shutdown_connections 2024-08-17T02:45:50.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:50.897+0000 7f8242600640 1 -- 172.21.15.100:0/878935046 wait complete. 2024-08-17T02:45:50.913 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-08-17T02:45:49.090714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381844,"kb_used_data":2984,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592876,"statfs":{"total":773094113280,"available":770655105024,"internally_reserved":0,"allocated":3055616,"data_stored":1813588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001538"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.884819+0000","last_change":"2024-08-17T02:45:41.879971+0000","last_active":"2024-08-17T02:45:41.884819+0000","last_peered":"2024-08-17T02:45:41.884819+0000","last_clean":"2024-08-17T02:45:41.884819+0000","last_became_active":"2024-08-17T02:45:41.879691+0000","last_became_peered":"2024-08-17T02:45:41.879691+0000","last_unstale":"2024-08-17T02:45:41.884819+0000","last_undegraded":"2024-08-17T02:45:41.884819+0000","last_fullsized":"2024-08-17T02:45:41.884819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:02:08.258895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.869545+0000","last_change":"2024-08-17T02:45:41.863383+0000","last_active":"2024-08-17T02:45:41.869545+0000","last_peered":"2024-08-17T02:45:41.869545+0000","last_clean":"2024-08-17T02:45:41.869545+0000","last_became_active":"2024-08-17T02:45:41.863151+0000","last_became_peered":"2024-08-17T02:45:41.863151+0000","last_unstale":"2024-08-17T02:45:41.869545+0000","last_undegraded":"2024-08-17T02:45:41.869545+0000","last_fullsized":"2024-08-17T02:45:41.869545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:09.195225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.864696+0000","last_change":"2024-08-17T02:45:41.859813+0000","last_active":"2024-08-17T02:45:41.864696+0000","last_peered":"2024-08-17T02:45:41.864696+0000","last_clean":"2024-08-17T02:45:41.864696+0000","last_became_active":"2024-08-17T02:45:41.859526+0000","last_became_peered":"2024-08-17T02:45:41.859526+0000","last_unstale":"2024-08-17T02:45:41.864696+0000","last_undegraded":"2024-08-17T02:45:41.864696+0000","last_fullsized":"2024-08-17T02:45:41.864696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:07.343258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.858986+0000","last_change":"2024-08-17T02:45:41.855298+0000","last_active":"2024-08-17T02:45:41.858986+0000","last_peered":"2024-08-17T02:45:41.858986+0000","last_clean":"2024-08-17T02:45:41.858986+0000","last_became_active":"2024-08-17T02:45:41.854637+0000","last_became_peered":"2024-08-17T02:45:41.854637+0000","last_unstale":"2024-08-17T02:45:41.858986+0000","last_undegraded":"2024-08-17T02:45:41.858986+0000","last_fullsized":"2024-08-17T02:45:41.858986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:02.143166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.878742+0000","last_change":"2024-08-17T02:45:41.867785+0000","last_active":"2024-08-17T02:45:41.878742+0000","last_peered":"2024-08-17T02:45:41.878742+0000","last_clean":"2024-08-17T02:45:41.878742+0000","last_became_active":"2024-08-17T02:45:41.866024+0000","last_became_peered":"2024-08-17T02:45:41.866024+0000","last_unstale":"2024-08-17T02:45:41.878742+0000","last_undegraded":"2024-08-17T02:45:41.878742+0000","last_fullsized":"2024-08-17T02:45:41.878742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:27.873599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.860111+0000","last_change":"2024-08-17T02:45:41.855424+0000","last_active":"2024-08-17T02:45:41.860111+0000","last_peered":"2024-08-17T02:45:41.860111+0000","last_clean":"2024-08-17T02:45:41.860111+0000","last_became_active":"2024-08-17T02:45:41.854196+0000","last_became_peered":"2024-08-17T02:45:41.854196+0000","last_unstale":"2024-08-17T02:45:41.860111+0000","last_undegraded":"2024-08-17T02:45:41.860111+0000","last_fullsized":"2024-08-17T02:45:41.860111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:01.344799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.878291+0000","last_change":"2024-08-17T02:45:41.875455+0000","last_active":"2024-08-17T02:45:41.878291+0000","last_peered":"2024-08-17T02:45:41.878291+0000","last_clean":"2024-08-17T02:45:41.878291+0000","last_became_active":"2024-08-17T02:45:41.874847+0000","last_became_peered":"2024-08-17T02:45:41.874847+0000","last_unstale":"2024-08-17T02:45:41.878291+0000","last_undegraded":"2024-08-17T02:45:41.878291+0000","last_fullsized":"2024-08-17T02:45:41.878291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:51.387674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.849358+0000","last_change":"2024-08-17T02:45:41.845108+0000","last_active":"2024-08-17T02:45:41.849358+0000","last_peered":"2024-08-17T02:45:41.849358+0000","last_clean":"2024-08-17T02:45:41.849358+0000","last_became_active":"2024-08-17T02:45:41.844922+0000","last_became_peered":"2024-08-17T02:45:41.844922+0000","last_unstale":"2024-08-17T02:45:41.849358+0000","last_undegraded":"2024-08-17T02:45:41.849358+0000","last_fullsized":"2024-08-17T02:45:41.849358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:13.016129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.884436+0000","last_change":"2024-08-17T02:45:41.879469+0000","last_active":"2024-08-17T02:45:41.884436+0000","last_peered":"2024-08-17T02:45:41.884436+0000","last_clean":"2024-08-17T02:45:41.884436+0000","last_became_active":"2024-08-17T02:45:41.879191+0000","last_became_peered":"2024-08-17T02:45:41.879191+0000","last_unstale":"2024-08-17T02:45:41.884436+0000","last_undegraded":"2024-08-17T02:45:41.884436+0000","last_fullsized":"2024-08-17T02:45:41.884436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:36.351108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.869635+0000","last_change":"2024-08-17T02:45:41.865511+0000","last_active":"2024-08-17T02:45:41.869635+0000","last_peered":"2024-08-17T02:45:41.869635+0000","last_clean":"2024-08-17T02:45:41.869635+0000","last_became_active":"2024-08-17T02:45:41.865229+0000","last_became_peered":"2024-08-17T02:45:41.865229+0000","last_unstale":"2024-08-17T02:45:41.869635+0000","last_undegraded":"2024-08-17T02:45:41.869635+0000","last_fullsized":"2024-08-17T02:45:41.869635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:24.850532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.869380+0000","last_change":"2024-08-17T02:45:41.867609+0000","last_active":"2024-08-17T02:45:41.869380+0000","last_peered":"2024-08-17T02:45:41.869380+0000","last_clean":"2024-08-17T02:45:41.869380+0000","last_became_active":"2024-08-17T02:45:41.867267+0000","last_became_peered":"2024-08-17T02:45:41.867267+0000","last_unstale":"2024-08-17T02:45:41.869380+0000","last_undegraded":"2024-08-17T02:45:41.869380+0000","last_fullsized":"2024-08-17T02:45:41.869380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:36:25.246538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.883617+0000","last_change":"2024-08-17T02:45:41.878878+0000","last_active":"2024-08-17T02:45:41.883617+0000","last_peered":"2024-08-17T02:45:41.883617+0000","last_clean":"2024-08-17T02:45:41.883617+0000","last_became_active":"2024-08-17T02:45:41.876755+0000","last_became_peered":"2024-08-17T02:45:41.876755+0000","last_unstale":"2024-08-17T02:45:41.883617+0000","last_undegraded":"2024-08-17T02:45:41.883617+0000","last_fullsized":"2024-08-17T02:45:41.883617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:15.533277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.875157+0000","last_change":"2024-08-17T02:45:41.870345+0000","last_active":"2024-08-17T02:45:41.875157+0000","last_peered":"2024-08-17T02:45:41.875157+0000","last_clean":"2024-08-17T02:45:41.875157+0000","last_became_active":"2024-08-17T02:45:41.869995+0000","last_became_peered":"2024-08-17T02:45:41.869995+0000","last_unstale":"2024-08-17T02:45:41.875157+0000","last_undegraded":"2024-08-17T02:45:41.875157+0000","last_fullsized":"2024-08-17T02:45:41.875157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:27.590592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.872965+0000","last_change":"2024-08-17T02:45:41.865428+0000","last_active":"2024-08-17T02:45:41.872965+0000","last_peered":"2024-08-17T02:45:41.872965+0000","last_clean":"2024-08-17T02:45:41.872965+0000","last_became_active":"2024-08-17T02:45:41.865184+0000","last_became_peered":"2024-08-17T02:45:41.865184+0000","last_unstale":"2024-08-17T02:45:41.872965+0000","last_undegraded":"2024-08-17T02:45:41.872965+0000","last_fullsized":"2024-08-17T02:45:41.872965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:00.504734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.867141+0000","last_change":"2024-08-17T02:45:41.862050+0000","last_active":"2024-08-17T02:45:41.867141+0000","last_peered":"2024-08-17T02:45:41.867141+0000","last_clean":"2024-08-17T02:45:41.867141+0000","last_became_active":"2024-08-17T02:45:41.861754+0000","last_became_peered":"2024-08-17T02:45:41.861754+0000","last_unstale":"2024-08-17T02:45:41.867141+0000","last_undegraded":"2024-08-17T02:45:41.867141+0000","last_fullsized":"2024-08-17T02:45:41.867141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:31:57.128164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.866857+0000","last_change":"2024-08-17T02:45:41.861246+0000","last_active":"2024-08-17T02:45:41.866857+0000","last_peered":"2024-08-17T02:45:41.866857+0000","last_clean":"2024-08-17T02:45:41.866857+0000","last_became_active":"2024-08-17T02:45:41.860955+0000","last_became_peered":"2024-08-17T02:45:41.860955+0000","last_unstale":"2024-08-17T02:45:41.866857+0000","last_undegraded":"2024-08-17T02:45:41.866857+0000","last_fullsized":"2024-08-17T02:45:41.866857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:13.016129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.867675+0000","last_change":"2024-08-17T02:45:41.863642+0000","last_active":"2024-08-17T02:45:41.867675+0000","last_peered":"2024-08-17T02:45:41.867675+0000","last_clean":"2024-08-17T02:45:41.867675+0000","last_became_active":"2024-08-17T02:45:41.863379+0000","last_became_peered":"2024-08-17T02:45:41.863379+0000","last_unstale":"2024-08-17T02:45:41.867675+0000","last_undegraded":"2024-08-17T02:45:41.867675+0000","last_fullsized":"2024-08-17T02:45:41.867675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:26.094951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.877544+0000","last_change":"2024-08-17T02:45:41.872075+0000","last_active":"2024-08-17T02:45:41.877544+0000","last_peered":"2024-08-17T02:45:41.877544+0000","last_clean":"2024-08-17T02:45:41.877544+0000","last_became_active":"2024-08-17T02:45:41.871439+0000","last_became_peered":"2024-08-17T02:45:41.871439+0000","last_unstale":"2024-08-17T02:45:41.877544+0000","last_undegraded":"2024-08-17T02:45:41.877544+0000","last_fullsized":"2024-08-17T02:45:41.877544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:15.533277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.874148+0000","last_change":"2024-08-17T02:45:41.866609+0000","last_active":"2024-08-17T02:45:41.874148+0000","last_peered":"2024-08-17T02:45:41.874148+0000","last_clean":"2024-08-17T02:45:41.874148+0000","last_became_active":"2024-08-17T02:45:41.866323+0000","last_became_peered":"2024-08-17T02:45:41.866323+0000","last_unstale":"2024-08-17T02:45:41.874148+0000","last_undegraded":"2024-08-17T02:45:41.874148+0000","last_fullsized":"2024-08-17T02:45:41.874148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:52.201878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.884941+0000","last_change":"2024-08-17T02:45:41.881550+0000","last_active":"2024-08-17T02:45:41.884941+0000","last_peered":"2024-08-17T02:45:41.884941+0000","last_clean":"2024-08-17T02:45:41.884941+0000","last_became_active":"2024-08-17T02:45:41.881022+0000","last_became_peered":"2024-08-17T02:45:41.881022+0000","last_unstale":"2024-08-17T02:45:41.884941+0000","last_undegraded":"2024-08-17T02:45:41.884941+0000","last_fullsized":"2024-08-17T02:45:41.884941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:50:11.095464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.875180+0000","last_change":"2024-08-17T02:45:41.868514+0000","last_active":"2024-08-17T02:45:41.875180+0000","last_peered":"2024-08-17T02:45:41.875180+0000","last_clean":"2024-08-17T02:45:41.875180+0000","last_became_active":"2024-08-17T02:45:41.868230+0000","last_became_peered":"2024-08-17T02:45:41.868230+0000","last_unstale":"2024-08-17T02:45:41.875180+0000","last_undegraded":"2024-08-17T02:45:41.875180+0000","last_fullsized":"2024-08-17T02:45:41.875180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:31:57.128164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.866839+0000","last_change":"2024-08-17T02:45:41.860030+0000","last_active":"2024-08-17T02:45:41.866839+0000","last_peered":"2024-08-17T02:45:41.866839+0000","last_clean":"2024-08-17T02:45:41.866839+0000","last_became_active":"2024-08-17T02:45:41.859373+0000","last_became_peered":"2024-08-17T02:45:41.859373+0000","last_unstale":"2024-08-17T02:45:41.866839+0000","last_undegraded":"2024-08-17T02:45:41.866839+0000","last_fullsized":"2024-08-17T02:45:41.866839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:44:02.932481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.867355+0000","last_change":"2024-08-17T02:45:41.862826+0000","last_active":"2024-08-17T02:45:41.867355+0000","last_peered":"2024-08-17T02:45:41.867355+0000","last_clean":"2024-08-17T02:45:41.867355+0000","last_became_active":"2024-08-17T02:45:41.862601+0000","last_became_peered":"2024-08-17T02:45:41.862601+0000","last_unstale":"2024-08-17T02:45:41.867355+0000","last_undegraded":"2024-08-17T02:45:41.867355+0000","last_fullsized":"2024-08-17T02:45:41.867355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:31:57.128164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.859156+0000","last_change":"2024-08-17T02:45:41.853293+0000","last_active":"2024-08-17T02:45:41.859156+0000","last_peered":"2024-08-17T02:45:41.859156+0000","last_clean":"2024-08-17T02:45:41.859156+0000","last_became_active":"2024-08-17T02:45:41.853030+0000","last_became_peered":"2024-08-17T02:45:41.853030+0000","last_unstale":"2024-08-17T02:45:41.859156+0000","last_undegraded":"2024-08-17T02:45:41.859156+0000","last_fullsized":"2024-08-17T02:45:41.859156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:10:57.188283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.863593+0000","last_change":"2024-08-17T02:45:41.858360+0000","last_active":"2024-08-17T02:45:41.863593+0000","last_peered":"2024-08-17T02:45:41.863593+0000","last_clean":"2024-08-17T02:45:41.863593+0000","last_became_active":"2024-08-17T02:45:41.858129+0000","last_became_peered":"2024-08-17T02:45:41.858129+0000","last_unstale":"2024-08-17T02:45:41.863593+0000","last_undegraded":"2024-08-17T02:45:41.863593+0000","last_fullsized":"2024-08-17T02:45:41.863593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:00.504734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886048+0000","last_change":"2024-08-17T02:45:41.882941+0000","last_active":"2024-08-17T02:45:41.886048+0000","last_peered":"2024-08-17T02:45:41.886048+0000","last_clean":"2024-08-17T02:45:41.886048+0000","last_became_active":"2024-08-17T02:45:41.880910+0000","last_became_peered":"2024-08-17T02:45:41.880910+0000","last_unstale":"2024-08-17T02:45:41.886048+0000","last_undegraded":"2024-08-17T02:45:41.886048+0000","last_fullsized":"2024-08-17T02:45:41.886048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:35.831054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.859157+0000","last_change":"2024-08-17T02:45:41.855434+0000","last_active":"2024-08-17T02:45:41.859157+0000","last_peered":"2024-08-17T02:45:41.859157+0000","last_clean":"2024-08-17T02:45:41.859157+0000","last_became_active":"2024-08-17T02:45:41.855036+0000","last_became_peered":"2024-08-17T02:45:41.855036+0000","last_unstale":"2024-08-17T02:45:41.859157+0000","last_undegraded":"2024-08-17T02:45:41.859157+0000","last_fullsized":"2024-08-17T02:45:41.859157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:06.130481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.878219+0000","last_change":"2024-08-17T02:45:41.875037+0000","last_active":"2024-08-17T02:45:41.878219+0000","last_peered":"2024-08-17T02:45:41.878219+0000","last_clean":"2024-08-17T02:45:41.878219+0000","last_became_active":"2024-08-17T02:45:41.874745+0000","last_became_peered":"2024-08-17T02:45:41.874745+0000","last_unstale":"2024-08-17T02:45:41.878219+0000","last_undegraded":"2024-08-17T02:45:41.878219+0000","last_fullsized":"2024-08-17T02:45:41.878219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:07.343258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.868387+0000","last_change":"2024-08-17T02:45:41.860577+0000","last_active":"2024-08-17T02:45:41.868387+0000","last_peered":"2024-08-17T02:45:41.868387+0000","last_clean":"2024-08-17T02:45:41.868387+0000","last_became_active":"2024-08-17T02:45:41.857944+0000","last_became_peered":"2024-08-17T02:45:41.857944+0000","last_unstale":"2024-08-17T02:45:41.868387+0000","last_undegraded":"2024-08-17T02:45:41.868387+0000","last_fullsized":"2024-08-17T02:45:41.868387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:06.130481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.857933+0000","last_change":"2024-08-17T02:45:41.852863+0000","last_active":"2024-08-17T02:45:41.857933+0000","last_peered":"2024-08-17T02:45:41.857933+0000","last_clean":"2024-08-17T02:45:41.857933+0000","last_became_active":"2024-08-17T02:45:41.852578+0000","last_became_peered":"2024-08-17T02:45:41.852578+0000","last_unstale":"2024-08-17T02:45:41.857933+0000","last_undegraded":"2024-08-17T02:45:41.857933+0000","last_fullsized":"2024-08-17T02:45:41.857933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:27.590592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.851184+0000","last_change":"2024-08-17T02:45:41.846025+0000","last_active":"2024-08-17T02:45:41.851184+0000","last_peered":"2024-08-17T02:45:41.851184+0000","last_clean":"2024-08-17T02:45:41.851184+0000","last_became_active":"2024-08-17T02:45:41.845713+0000","last_became_peered":"2024-08-17T02:45:41.845713+0000","last_unstale":"2024-08-17T02:45:41.851184+0000","last_undegraded":"2024-08-17T02:45:41.851184+0000","last_fullsized":"2024-08-17T02:45:41.851184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:21.073718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.874435+0000","last_change":"2024-08-17T02:45:41.870783+0000","last_active":"2024-08-17T02:45:41.874435+0000","last_peered":"2024-08-17T02:45:41.874435+0000","last_clean":"2024-08-17T02:45:41.874435+0000","last_became_active":"2024-08-17T02:45:41.870550+0000","last_became_peered":"2024-08-17T02:45:41.870550+0000","last_unstale":"2024-08-17T02:45:41.874435+0000","last_undegraded":"2024-08-17T02:45:41.874435+0000","last_fullsized":"2024-08-17T02:45:41.874435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:55:47.666421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.873947+0000","last_change":"2024-08-17T02:45:41.860580+0000","last_active":"2024-08-17T02:45:41.873947+0000","last_peered":"2024-08-17T02:45:41.873947+0000","last_clean":"2024-08-17T02:45:41.873947+0000","last_became_active":"2024-08-17T02:45:41.860364+0000","last_became_peered":"2024-08-17T02:45:41.860364+0000","last_unstale":"2024-08-17T02:45:41.873947+0000","last_undegraded":"2024-08-17T02:45:41.873947+0000","last_fullsized":"2024-08-17T02:45:41.873947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:44.911480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.878927+0000","last_change":"2024-08-17T02:45:40.856192+0000","last_active":"2024-08-17T02:45:41.878927+0000","last_peered":"2024-08-17T02:45:41.878927+0000","last_clean":"2024-08-17T02:45:41.878927+0000","last_became_active":"2024-08-17T02:45:40.856008+0000","last_became_peered":"2024-08-17T02:45:40.856008+0000","last_unstale":"2024-08-17T02:45:41.878927+0000","last_undegraded":"2024-08-17T02:45:41.878927+0000","last_fullsized":"2024-08-17T02:45:41.878927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:03.324359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.868405+0000","last_change":"2024-08-17T02:45:41.860685+0000","last_active":"2024-08-17T02:45:41.868405+0000","last_peered":"2024-08-17T02:45:41.868405+0000","last_clean":"2024-08-17T02:45:41.868405+0000","last_became_active":"2024-08-17T02:45:41.858422+0000","last_became_peered":"2024-08-17T02:45:41.858422+0000","last_unstale":"2024-08-17T02:45:41.868405+0000","last_undegraded":"2024-08-17T02:45:41.868405+0000","last_fullsized":"2024-08-17T02:45:41.868405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:25.446485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.883276+0000","last_change":"2024-08-17T02:45:40.850702+0000","last_active":"2024-08-17T02:45:41.883276+0000","last_peered":"2024-08-17T02:45:41.883276+0000","last_clean":"2024-08-17T02:45:41.883276+0000","last_became_active":"2024-08-17T02:45:40.850384+0000","last_became_peered":"2024-08-17T02:45:40.850384+0000","last_unstale":"2024-08-17T02:45:41.883276+0000","last_undegraded":"2024-08-17T02:45:41.883276+0000","last_fullsized":"2024-08-17T02:45:41.883276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:38:15.702366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.840461+0000","last_change":"2024-08-17T02:45:40.847576+0000","last_active":"2024-08-17T02:45:41.840461+0000","last_peered":"2024-08-17T02:45:41.840461+0000","last_clean":"2024-08-17T02:45:41.840461+0000","last_became_active":"2024-08-17T02:45:40.847319+0000","last_became_peered":"2024-08-17T02:45:40.847319+0000","last_unstale":"2024-08-17T02:45:41.840461+0000","last_undegraded":"2024-08-17T02:45:41.840461+0000","last_fullsized":"2024-08-17T02:45:41.840461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:19.561224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.863488+0000","last_change":"2024-08-17T02:45:41.857865+0000","last_active":"2024-08-17T02:45:41.863488+0000","last_peered":"2024-08-17T02:45:41.863488+0000","last_clean":"2024-08-17T02:45:41.863488+0000","last_became_active":"2024-08-17T02:45:41.857585+0000","last_became_peered":"2024-08-17T02:45:41.857585+0000","last_unstale":"2024-08-17T02:45:41.863488+0000","last_undegraded":"2024-08-17T02:45:41.863488+0000","last_fullsized":"2024-08-17T02:45:41.863488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:10:57.188283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.840871+0000","last_change":"2024-08-17T02:45:40.853724+0000","last_active":"2024-08-17T02:45:41.840871+0000","last_peered":"2024-08-17T02:45:41.840871+0000","last_clean":"2024-08-17T02:45:41.840871+0000","last_became_active":"2024-08-17T02:45:40.848438+0000","last_became_peered":"2024-08-17T02:45:40.848438+0000","last_unstale":"2024-08-17T02:45:41.840871+0000","last_undegraded":"2024-08-17T02:45:41.840871+0000","last_fullsized":"2024-08-17T02:45:41.840871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:52:22.103135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.859791+0000","last_change":"2024-08-17T02:45:41.856281+0000","last_active":"2024-08-17T02:45:41.859791+0000","last_peered":"2024-08-17T02:45:41.859791+0000","last_clean":"2024-08-17T02:45:41.859791+0000","last_became_active":"2024-08-17T02:45:41.855982+0000","last_became_peered":"2024-08-17T02:45:41.855982+0000","last_unstale":"2024-08-17T02:45:41.859791+0000","last_undegraded":"2024-08-17T02:45:41.859791+0000","last_fullsized":"2024-08-17T02:45:41.859791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:10:57.188283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.865649+0000","last_change":"2024-08-17T02:45:40.856916+0000","last_active":"2024-08-17T02:45:41.865649+0000","last_peered":"2024-08-17T02:45:41.865649+0000","last_clean":"2024-08-17T02:45:41.865649+0000","last_became_active":"2024-08-17T02:45:40.856729+0000","last_became_peered":"2024-08-17T02:45:40.856729+0000","last_unstale":"2024-08-17T02:45:41.865649+0000","last_undegraded":"2024-08-17T02:45:41.865649+0000","last_fullsized":"2024-08-17T02:45:41.865649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:27.561597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.876949+0000","last_change":"2024-08-17T02:45:41.876111+0000","last_active":"2024-08-17T02:45:41.876949+0000","last_peered":"2024-08-17T02:45:41.876949+0000","last_clean":"2024-08-17T02:45:41.876949+0000","last_became_active":"2024-08-17T02:45:41.872909+0000","last_became_peered":"2024-08-17T02:45:41.872909+0000","last_unstale":"2024-08-17T02:45:41.876949+0000","last_undegraded":"2024-08-17T02:45:41.876949+0000","last_fullsized":"2024-08-17T02:45:41.876949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:37.395022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.842827+0000","last_change":"2024-08-17T02:45:40.861062+0000","last_active":"2024-08-17T02:45:41.842827+0000","last_peered":"2024-08-17T02:45:41.842827+0000","last_clean":"2024-08-17T02:45:41.842827+0000","last_became_active":"2024-08-17T02:45:40.860760+0000","last_became_peered":"2024-08-17T02:45:40.860760+0000","last_unstale":"2024-08-17T02:45:41.842827+0000","last_undegraded":"2024-08-17T02:45:41.842827+0000","last_fullsized":"2024-08-17T02:45:41.842827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:19.561224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.869792+0000","last_change":"2024-08-17T02:45:41.863001+0000","last_active":"2024-08-17T02:45:41.869792+0000","last_peered":"2024-08-17T02:45:41.869792+0000","last_clean":"2024-08-17T02:45:41.869792+0000","last_became_active":"2024-08-17T02:45:41.862662+0000","last_became_peered":"2024-08-17T02:45:41.862662+0000","last_unstale":"2024-08-17T02:45:41.869792+0000","last_undegraded":"2024-08-17T02:45:41.869792+0000","last_fullsized":"2024-08-17T02:45:41.869792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:10:57.188283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.889508+0000","last_change":"2024-08-17T02:45:40.853331+0000","last_active":"2024-08-17T02:45:41.889508+0000","last_peered":"2024-08-17T02:45:41.889508+0000","last_clean":"2024-08-17T02:45:41.889508+0000","last_became_active":"2024-08-17T02:45:40.853029+0000","last_became_peered":"2024-08-17T02:45:40.853029+0000","last_unstale":"2024-08-17T02:45:41.889508+0000","last_undegraded":"2024-08-17T02:45:41.889508+0000","last_fullsized":"2024-08-17T02:45:41.889508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:43.905610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.879140+0000","last_change":"2024-08-17T02:45:41.872156+0000","last_active":"2024-08-17T02:45:41.879140+0000","last_peered":"2024-08-17T02:45:41.879140+0000","last_clean":"2024-08-17T02:45:41.879140+0000","last_became_active":"2024-08-17T02:45:41.867463+0000","last_became_peered":"2024-08-17T02:45:41.867463+0000","last_unstale":"2024-08-17T02:45:41.879140+0000","last_undegraded":"2024-08-17T02:45:41.879140+0000","last_fullsized":"2024-08-17T02:45:41.879140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:21.073718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886214+0000","last_change":"2024-08-17T02:45:40.843999+0000","last_active":"2024-08-17T02:45:41.886214+0000","last_peered":"2024-08-17T02:45:41.886214+0000","last_clean":"2024-08-17T02:45:41.886214+0000","last_became_active":"2024-08-17T02:45:40.843713+0000","last_became_peered":"2024-08-17T02:45:40.843713+0000","last_unstale":"2024-08-17T02:45:41.886214+0000","last_undegraded":"2024-08-17T02:45:41.886214+0000","last_fullsized":"2024-08-17T02:45:41.886214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:11.722334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.875620+0000","last_change":"2024-08-17T02:45:41.866615+0000","last_active":"2024-08-17T02:45:41.875620+0000","last_peered":"2024-08-17T02:45:41.875620+0000","last_clean":"2024-08-17T02:45:41.875620+0000","last_became_active":"2024-08-17T02:45:41.865961+0000","last_became_peered":"2024-08-17T02:45:41.865961+0000","last_unstale":"2024-08-17T02:45:41.875620+0000","last_undegraded":"2024-08-17T02:45:41.875620+0000","last_fullsized":"2024-08-17T02:45:41.875620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:05.492164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.884888+0000","last_change":"2024-08-17T02:45:40.847584+0000","last_active":"2024-08-17T02:45:41.884888+0000","last_peered":"2024-08-17T02:45:41.884888+0000","last_clean":"2024-08-17T02:45:41.884888+0000","last_became_active":"2024-08-17T02:45:40.847259+0000","last_became_peered":"2024-08-17T02:45:40.847259+0000","last_unstale":"2024-08-17T02:45:41.884888+0000","last_undegraded":"2024-08-17T02:45:41.884888+0000","last_fullsized":"2024-08-17T02:45:41.884888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:00:43.864087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.872881+0000","last_change":"2024-08-17T02:45:41.864969+0000","last_active":"2024-08-17T02:45:41.872881+0000","last_peered":"2024-08-17T02:45:41.872881+0000","last_clean":"2024-08-17T02:45:41.872881+0000","last_became_active":"2024-08-17T02:45:41.860538+0000","last_became_peered":"2024-08-17T02:45:41.860538+0000","last_unstale":"2024-08-17T02:45:41.872881+0000","last_undegraded":"2024-08-17T02:45:41.872881+0000","last_fullsized":"2024-08-17T02:45:41.872881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:16:34.733391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.842294+0000","last_change":"2024-08-17T02:45:40.853949+0000","last_active":"2024-08-17T02:45:41.842294+0000","last_peered":"2024-08-17T02:45:41.842294+0000","last_clean":"2024-08-17T02:45:41.842294+0000","last_became_active":"2024-08-17T02:45:40.852638+0000","last_became_peered":"2024-08-17T02:45:40.852638+0000","last_unstale":"2024-08-17T02:45:41.842294+0000","last_undegraded":"2024-08-17T02:45:41.842294+0000","last_fullsized":"2024-08-17T02:45:41.842294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:03.324359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.884327+0000","last_change":"2024-08-17T02:45:41.876365+0000","last_active":"2024-08-17T02:45:41.884327+0000","last_peered":"2024-08-17T02:45:41.884327+0000","last_clean":"2024-08-17T02:45:41.884327+0000","last_became_active":"2024-08-17T02:45:41.876110+0000","last_became_peered":"2024-08-17T02:45:41.876110+0000","last_unstale":"2024-08-17T02:45:41.884327+0000","last_undegraded":"2024-08-17T02:45:41.884327+0000","last_fullsized":"2024-08-17T02:45:41.884327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:52.363743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.851754+0000","last_change":"2024-08-17T02:45:40.845008+0000","last_active":"2024-08-17T02:45:41.851754+0000","last_peered":"2024-08-17T02:45:41.851754+0000","last_clean":"2024-08-17T02:45:41.851754+0000","last_became_active":"2024-08-17T02:45:40.842289+0000","last_became_peered":"2024-08-17T02:45:40.842289+0000","last_unstale":"2024-08-17T02:45:41.851754+0000","last_undegraded":"2024-08-17T02:45:41.851754+0000","last_fullsized":"2024-08-17T02:45:41.851754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:48.334950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.870954+0000","last_change":"2024-08-17T02:45:41.864016+0000","last_active":"2024-08-17T02:45:41.870954+0000","last_peered":"2024-08-17T02:45:41.870954+0000","last_clean":"2024-08-17T02:45:41.870954+0000","last_became_active":"2024-08-17T02:45:41.863757+0000","last_became_peered":"2024-08-17T02:45:41.863757+0000","last_unstale":"2024-08-17T02:45:41.870954+0000","last_undegraded":"2024-08-17T02:45:41.870954+0000","last_fullsized":"2024-08-17T02:45:41.870954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:03.754114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.878538+0000","last_change":"2024-08-17T02:45:40.835613+0000","last_active":"2024-08-17T02:45:41.878538+0000","last_peered":"2024-08-17T02:45:41.878538+0000","last_clean":"2024-08-17T02:45:41.878538+0000","last_became_active":"2024-08-17T02:45:40.835051+0000","last_became_peered":"2024-08-17T02:45:40.835051+0000","last_unstale":"2024-08-17T02:45:41.878538+0000","last_undegraded":"2024-08-17T02:45:41.878538+0000","last_fullsized":"2024-08-17T02:45:41.878538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:13.885252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.879176+0000","last_change":"2024-08-17T02:45:41.876204+0000","last_active":"2024-08-17T02:45:41.879176+0000","last_peered":"2024-08-17T02:45:41.879176+0000","last_clean":"2024-08-17T02:45:41.879176+0000","last_became_active":"2024-08-17T02:45:41.875536+0000","last_became_peered":"2024-08-17T02:45:41.875536+0000","last_unstale":"2024-08-17T02:45:41.879176+0000","last_undegraded":"2024-08-17T02:45:41.879176+0000","last_fullsized":"2024-08-17T02:45:41.879176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:47:30.233998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.884435+0000","last_change":"2024-08-17T02:45:40.852072+0000","last_active":"2024-08-17T02:45:41.884435+0000","last_peered":"2024-08-17T02:45:41.884435+0000","last_clean":"2024-08-17T02:45:41.884435+0000","last_became_active":"2024-08-17T02:45:40.851346+0000","last_became_peered":"2024-08-17T02:45:40.851346+0000","last_unstale":"2024-08-17T02:45:41.884435+0000","last_undegraded":"2024-08-17T02:45:41.884435+0000","last_fullsized":"2024-08-17T02:45:41.884435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:26:40.603861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886342+0000","last_change":"2024-08-17T02:45:41.884514+0000","last_active":"2024-08-17T02:45:41.886342+0000","last_peered":"2024-08-17T02:45:41.886342+0000","last_clean":"2024-08-17T02:45:41.886342+0000","last_became_active":"2024-08-17T02:45:41.883843+0000","last_became_peered":"2024-08-17T02:45:41.883843+0000","last_unstale":"2024-08-17T02:45:41.886342+0000","last_undegraded":"2024-08-17T02:45:41.886342+0000","last_fullsized":"2024-08-17T02:45:41.886342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:08:27.775215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.873328+0000","last_change":"2024-08-17T02:45:40.842420+0000","last_active":"2024-08-17T02:45:41.873328+0000","last_peered":"2024-08-17T02:45:41.873328+0000","last_clean":"2024-08-17T02:45:41.873328+0000","last_became_active":"2024-08-17T02:45:40.842134+0000","last_became_peered":"2024-08-17T02:45:40.842134+0000","last_unstale":"2024-08-17T02:45:41.873328+0000","last_undegraded":"2024-08-17T02:45:41.873328+0000","last_fullsized":"2024-08-17T02:45:41.873328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:19.561224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886470+0000","last_change":"2024-08-17T02:45:41.885453+0000","last_active":"2024-08-17T02:45:41.886470+0000","last_peered":"2024-08-17T02:45:41.886470+0000","last_clean":"2024-08-17T02:45:41.886470+0000","last_became_active":"2024-08-17T02:45:41.885194+0000","last_became_peered":"2024-08-17T02:45:41.885194+0000","last_unstale":"2024-08-17T02:45:41.886470+0000","last_undegraded":"2024-08-17T02:45:41.886470+0000","last_fullsized":"2024-08-17T02:45:41.886470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:41:42.486969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886577+0000","last_change":"2024-08-17T02:45:40.843903+0000","last_active":"2024-08-17T02:45:41.886577+0000","last_peered":"2024-08-17T02:45:41.886577+0000","last_clean":"2024-08-17T02:45:41.886577+0000","last_became_active":"2024-08-17T02:45:40.841473+0000","last_became_peered":"2024-08-17T02:45:40.841473+0000","last_unstale":"2024-08-17T02:45:41.886577+0000","last_undegraded":"2024-08-17T02:45:41.886577+0000","last_fullsized":"2024-08-17T02:45:41.886577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:20.067847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.855084+0000","last_change":"2024-08-17T02:45:41.849797+0000","last_active":"2024-08-17T02:45:41.855084+0000","last_peered":"2024-08-17T02:45:41.855084+0000","last_clean":"2024-08-17T02:45:41.855084+0000","last_became_active":"2024-08-17T02:45:41.849495+0000","last_became_peered":"2024-08-17T02:45:41.849495+0000","last_unstale":"2024-08-17T02:45:41.855084+0000","last_undegraded":"2024-08-17T02:45:41.855084+0000","last_fullsized":"2024-08-17T02:45:41.855084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:44.220882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.841551+0000","last_change":"2024-08-17T02:45:40.858186+0000","last_active":"2024-08-17T02:45:41.841551+0000","last_peered":"2024-08-17T02:45:41.841551+0000","last_clean":"2024-08-17T02:45:41.841551+0000","last_became_active":"2024-08-17T02:45:40.857956+0000","last_became_peered":"2024-08-17T02:45:40.857956+0000","last_unstale":"2024-08-17T02:45:41.841551+0000","last_undegraded":"2024-08-17T02:45:41.841551+0000","last_fullsized":"2024-08-17T02:45:41.841551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:52:22.103135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.874128+0000","last_change":"2024-08-17T02:45:41.866120+0000","last_active":"2024-08-17T02:45:41.874128+0000","last_peered":"2024-08-17T02:45:41.874128+0000","last_clean":"2024-08-17T02:45:41.874128+0000","last_became_active":"2024-08-17T02:45:41.865856+0000","last_became_peered":"2024-08-17T02:45:41.865856+0000","last_unstale":"2024-08-17T02:45:41.874128+0000","last_undegraded":"2024-08-17T02:45:41.874128+0000","last_fullsized":"2024-08-17T02:45:41.874128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:50:37.265026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.852465+0000","last_change":"2024-08-17T02:45:37.011679+0000","last_active":"2024-08-17T02:45:41.852465+0000","last_peered":"2024-08-17T02:45:41.852465+0000","last_clean":"2024-08-17T02:45:41.852465+0000","last_became_active":"2024-08-17T02:45:37.010559+0000","last_became_peered":"2024-08-17T02:45:37.010559+0000","last_unstale":"2024-08-17T02:45:41.852465+0000","last_undegraded":"2024-08-17T02:45:41.852465+0000","last_fullsized":"2024-08-17T02:45:41.852465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:35.708391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:35.708391+0000","last_clean_scrub_stamp":"2024-08-17T02:45:35.708391+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:11.380093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.840462+0000","last_change":"2024-08-17T02:45:40.848763+0000","last_active":"2024-08-17T02:45:41.840462+0000","last_peered":"2024-08-17T02:45:41.840462+0000","last_clean":"2024-08-17T02:45:41.840462+0000","last_became_active":"2024-08-17T02:45:40.847935+0000","last_became_peered":"2024-08-17T02:45:40.847935+0000","last_unstale":"2024-08-17T02:45:41.840462+0000","last_undegraded":"2024-08-17T02:45:41.840462+0000","last_fullsized":"2024-08-17T02:45:41.840462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:15.864750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.851312+0000","last_change":"2024-08-17T02:45:41.846412+0000","last_active":"2024-08-17T02:45:41.851312+0000","last_peered":"2024-08-17T02:45:41.851312+0000","last_clean":"2024-08-17T02:45:41.851312+0000","last_became_active":"2024-08-17T02:45:41.846136+0000","last_became_peered":"2024-08-17T02:45:41.846136+0000","last_unstale":"2024-08-17T02:45:41.851312+0000","last_undegraded":"2024-08-17T02:45:41.851312+0000","last_fullsized":"2024-08-17T02:45:41.851312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:06.130481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.852345+0000","last_change":"2024-08-17T02:45:40.858420+0000","last_active":"2024-08-17T02:45:41.852345+0000","last_peered":"2024-08-17T02:45:41.852345+0000","last_clean":"2024-08-17T02:45:41.852345+0000","last_became_active":"2024-08-17T02:45:40.858149+0000","last_became_peered":"2024-08-17T02:45:40.858149+0000","last_unstale":"2024-08-17T02:45:41.852345+0000","last_undegraded":"2024-08-17T02:45:41.852345+0000","last_fullsized":"2024-08-17T02:45:41.852345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:48.334950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.872483+0000","last_change":"2024-08-17T02:45:41.864808+0000","last_active":"2024-08-17T02:45:41.872483+0000","last_peered":"2024-08-17T02:45:41.872483+0000","last_clean":"2024-08-17T02:45:41.872483+0000","last_became_active":"2024-08-17T02:45:41.864397+0000","last_became_peered":"2024-08-17T02:45:41.864397+0000","last_unstale":"2024-08-17T02:45:41.872483+0000","last_undegraded":"2024-08-17T02:45:41.872483+0000","last_fullsized":"2024-08-17T02:45:41.872483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:44.425401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.842270+0000","last_change":"2024-08-17T02:45:40.843284+0000","last_active":"2024-08-17T02:45:41.842270+0000","last_peered":"2024-08-17T02:45:41.842270+0000","last_clean":"2024-08-17T02:45:41.842270+0000","last_became_active":"2024-08-17T02:45:40.842914+0000","last_became_peered":"2024-08-17T02:45:40.842914+0000","last_unstale":"2024-08-17T02:45:41.842270+0000","last_undegraded":"2024-08-17T02:45:41.842270+0000","last_fullsized":"2024-08-17T02:45:41.842270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:03.324359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.859058+0000","last_change":"2024-08-17T02:45:41.855267+0000","last_active":"2024-08-17T02:45:41.859058+0000","last_peered":"2024-08-17T02:45:41.859058+0000","last_clean":"2024-08-17T02:45:41.859058+0000","last_became_active":"2024-08-17T02:45:41.854987+0000","last_became_peered":"2024-08-17T02:45:41.854987+0000","last_unstale":"2024-08-17T02:45:41.859058+0000","last_undegraded":"2024-08-17T02:45:41.859058+0000","last_fullsized":"2024-08-17T02:45:41.859058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:00.504734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.842257+0000","last_change":"2024-08-17T02:45:40.848058+0000","last_active":"2024-08-17T02:45:41.842257+0000","last_peered":"2024-08-17T02:45:41.842257+0000","last_clean":"2024-08-17T02:45:41.842257+0000","last_became_active":"2024-08-17T02:45:40.846274+0000","last_became_peered":"2024-08-17T02:45:40.846274+0000","last_unstale":"2024-08-17T02:45:41.842257+0000","last_undegraded":"2024-08-17T02:45:41.842257+0000","last_fullsized":"2024-08-17T02:45:41.842257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:13.885252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.876964+0000","last_change":"2024-08-17T02:45:41.864247+0000","last_active":"2024-08-17T02:45:41.876964+0000","last_peered":"2024-08-17T02:45:41.876964+0000","last_clean":"2024-08-17T02:45:41.876964+0000","last_became_active":"2024-08-17T02:45:41.861904+0000","last_became_peered":"2024-08-17T02:45:41.861904+0000","last_unstale":"2024-08-17T02:45:41.876964+0000","last_undegraded":"2024-08-17T02:45:41.876964+0000","last_fullsized":"2024-08-17T02:45:41.876964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:25.446485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.847751+0000","last_change":"2024-08-17T02:45:40.851172+0000","last_active":"2024-08-17T02:45:41.847751+0000","last_peered":"2024-08-17T02:45:41.847751+0000","last_clean":"2024-08-17T02:45:41.847751+0000","last_became_active":"2024-08-17T02:45:40.850891+0000","last_became_peered":"2024-08-17T02:45:40.850891+0000","last_unstale":"2024-08-17T02:45:41.847751+0000","last_undegraded":"2024-08-17T02:45:41.847751+0000","last_fullsized":"2024-08-17T02:45:41.847751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:30.021288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.865063+0000","last_change":"2024-08-17T02:45:41.853051+0000","last_active":"2024-08-17T02:45:41.865063+0000","last_peered":"2024-08-17T02:45:41.865063+0000","last_clean":"2024-08-17T02:45:41.865063+0000","last_became_active":"2024-08-17T02:45:41.852732+0000","last_became_peered":"2024-08-17T02:45:41.852732+0000","last_unstale":"2024-08-17T02:45:41.865063+0000","last_undegraded":"2024-08-17T02:45:41.865063+0000","last_fullsized":"2024-08-17T02:45:41.865063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:06.130481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.856490+0000","last_change":"2024-08-17T02:45:40.863294+0000","last_active":"2024-08-17T02:45:41.856490+0000","last_peered":"2024-08-17T02:45:41.856490+0000","last_clean":"2024-08-17T02:45:41.856490+0000","last_became_active":"2024-08-17T02:45:40.863098+0000","last_became_peered":"2024-08-17T02:45:40.863098+0000","last_unstale":"2024-08-17T02:45:41.856490+0000","last_undegraded":"2024-08-17T02:45:41.856490+0000","last_fullsized":"2024-08-17T02:45:41.856490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:34:13.760542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.858888+0000","last_change":"2024-08-17T02:45:41.852369+0000","last_active":"2024-08-17T02:45:41.858888+0000","last_peered":"2024-08-17T02:45:41.858888+0000","last_clean":"2024-08-17T02:45:41.858888+0000","last_became_active":"2024-08-17T02:45:41.852188+0000","last_became_peered":"2024-08-17T02:45:41.852188+0000","last_unstale":"2024-08-17T02:45:41.858888+0000","last_undegraded":"2024-08-17T02:45:41.858888+0000","last_fullsized":"2024-08-17T02:45:41.858888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:35:47.023580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:45:42.859165+0000","last_change":"2024-08-17T02:45:40.854078+0000","last_active":"2024-08-17T02:45:42.859165+0000","last_peered":"2024-08-17T02:45:42.859165+0000","last_clean":"2024-08-17T02:45:42.859165+0000","last_became_active":"2024-08-17T02:45:40.853737+0000","last_became_peered":"2024-08-17T02:45:40.853737+0000","last_unstale":"2024-08-17T02:45:42.859165+0000","last_undegraded":"2024-08-17T02:45:42.859165+0000","last_fullsized":"2024-08-17T02:45:42.859165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:43.419530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.865212+0000","last_change":"2024-08-17T02:45:41.861623+0000","last_active":"2024-08-17T02:45:41.865212+0000","last_peered":"2024-08-17T02:45:41.865212+0000","last_clean":"2024-08-17T02:45:41.865212+0000","last_became_active":"2024-08-17T02:45:41.861378+0000","last_became_peered":"2024-08-17T02:45:41.861378+0000","last_unstale":"2024-08-17T02:45:41.865212+0000","last_undegraded":"2024-08-17T02:45:41.865212+0000","last_fullsized":"2024-08-17T02:45:41.865212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:01.344799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.881441+0000","last_change":"2024-08-17T02:45:40.857808+0000","last_active":"2024-08-17T02:45:41.881441+0000","last_peered":"2024-08-17T02:45:41.881441+0000","last_clean":"2024-08-17T02:45:41.881441+0000","last_became_active":"2024-08-17T02:45:40.857551+0000","last_became_peered":"2024-08-17T02:45:40.857551+0000","last_unstale":"2024-08-17T02:45:41.881441+0000","last_undegraded":"2024-08-17T02:45:41.881441+0000","last_fullsized":"2024-08-17T02:45:41.881441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:08.041685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.872662+0000","last_change":"2024-08-17T02:45:41.864378+0000","last_active":"2024-08-17T02:45:41.872662+0000","last_peered":"2024-08-17T02:45:41.872662+0000","last_clean":"2024-08-17T02:45:41.872662+0000","last_became_active":"2024-08-17T02:45:41.864154+0000","last_became_peered":"2024-08-17T02:45:41.864154+0000","last_unstale":"2024-08-17T02:45:41.872662+0000","last_undegraded":"2024-08-17T02:45:41.872662+0000","last_fullsized":"2024-08-17T02:45:41.872662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:02.801412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.852235+0000","last_change":"2024-08-17T02:45:40.857559+0000","last_active":"2024-08-17T02:45:41.852235+0000","last_peered":"2024-08-17T02:45:41.852235+0000","last_clean":"2024-08-17T02:45:41.852235+0000","last_became_active":"2024-08-17T02:45:40.856889+0000","last_became_peered":"2024-08-17T02:45:40.856889+0000","last_unstale":"2024-08-17T02:45:41.852235+0000","last_undegraded":"2024-08-17T02:45:41.852235+0000","last_fullsized":"2024-08-17T02:45:41.852235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:26.959391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.873161+0000","last_change":"2024-08-17T02:45:41.861090+0000","last_active":"2024-08-17T02:45:41.873161+0000","last_peered":"2024-08-17T02:45:41.873161+0000","last_clean":"2024-08-17T02:45:41.873161+0000","last_became_active":"2024-08-17T02:45:41.860752+0000","last_became_peered":"2024-08-17T02:45:41.860752+0000","last_unstale":"2024-08-17T02:45:41.873161+0000","last_undegraded":"2024-08-17T02:45:41.873161+0000","last_fullsized":"2024-08-17T02:45:41.873161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:44.425401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.849695+0000","last_change":"2024-08-17T02:45:40.855151+0000","last_active":"2024-08-17T02:45:41.849695+0000","last_peered":"2024-08-17T02:45:41.849695+0000","last_clean":"2024-08-17T02:45:41.849695+0000","last_became_active":"2024-08-17T02:45:40.854968+0000","last_became_peered":"2024-08-17T02:45:40.854968+0000","last_unstale":"2024-08-17T02:45:41.849695+0000","last_undegraded":"2024-08-17T02:45:41.849695+0000","last_fullsized":"2024-08-17T02:45:41.849695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:13.885252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.861997+0000","last_change":"2024-08-17T02:45:41.857268+0000","last_active":"2024-08-17T02:45:41.861997+0000","last_peered":"2024-08-17T02:45:41.861997+0000","last_clean":"2024-08-17T02:45:41.861997+0000","last_became_active":"2024-08-17T02:45:41.856839+0000","last_became_peered":"2024-08-17T02:45:41.856839+0000","last_unstale":"2024-08-17T02:45:41.861997+0000","last_undegraded":"2024-08-17T02:45:41.861997+0000","last_fullsized":"2024-08-17T02:45:41.861997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:25.446485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.848840+0000","last_change":"2024-08-17T02:45:40.843100+0000","last_active":"2024-08-17T02:45:41.848840+0000","last_peered":"2024-08-17T02:45:41.848840+0000","last_clean":"2024-08-17T02:45:41.848840+0000","last_became_active":"2024-08-17T02:45:40.842206+0000","last_became_peered":"2024-08-17T02:45:40.842206+0000","last_unstale":"2024-08-17T02:45:41.848840+0000","last_undegraded":"2024-08-17T02:45:41.848840+0000","last_fullsized":"2024-08-17T02:45:41.848840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:52:22.103135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.872919+0000","last_change":"2024-08-17T02:45:41.865819+0000","last_active":"2024-08-17T02:45:41.872919+0000","last_peered":"2024-08-17T02:45:41.872919+0000","last_clean":"2024-08-17T02:45:41.872919+0000","last_became_active":"2024-08-17T02:45:41.865537+0000","last_became_peered":"2024-08-17T02:45:41.865537+0000","last_unstale":"2024-08-17T02:45:41.872919+0000","last_undegraded":"2024-08-17T02:45:41.872919+0000","last_fullsized":"2024-08-17T02:45:41.872919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:44.220882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.887173+0000","last_change":"2024-08-17T02:45:40.861158+0000","last_active":"2024-08-17T02:45:41.887173+0000","last_peered":"2024-08-17T02:45:41.887173+0000","last_clean":"2024-08-17T02:45:41.887173+0000","last_became_active":"2024-08-17T02:45:40.860714+0000","last_became_peered":"2024-08-17T02:45:40.860714+0000","last_unstale":"2024-08-17T02:45:41.887173+0000","last_undegraded":"2024-08-17T02:45:41.887173+0000","last_fullsized":"2024-08-17T02:45:41.887173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:52:04.471737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.885525+0000","last_change":"2024-08-17T02:45:41.881747+0000","last_active":"2024-08-17T02:45:41.885525+0000","last_peered":"2024-08-17T02:45:41.885525+0000","last_clean":"2024-08-17T02:45:41.885525+0000","last_became_active":"2024-08-17T02:45:41.880618+0000","last_became_peered":"2024-08-17T02:45:41.880618+0000","last_unstale":"2024-08-17T02:45:41.885525+0000","last_undegraded":"2024-08-17T02:45:41.885525+0000","last_fullsized":"2024-08-17T02:45:41.885525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:03:23.967191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.867016+0000","last_change":"2024-08-17T02:45:41.862264+0000","last_active":"2024-08-17T02:45:41.867016+0000","last_peered":"2024-08-17T02:45:41.867016+0000","last_clean":"2024-08-17T02:45:41.867016+0000","last_became_active":"2024-08-17T02:45:41.862036+0000","last_became_peered":"2024-08-17T02:45:41.862036+0000","last_unstale":"2024-08-17T02:45:41.867016+0000","last_undegraded":"2024-08-17T02:45:41.867016+0000","last_fullsized":"2024-08-17T02:45:41.867016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:31:57.128164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886946+0000","last_change":"2024-08-17T02:45:40.860423+0000","last_active":"2024-08-17T02:45:41.886946+0000","last_peered":"2024-08-17T02:45:41.886946+0000","last_clean":"2024-08-17T02:45:41.886946+0000","last_became_active":"2024-08-17T02:45:40.860126+0000","last_became_peered":"2024-08-17T02:45:40.860126+0000","last_unstale":"2024-08-17T02:45:41.886946+0000","last_undegraded":"2024-08-17T02:45:41.886946+0000","last_fullsized":"2024-08-17T02:45:41.886946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:43:21.770605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886285+0000","last_change":"2024-08-17T02:45:41.880348+0000","last_active":"2024-08-17T02:45:41.886285+0000","last_peered":"2024-08-17T02:45:41.886285+0000","last_clean":"2024-08-17T02:45:41.886285+0000","last_became_active":"2024-08-17T02:45:41.879896+0000","last_became_peered":"2024-08-17T02:45:41.879896+0000","last_unstale":"2024-08-17T02:45:41.886285+0000","last_undegraded":"2024-08-17T02:45:41.886285+0000","last_fullsized":"2024-08-17T02:45:41.886285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:09.195225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886135+0000","last_change":"2024-08-17T02:45:40.862857+0000","last_active":"2024-08-17T02:45:41.886135+0000","last_peered":"2024-08-17T02:45:41.886135+0000","last_clean":"2024-08-17T02:45:41.886135+0000","last_became_active":"2024-08-17T02:45:40.862629+0000","last_became_peered":"2024-08-17T02:45:40.862629+0000","last_unstale":"2024-08-17T02:45:41.886135+0000","last_undegraded":"2024-08-17T02:45:41.886135+0000","last_fullsized":"2024-08-17T02:45:41.886135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:30:25.700503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.869810+0000","last_change":"2024-08-17T02:45:41.863606+0000","last_active":"2024-08-17T02:45:41.869810+0000","last_peered":"2024-08-17T02:45:41.869810+0000","last_clean":"2024-08-17T02:45:41.869810+0000","last_became_active":"2024-08-17T02:45:41.863332+0000","last_became_peered":"2024-08-17T02:45:41.863332+0000","last_unstale":"2024-08-17T02:45:41.869810+0000","last_undegraded":"2024-08-17T02:45:41.869810+0000","last_fullsized":"2024-08-17T02:45:41.869810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:09.195225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.875437+0000","last_change":"2024-08-17T02:45:40.851226+0000","last_active":"2024-08-17T02:45:41.875437+0000","last_peered":"2024-08-17T02:45:41.875437+0000","last_clean":"2024-08-17T02:45:41.875437+0000","last_became_active":"2024-08-17T02:45:40.850945+0000","last_became_peered":"2024-08-17T02:45:40.850945+0000","last_unstale":"2024-08-17T02:45:41.875437+0000","last_undegraded":"2024-08-17T02:45:41.875437+0000","last_fullsized":"2024-08-17T02:45:41.875437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:00:43.864087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.875679+0000","last_change":"2024-08-17T02:45:41.871607+0000","last_active":"2024-08-17T02:45:41.875679+0000","last_peered":"2024-08-17T02:45:41.875679+0000","last_clean":"2024-08-17T02:45:41.875679+0000","last_became_active":"2024-08-17T02:45:41.871278+0000","last_became_peered":"2024-08-17T02:45:41.871278+0000","last_unstale":"2024-08-17T02:45:41.875679+0000","last_undegraded":"2024-08-17T02:45:41.875679+0000","last_fullsized":"2024-08-17T02:45:41.875679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:02.143166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.884575+0000","last_change":"2024-08-17T02:45:40.857851+0000","last_active":"2024-08-17T02:45:41.884575+0000","last_peered":"2024-08-17T02:45:41.884575+0000","last_clean":"2024-08-17T02:45:41.884575+0000","last_became_active":"2024-08-17T02:45:40.857532+0000","last_became_peered":"2024-08-17T02:45:40.857532+0000","last_unstale":"2024-08-17T02:45:41.884575+0000","last_undegraded":"2024-08-17T02:45:41.884575+0000","last_fullsized":"2024-08-17T02:45:41.884575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:25:01.252070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":823296,"data_stored":669460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":237568,"data_stored":80074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":229376,"data_stored":78612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":237568,"data_stored":78648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":237568,"data_stored":80074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":225280,"data_stored":78522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":233472,"data_stored":78682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298168,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073672,"statfs":{"total":96636764160,"available":96331440128,"internally_reserved":0,"allocated":831488,"data_stored":669516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:45:50.918 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:45:51.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.102+0000 7f1fe8a00640 1 Processor -- start 2024-08-17T02:45:51.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.102+0000 7f1fe8a00640 1 -- start start 2024-08-17T02:45:51.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.103+0000 7f1fe8a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1fe40ccca0 0x7f1fe4163870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:51.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.103+0000 7f1fe8a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe40cadc0 con 0x7f1fe40ceb40 2024-08-17T02:45:51.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.103+0000 7f1fe8a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe40cb060 con 0x7f1fe4159ca0 2024-08-17T02:45:51.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.103+0000 7f1fe8a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe40cd6e0 con 0x7f1fe40ccca0 2024-08-17T02:45:51.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.104+0000 7f1fe3200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1fe40ccca0 0x7f1fe4163870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:51.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.104+0000 7f1fe1e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1fe40ceb40 0x7f1fe40cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37510/0 (socket says 172.21.15.100:37510) 2024-08-17T02:45:51.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.104+0000 7f1fe1e00640 1 -- 172.21.15.100:0/3361817738 learned_addr learned my addr 172.21.15.100:0/3361817738 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:51.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.104+0000 7f1fe1400640 1 -- 172.21.15.100:0/3361817738 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74526682 0 0) 0x7f1fe40cadc0 con 0x7f1fe40ceb40 2024-08-17T02:45:51.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.104+0000 7f1fe3200640 1 -- 172.21.15.100:0/3361817738 >> v1:172.21.15.123:6789/0 conn(0x7f1fe4159ca0 legacy=0x7f1fe40ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:51.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.104+0000 7f1fe3200640 1 -- 172.21.15.100:0/3361817738 >> v1:172.21.15.100:6789/0 conn(0x7f1fe40ceb40 legacy=0x7f1fe40cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:51.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.104+0000 7f1fe3200640 1 -- 172.21.15.100:0/3361817738 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe40cb300 con 0x7f1fe40ccca0 2024-08-17T02:45:51.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.105+0000 7f1fe3200640 1 --2- 172.21.15.100:0/3361817738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fe40ccca0 0x7f1fe4163870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009e60 tx=0x7f1fdc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f562e292888a43b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:51.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.105+0000 7f1fe1400640 1 -- 172.21.15.100:0/3361817738 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc007550 con 0x7f1fe40ccca0 2024-08-17T02:45:51.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.105+0000 7f1fe1400640 1 -- 172.21.15.100:0/3361817738 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc02d050 con 0x7f1fe40ccca0 2024-08-17T02:45:51.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.105+0000 7f1fe1400640 1 -- 172.21.15.100:0/3361817738 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc007900 con 0x7f1fe40ccca0 2024-08-17T02:45:51.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.106+0000 7f1fe8a00640 1 -- 172.21.15.100:0/3361817738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fe40ccca0 msgr2=0x7f1fe4163870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:51.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.106+0000 7f1fe8a00640 1 --2- 172.21.15.100:0/3361817738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fe40ccca0 0x7f1fe4163870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009e60 tx=0x7f1fdc009780 comp rx=0 tx=0).stop 2024-08-17T02:45:51.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.106+0000 7f1fe8a00640 1 -- 172.21.15.100:0/3361817738 shutdown_connections 2024-08-17T02:45:51.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.106+0000 7f1fe8a00640 1 --2- 172.21.15.100:0/3361817738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fe40ccca0 0x7f1fe4163870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.106+0000 7f1fe8a00640 1 -- 172.21.15.100:0/3361817738 >> 172.21.15.100:0/3361817738 conn(0x7f1fe4098e00 msgr2=0x7f1fe406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:51.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.106+0000 7f1fe8a00640 1 -- 172.21.15.100:0/3361817738 shutdown_connections 2024-08-17T02:45:51.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.106+0000 7f1fe8a00640 1 -- 172.21.15.100:0/3361817738 wait complete. 2024-08-17T02:45:51.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.107+0000 7f1fe8a00640 1 Processor -- start 2024-08-17T02:45:51.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.108+0000 7f1fe8a00640 1 -- start start 2024-08-17T02:45:51.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.108+0000 7f1fe8a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe40ccca0 0x7f1fe40c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:51.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.108+0000 7f1fe8a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1fe40ceb40 0x7f1fe4168f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:51.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.108+0000 7f1fe8a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fe4159ca0 0x7f1fe41694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:51.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.108+0000 7f1fe8a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40b3230 con 0x7f1fe40ccca0 2024-08-17T02:45:51.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.108+0000 7f1fe8a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40c6040 con 0x7f1fe4159ca0 2024-08-17T02:45:51.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.108+0000 7f1fe8a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40c6320 con 0x7f1fe40ceb40 2024-08-17T02:45:51.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.109+0000 7f1fe2800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe40ccca0 0x7f1fe40c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:51.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.109+0000 7f1fe2800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe40ccca0 0x7f1fe40c5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33284/0 (socket says 172.21.15.100:33284) 2024-08-17T02:45:51.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.109+0000 7f1fe2800640 1 -- 172.21.15.100:0/1633986547 learned_addr learned my addr 172.21.15.100:0/1633986547 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:51.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.109+0000 7f1fe1e00640 1 --2- 172.21.15.100:0/1633986547 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1fe40ceb40 0x7f1fe4168f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:51.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.109+0000 7f1fe3200640 1 --2- 172.21.15.100:0/1633986547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fe4159ca0 0x7f1fe41694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:51.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.109+0000 7f1fe2800640 1 -- 172.21.15.100:0/1633986547 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1fe40ceb40 msgr2=0x7f1fe4168f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:51.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.109+0000 7f1fe2800640 1 --2- 172.21.15.100:0/1633986547 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1fe40ceb40 0x7f1fe4168f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.109+0000 7f1fe2800640 1 -- 172.21.15.100:0/1633986547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fe4159ca0 msgr2=0x7f1fe41694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:51.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.109+0000 7f1fe2800640 1 --2- 172.21.15.100:0/1633986547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fe4159ca0 0x7f1fe41694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.109+0000 7f1fe2800640 1 -- 172.21.15.100:0/1633986547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc009a20 con 0x7f1fe40ccca0 2024-08-17T02:45:51.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.109+0000 7f1fe2800640 1 --2- 172.21.15.100:0/1633986547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe40ccca0 0x7f1fe40c5610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400c4c0 tx=0x7f1fd4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:51.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.110+0000 7f1fda000640 1 -- 172.21.15.100:0/1633986547 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4011590 con 0x7f1fe40ccca0 2024-08-17T02:45:51.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.110+0000 7f1fda000640 1 -- 172.21.15.100:0/1633986547 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd4011710 con 0x7f1fe40ccca0 2024-08-17T02:45:51.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.110+0000 7f1fda000640 1 -- 172.21.15.100:0/1633986547 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4011ad0 con 0x7f1fe40ccca0 2024-08-17T02:45:51.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.110+0000 7f1fe8a00640 1 -- 172.21.15.100:0/1633986547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe40b2be0 con 0x7f1fe40ccca0 2024-08-17T02:45:51.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.110+0000 7f1fe8a00640 1 -- 172.21.15.100:0/1633986547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe416a170 con 0x7f1fe40ccca0 2024-08-17T02:45:51.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.111+0000 7f1fe8a00640 1 -- 172.21.15.100:0/1633986547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe4071050 con 0x7f1fe40ccca0 2024-08-17T02:45:51.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.111+0000 7f1fda000640 1 -- 172.21.15.100:0/1633986547 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1fd401b3b0 con 0x7f1fe40ccca0 2024-08-17T02:45:51.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.112+0000 7f1fda000640 1 --2- 172.21.15.100:0/1633986547 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1fc4065180 0x7f1fc4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:51.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.112+0000 7f1fda000640 1 -- 172.21.15.100:0/1633986547 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1fd4081880 con 0x7f1fe40ccca0 2024-08-17T02:45:51.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.113+0000 7f1fe1e00640 1 --2- 172.21.15.100:0/1633986547 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1fc4065180 0x7f1fc4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:51.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.113+0000 7f1fe1e00640 1 --2- 172.21.15.100:0/1633986547 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1fc4065180 0x7f1fc4067630 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1fe415f500 tx=0x7f1fd0007ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.116+0000 7f1fda000640 1 -- 172.21.15.100:0/1633986547 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1fd404f950 con 0x7f1fe40ccca0 2024-08-17T02:45:51.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.283+0000 7f1fe8a00640 1 -- 172.21.15.100:0/1633986547 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1fe40b3370 con 0x7f1fc4065180 2024-08-17T02:45:51.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.290+0000 7f1fda000640 1 -- 172.21.15.100:0/1633986547 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264595 (secure 0 0 0) 0x7f1fd00075f0 con 0x7f1fc4065180 2024-08-17T02:45:51.294 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:51.295 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-08-17T02:45:51.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.293+0000 7f1fe8a00640 1 -- 172.21.15.100:0/1633986547 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1fc4065180 msgr2=0x7f1fc4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:51.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.293+0000 7f1fe8a00640 1 --2- 172.21.15.100:0/1633986547 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1fc4065180 0x7f1fc4067630 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1fe415f500 tx=0x7f1fd0007ca0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.294+0000 7f1fe8a00640 1 -- 172.21.15.100:0/1633986547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe40ccca0 msgr2=0x7f1fe40c5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:51.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.294+0000 7f1fe8a00640 1 --2- 172.21.15.100:0/1633986547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe40ccca0 0x7f1fe40c5610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400c4c0 tx=0x7f1fd4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.294+0000 7f1fe8a00640 1 -- 172.21.15.100:0/1633986547 shutdown_connections 2024-08-17T02:45:51.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.294+0000 7f1fe8a00640 1 --2- 172.21.15.100:0/1633986547 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1fc4065180 0x7f1fc4067630 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.294+0000 7f1fe8a00640 1 --2- 172.21.15.100:0/1633986547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fe4159ca0 0x7f1fe41694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.294+0000 7f1fe8a00640 1 --2- 172.21.15.100:0/1633986547 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1fe40ceb40 0x7f1fe4168f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.294+0000 7f1fe8a00640 1 --2- 172.21.15.100:0/1633986547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe40ccca0 0x7f1fe40c5610 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.294+0000 7f1fe8a00640 1 -- 172.21.15.100:0/1633986547 >> 172.21.15.100:0/1633986547 conn(0x7f1fe4098e00 msgr2=0x7f1fe4156110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:51.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.294+0000 7f1fe8a00640 1 -- 172.21.15.100:0/1633986547 shutdown_connections 2024-08-17T02:45:51.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.294+0000 7f1fe8a00640 1 -- 172.21.15.100:0/1633986547 wait complete. 2024-08-17T02:45:51.309 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-08-17T02:45:51.091276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381844,"kb_used_data":2984,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592876,"statfs":{"total":773094113280,"available":770655105024,"internally_reserved":0,"allocated":3055616,"data_stored":1813588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.252268"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.884819+0000","last_change":"2024-08-17T02:45:41.879971+0000","last_active":"2024-08-17T02:45:41.884819+0000","last_peered":"2024-08-17T02:45:41.884819+0000","last_clean":"2024-08-17T02:45:41.884819+0000","last_became_active":"2024-08-17T02:45:41.879691+0000","last_became_peered":"2024-08-17T02:45:41.879691+0000","last_unstale":"2024-08-17T02:45:41.884819+0000","last_undegraded":"2024-08-17T02:45:41.884819+0000","last_fullsized":"2024-08-17T02:45:41.884819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:02:08.258895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.869545+0000","last_change":"2024-08-17T02:45:41.863383+0000","last_active":"2024-08-17T02:45:41.869545+0000","last_peered":"2024-08-17T02:45:41.869545+0000","last_clean":"2024-08-17T02:45:41.869545+0000","last_became_active":"2024-08-17T02:45:41.863151+0000","last_became_peered":"2024-08-17T02:45:41.863151+0000","last_unstale":"2024-08-17T02:45:41.869545+0000","last_undegraded":"2024-08-17T02:45:41.869545+0000","last_fullsized":"2024-08-17T02:45:41.869545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:09.195225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.864696+0000","last_change":"2024-08-17T02:45:41.859813+0000","last_active":"2024-08-17T02:45:41.864696+0000","last_peered":"2024-08-17T02:45:41.864696+0000","last_clean":"2024-08-17T02:45:41.864696+0000","last_became_active":"2024-08-17T02:45:41.859526+0000","last_became_peered":"2024-08-17T02:45:41.859526+0000","last_unstale":"2024-08-17T02:45:41.864696+0000","last_undegraded":"2024-08-17T02:45:41.864696+0000","last_fullsized":"2024-08-17T02:45:41.864696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:07.343258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.858986+0000","last_change":"2024-08-17T02:45:41.855298+0000","last_active":"2024-08-17T02:45:41.858986+0000","last_peered":"2024-08-17T02:45:41.858986+0000","last_clean":"2024-08-17T02:45:41.858986+0000","last_became_active":"2024-08-17T02:45:41.854637+0000","last_became_peered":"2024-08-17T02:45:41.854637+0000","last_unstale":"2024-08-17T02:45:41.858986+0000","last_undegraded":"2024-08-17T02:45:41.858986+0000","last_fullsized":"2024-08-17T02:45:41.858986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:02.143166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.878742+0000","last_change":"2024-08-17T02:45:41.867785+0000","last_active":"2024-08-17T02:45:41.878742+0000","last_peered":"2024-08-17T02:45:41.878742+0000","last_clean":"2024-08-17T02:45:41.878742+0000","last_became_active":"2024-08-17T02:45:41.866024+0000","last_became_peered":"2024-08-17T02:45:41.866024+0000","last_unstale":"2024-08-17T02:45:41.878742+0000","last_undegraded":"2024-08-17T02:45:41.878742+0000","last_fullsized":"2024-08-17T02:45:41.878742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:54:27.873599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.860111+0000","last_change":"2024-08-17T02:45:41.855424+0000","last_active":"2024-08-17T02:45:41.860111+0000","last_peered":"2024-08-17T02:45:41.860111+0000","last_clean":"2024-08-17T02:45:41.860111+0000","last_became_active":"2024-08-17T02:45:41.854196+0000","last_became_peered":"2024-08-17T02:45:41.854196+0000","last_unstale":"2024-08-17T02:45:41.860111+0000","last_undegraded":"2024-08-17T02:45:41.860111+0000","last_fullsized":"2024-08-17T02:45:41.860111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:01.344799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.878291+0000","last_change":"2024-08-17T02:45:41.875455+0000","last_active":"2024-08-17T02:45:41.878291+0000","last_peered":"2024-08-17T02:45:41.878291+0000","last_clean":"2024-08-17T02:45:41.878291+0000","last_became_active":"2024-08-17T02:45:41.874847+0000","last_became_peered":"2024-08-17T02:45:41.874847+0000","last_unstale":"2024-08-17T02:45:41.878291+0000","last_undegraded":"2024-08-17T02:45:41.878291+0000","last_fullsized":"2024-08-17T02:45:41.878291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:51.387674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.849358+0000","last_change":"2024-08-17T02:45:41.845108+0000","last_active":"2024-08-17T02:45:41.849358+0000","last_peered":"2024-08-17T02:45:41.849358+0000","last_clean":"2024-08-17T02:45:41.849358+0000","last_became_active":"2024-08-17T02:45:41.844922+0000","last_became_peered":"2024-08-17T02:45:41.844922+0000","last_unstale":"2024-08-17T02:45:41.849358+0000","last_undegraded":"2024-08-17T02:45:41.849358+0000","last_fullsized":"2024-08-17T02:45:41.849358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:13.016129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.884436+0000","last_change":"2024-08-17T02:45:41.879469+0000","last_active":"2024-08-17T02:45:41.884436+0000","last_peered":"2024-08-17T02:45:41.884436+0000","last_clean":"2024-08-17T02:45:41.884436+0000","last_became_active":"2024-08-17T02:45:41.879191+0000","last_became_peered":"2024-08-17T02:45:41.879191+0000","last_unstale":"2024-08-17T02:45:41.884436+0000","last_undegraded":"2024-08-17T02:45:41.884436+0000","last_fullsized":"2024-08-17T02:45:41.884436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:36.351108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.869635+0000","last_change":"2024-08-17T02:45:41.865511+0000","last_active":"2024-08-17T02:45:41.869635+0000","last_peered":"2024-08-17T02:45:41.869635+0000","last_clean":"2024-08-17T02:45:41.869635+0000","last_became_active":"2024-08-17T02:45:41.865229+0000","last_became_peered":"2024-08-17T02:45:41.865229+0000","last_unstale":"2024-08-17T02:45:41.869635+0000","last_undegraded":"2024-08-17T02:45:41.869635+0000","last_fullsized":"2024-08-17T02:45:41.869635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:24.850532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.869380+0000","last_change":"2024-08-17T02:45:41.867609+0000","last_active":"2024-08-17T02:45:41.869380+0000","last_peered":"2024-08-17T02:45:41.869380+0000","last_clean":"2024-08-17T02:45:41.869380+0000","last_became_active":"2024-08-17T02:45:41.867267+0000","last_became_peered":"2024-08-17T02:45:41.867267+0000","last_unstale":"2024-08-17T02:45:41.869380+0000","last_undegraded":"2024-08-17T02:45:41.869380+0000","last_fullsized":"2024-08-17T02:45:41.869380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:36:25.246538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.883617+0000","last_change":"2024-08-17T02:45:41.878878+0000","last_active":"2024-08-17T02:45:41.883617+0000","last_peered":"2024-08-17T02:45:41.883617+0000","last_clean":"2024-08-17T02:45:41.883617+0000","last_became_active":"2024-08-17T02:45:41.876755+0000","last_became_peered":"2024-08-17T02:45:41.876755+0000","last_unstale":"2024-08-17T02:45:41.883617+0000","last_undegraded":"2024-08-17T02:45:41.883617+0000","last_fullsized":"2024-08-17T02:45:41.883617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:15.533277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.875157+0000","last_change":"2024-08-17T02:45:41.870345+0000","last_active":"2024-08-17T02:45:41.875157+0000","last_peered":"2024-08-17T02:45:41.875157+0000","last_clean":"2024-08-17T02:45:41.875157+0000","last_became_active":"2024-08-17T02:45:41.869995+0000","last_became_peered":"2024-08-17T02:45:41.869995+0000","last_unstale":"2024-08-17T02:45:41.875157+0000","last_undegraded":"2024-08-17T02:45:41.875157+0000","last_fullsized":"2024-08-17T02:45:41.875157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:27.590592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.872965+0000","last_change":"2024-08-17T02:45:41.865428+0000","last_active":"2024-08-17T02:45:41.872965+0000","last_peered":"2024-08-17T02:45:41.872965+0000","last_clean":"2024-08-17T02:45:41.872965+0000","last_became_active":"2024-08-17T02:45:41.865184+0000","last_became_peered":"2024-08-17T02:45:41.865184+0000","last_unstale":"2024-08-17T02:45:41.872965+0000","last_undegraded":"2024-08-17T02:45:41.872965+0000","last_fullsized":"2024-08-17T02:45:41.872965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:00.504734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.867141+0000","last_change":"2024-08-17T02:45:41.862050+0000","last_active":"2024-08-17T02:45:41.867141+0000","last_peered":"2024-08-17T02:45:41.867141+0000","last_clean":"2024-08-17T02:45:41.867141+0000","last_became_active":"2024-08-17T02:45:41.861754+0000","last_became_peered":"2024-08-17T02:45:41.861754+0000","last_unstale":"2024-08-17T02:45:41.867141+0000","last_undegraded":"2024-08-17T02:45:41.867141+0000","last_fullsized":"2024-08-17T02:45:41.867141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:31:57.128164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.866857+0000","last_change":"2024-08-17T02:45:41.861246+0000","last_active":"2024-08-17T02:45:41.866857+0000","last_peered":"2024-08-17T02:45:41.866857+0000","last_clean":"2024-08-17T02:45:41.866857+0000","last_became_active":"2024-08-17T02:45:41.860955+0000","last_became_peered":"2024-08-17T02:45:41.860955+0000","last_unstale":"2024-08-17T02:45:41.866857+0000","last_undegraded":"2024-08-17T02:45:41.866857+0000","last_fullsized":"2024-08-17T02:45:41.866857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:13.016129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.867675+0000","last_change":"2024-08-17T02:45:41.863642+0000","last_active":"2024-08-17T02:45:41.867675+0000","last_peered":"2024-08-17T02:45:41.867675+0000","last_clean":"2024-08-17T02:45:41.867675+0000","last_became_active":"2024-08-17T02:45:41.863379+0000","last_became_peered":"2024-08-17T02:45:41.863379+0000","last_unstale":"2024-08-17T02:45:41.867675+0000","last_undegraded":"2024-08-17T02:45:41.867675+0000","last_fullsized":"2024-08-17T02:45:41.867675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:26.094951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.877544+0000","last_change":"2024-08-17T02:45:41.872075+0000","last_active":"2024-08-17T02:45:41.877544+0000","last_peered":"2024-08-17T02:45:41.877544+0000","last_clean":"2024-08-17T02:45:41.877544+0000","last_became_active":"2024-08-17T02:45:41.871439+0000","last_became_peered":"2024-08-17T02:45:41.871439+0000","last_unstale":"2024-08-17T02:45:41.877544+0000","last_undegraded":"2024-08-17T02:45:41.877544+0000","last_fullsized":"2024-08-17T02:45:41.877544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:15.533277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.874148+0000","last_change":"2024-08-17T02:45:41.866609+0000","last_active":"2024-08-17T02:45:41.874148+0000","last_peered":"2024-08-17T02:45:41.874148+0000","last_clean":"2024-08-17T02:45:41.874148+0000","last_became_active":"2024-08-17T02:45:41.866323+0000","last_became_peered":"2024-08-17T02:45:41.866323+0000","last_unstale":"2024-08-17T02:45:41.874148+0000","last_undegraded":"2024-08-17T02:45:41.874148+0000","last_fullsized":"2024-08-17T02:45:41.874148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:52.201878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.884941+0000","last_change":"2024-08-17T02:45:41.881550+0000","last_active":"2024-08-17T02:45:41.884941+0000","last_peered":"2024-08-17T02:45:41.884941+0000","last_clean":"2024-08-17T02:45:41.884941+0000","last_became_active":"2024-08-17T02:45:41.881022+0000","last_became_peered":"2024-08-17T02:45:41.881022+0000","last_unstale":"2024-08-17T02:45:41.884941+0000","last_undegraded":"2024-08-17T02:45:41.884941+0000","last_fullsized":"2024-08-17T02:45:41.884941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:50:11.095464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.875180+0000","last_change":"2024-08-17T02:45:41.868514+0000","last_active":"2024-08-17T02:45:41.875180+0000","last_peered":"2024-08-17T02:45:41.875180+0000","last_clean":"2024-08-17T02:45:41.875180+0000","last_became_active":"2024-08-17T02:45:41.868230+0000","last_became_peered":"2024-08-17T02:45:41.868230+0000","last_unstale":"2024-08-17T02:45:41.875180+0000","last_undegraded":"2024-08-17T02:45:41.875180+0000","last_fullsized":"2024-08-17T02:45:41.875180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:31:57.128164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.866839+0000","last_change":"2024-08-17T02:45:41.860030+0000","last_active":"2024-08-17T02:45:41.866839+0000","last_peered":"2024-08-17T02:45:41.866839+0000","last_clean":"2024-08-17T02:45:41.866839+0000","last_became_active":"2024-08-17T02:45:41.859373+0000","last_became_peered":"2024-08-17T02:45:41.859373+0000","last_unstale":"2024-08-17T02:45:41.866839+0000","last_undegraded":"2024-08-17T02:45:41.866839+0000","last_fullsized":"2024-08-17T02:45:41.866839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:44:02.932481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.867355+0000","last_change":"2024-08-17T02:45:41.862826+0000","last_active":"2024-08-17T02:45:41.867355+0000","last_peered":"2024-08-17T02:45:41.867355+0000","last_clean":"2024-08-17T02:45:41.867355+0000","last_became_active":"2024-08-17T02:45:41.862601+0000","last_became_peered":"2024-08-17T02:45:41.862601+0000","last_unstale":"2024-08-17T02:45:41.867355+0000","last_undegraded":"2024-08-17T02:45:41.867355+0000","last_fullsized":"2024-08-17T02:45:41.867355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:31:57.128164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.859156+0000","last_change":"2024-08-17T02:45:41.853293+0000","last_active":"2024-08-17T02:45:41.859156+0000","last_peered":"2024-08-17T02:45:41.859156+0000","last_clean":"2024-08-17T02:45:41.859156+0000","last_became_active":"2024-08-17T02:45:41.853030+0000","last_became_peered":"2024-08-17T02:45:41.853030+0000","last_unstale":"2024-08-17T02:45:41.859156+0000","last_undegraded":"2024-08-17T02:45:41.859156+0000","last_fullsized":"2024-08-17T02:45:41.859156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:10:57.188283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.863593+0000","last_change":"2024-08-17T02:45:41.858360+0000","last_active":"2024-08-17T02:45:41.863593+0000","last_peered":"2024-08-17T02:45:41.863593+0000","last_clean":"2024-08-17T02:45:41.863593+0000","last_became_active":"2024-08-17T02:45:41.858129+0000","last_became_peered":"2024-08-17T02:45:41.858129+0000","last_unstale":"2024-08-17T02:45:41.863593+0000","last_undegraded":"2024-08-17T02:45:41.863593+0000","last_fullsized":"2024-08-17T02:45:41.863593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:00.504734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886048+0000","last_change":"2024-08-17T02:45:41.882941+0000","last_active":"2024-08-17T02:45:41.886048+0000","last_peered":"2024-08-17T02:45:41.886048+0000","last_clean":"2024-08-17T02:45:41.886048+0000","last_became_active":"2024-08-17T02:45:41.880910+0000","last_became_peered":"2024-08-17T02:45:41.880910+0000","last_unstale":"2024-08-17T02:45:41.886048+0000","last_undegraded":"2024-08-17T02:45:41.886048+0000","last_fullsized":"2024-08-17T02:45:41.886048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:35.831054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.859157+0000","last_change":"2024-08-17T02:45:41.855434+0000","last_active":"2024-08-17T02:45:41.859157+0000","last_peered":"2024-08-17T02:45:41.859157+0000","last_clean":"2024-08-17T02:45:41.859157+0000","last_became_active":"2024-08-17T02:45:41.855036+0000","last_became_peered":"2024-08-17T02:45:41.855036+0000","last_unstale":"2024-08-17T02:45:41.859157+0000","last_undegraded":"2024-08-17T02:45:41.859157+0000","last_fullsized":"2024-08-17T02:45:41.859157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:06.130481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.878219+0000","last_change":"2024-08-17T02:45:41.875037+0000","last_active":"2024-08-17T02:45:41.878219+0000","last_peered":"2024-08-17T02:45:41.878219+0000","last_clean":"2024-08-17T02:45:41.878219+0000","last_became_active":"2024-08-17T02:45:41.874745+0000","last_became_peered":"2024-08-17T02:45:41.874745+0000","last_unstale":"2024-08-17T02:45:41.878219+0000","last_undegraded":"2024-08-17T02:45:41.878219+0000","last_fullsized":"2024-08-17T02:45:41.878219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:07.343258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.868387+0000","last_change":"2024-08-17T02:45:41.860577+0000","last_active":"2024-08-17T02:45:41.868387+0000","last_peered":"2024-08-17T02:45:41.868387+0000","last_clean":"2024-08-17T02:45:41.868387+0000","last_became_active":"2024-08-17T02:45:41.857944+0000","last_became_peered":"2024-08-17T02:45:41.857944+0000","last_unstale":"2024-08-17T02:45:41.868387+0000","last_undegraded":"2024-08-17T02:45:41.868387+0000","last_fullsized":"2024-08-17T02:45:41.868387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:06.130481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.857933+0000","last_change":"2024-08-17T02:45:41.852863+0000","last_active":"2024-08-17T02:45:41.857933+0000","last_peered":"2024-08-17T02:45:41.857933+0000","last_clean":"2024-08-17T02:45:41.857933+0000","last_became_active":"2024-08-17T02:45:41.852578+0000","last_became_peered":"2024-08-17T02:45:41.852578+0000","last_unstale":"2024-08-17T02:45:41.857933+0000","last_undegraded":"2024-08-17T02:45:41.857933+0000","last_fullsized":"2024-08-17T02:45:41.857933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:27.590592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.851184+0000","last_change":"2024-08-17T02:45:41.846025+0000","last_active":"2024-08-17T02:45:41.851184+0000","last_peered":"2024-08-17T02:45:41.851184+0000","last_clean":"2024-08-17T02:45:41.851184+0000","last_became_active":"2024-08-17T02:45:41.845713+0000","last_became_peered":"2024-08-17T02:45:41.845713+0000","last_unstale":"2024-08-17T02:45:41.851184+0000","last_undegraded":"2024-08-17T02:45:41.851184+0000","last_fullsized":"2024-08-17T02:45:41.851184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:21.073718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.874435+0000","last_change":"2024-08-17T02:45:41.870783+0000","last_active":"2024-08-17T02:45:41.874435+0000","last_peered":"2024-08-17T02:45:41.874435+0000","last_clean":"2024-08-17T02:45:41.874435+0000","last_became_active":"2024-08-17T02:45:41.870550+0000","last_became_peered":"2024-08-17T02:45:41.870550+0000","last_unstale":"2024-08-17T02:45:41.874435+0000","last_undegraded":"2024-08-17T02:45:41.874435+0000","last_fullsized":"2024-08-17T02:45:41.874435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:55:47.666421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.873947+0000","last_change":"2024-08-17T02:45:41.860580+0000","last_active":"2024-08-17T02:45:41.873947+0000","last_peered":"2024-08-17T02:45:41.873947+0000","last_clean":"2024-08-17T02:45:41.873947+0000","last_became_active":"2024-08-17T02:45:41.860364+0000","last_became_peered":"2024-08-17T02:45:41.860364+0000","last_unstale":"2024-08-17T02:45:41.873947+0000","last_undegraded":"2024-08-17T02:45:41.873947+0000","last_fullsized":"2024-08-17T02:45:41.873947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:44.911480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.878927+0000","last_change":"2024-08-17T02:45:40.856192+0000","last_active":"2024-08-17T02:45:41.878927+0000","last_peered":"2024-08-17T02:45:41.878927+0000","last_clean":"2024-08-17T02:45:41.878927+0000","last_became_active":"2024-08-17T02:45:40.856008+0000","last_became_peered":"2024-08-17T02:45:40.856008+0000","last_unstale":"2024-08-17T02:45:41.878927+0000","last_undegraded":"2024-08-17T02:45:41.878927+0000","last_fullsized":"2024-08-17T02:45:41.878927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:03.324359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.868405+0000","last_change":"2024-08-17T02:45:41.860685+0000","last_active":"2024-08-17T02:45:41.868405+0000","last_peered":"2024-08-17T02:45:41.868405+0000","last_clean":"2024-08-17T02:45:41.868405+0000","last_became_active":"2024-08-17T02:45:41.858422+0000","last_became_peered":"2024-08-17T02:45:41.858422+0000","last_unstale":"2024-08-17T02:45:41.868405+0000","last_undegraded":"2024-08-17T02:45:41.868405+0000","last_fullsized":"2024-08-17T02:45:41.868405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:25.446485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.883276+0000","last_change":"2024-08-17T02:45:40.850702+0000","last_active":"2024-08-17T02:45:41.883276+0000","last_peered":"2024-08-17T02:45:41.883276+0000","last_clean":"2024-08-17T02:45:41.883276+0000","last_became_active":"2024-08-17T02:45:40.850384+0000","last_became_peered":"2024-08-17T02:45:40.850384+0000","last_unstale":"2024-08-17T02:45:41.883276+0000","last_undegraded":"2024-08-17T02:45:41.883276+0000","last_fullsized":"2024-08-17T02:45:41.883276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:38:15.702366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.840461+0000","last_change":"2024-08-17T02:45:40.847576+0000","last_active":"2024-08-17T02:45:41.840461+0000","last_peered":"2024-08-17T02:45:41.840461+0000","last_clean":"2024-08-17T02:45:41.840461+0000","last_became_active":"2024-08-17T02:45:40.847319+0000","last_became_peered":"2024-08-17T02:45:40.847319+0000","last_unstale":"2024-08-17T02:45:41.840461+0000","last_undegraded":"2024-08-17T02:45:41.840461+0000","last_fullsized":"2024-08-17T02:45:41.840461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:19.561224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.863488+0000","last_change":"2024-08-17T02:45:41.857865+0000","last_active":"2024-08-17T02:45:41.863488+0000","last_peered":"2024-08-17T02:45:41.863488+0000","last_clean":"2024-08-17T02:45:41.863488+0000","last_became_active":"2024-08-17T02:45:41.857585+0000","last_became_peered":"2024-08-17T02:45:41.857585+0000","last_unstale":"2024-08-17T02:45:41.863488+0000","last_undegraded":"2024-08-17T02:45:41.863488+0000","last_fullsized":"2024-08-17T02:45:41.863488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:10:57.188283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.840871+0000","last_change":"2024-08-17T02:45:40.853724+0000","last_active":"2024-08-17T02:45:41.840871+0000","last_peered":"2024-08-17T02:45:41.840871+0000","last_clean":"2024-08-17T02:45:41.840871+0000","last_became_active":"2024-08-17T02:45:40.848438+0000","last_became_peered":"2024-08-17T02:45:40.848438+0000","last_unstale":"2024-08-17T02:45:41.840871+0000","last_undegraded":"2024-08-17T02:45:41.840871+0000","last_fullsized":"2024-08-17T02:45:41.840871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:52:22.103135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.859791+0000","last_change":"2024-08-17T02:45:41.856281+0000","last_active":"2024-08-17T02:45:41.859791+0000","last_peered":"2024-08-17T02:45:41.859791+0000","last_clean":"2024-08-17T02:45:41.859791+0000","last_became_active":"2024-08-17T02:45:41.855982+0000","last_became_peered":"2024-08-17T02:45:41.855982+0000","last_unstale":"2024-08-17T02:45:41.859791+0000","last_undegraded":"2024-08-17T02:45:41.859791+0000","last_fullsized":"2024-08-17T02:45:41.859791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:10:57.188283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.865649+0000","last_change":"2024-08-17T02:45:40.856916+0000","last_active":"2024-08-17T02:45:41.865649+0000","last_peered":"2024-08-17T02:45:41.865649+0000","last_clean":"2024-08-17T02:45:41.865649+0000","last_became_active":"2024-08-17T02:45:40.856729+0000","last_became_peered":"2024-08-17T02:45:40.856729+0000","last_unstale":"2024-08-17T02:45:41.865649+0000","last_undegraded":"2024-08-17T02:45:41.865649+0000","last_fullsized":"2024-08-17T02:45:41.865649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:27.561597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.876949+0000","last_change":"2024-08-17T02:45:41.876111+0000","last_active":"2024-08-17T02:45:41.876949+0000","last_peered":"2024-08-17T02:45:41.876949+0000","last_clean":"2024-08-17T02:45:41.876949+0000","last_became_active":"2024-08-17T02:45:41.872909+0000","last_became_peered":"2024-08-17T02:45:41.872909+0000","last_unstale":"2024-08-17T02:45:41.876949+0000","last_undegraded":"2024-08-17T02:45:41.876949+0000","last_fullsized":"2024-08-17T02:45:41.876949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:37.395022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.842827+0000","last_change":"2024-08-17T02:45:40.861062+0000","last_active":"2024-08-17T02:45:41.842827+0000","last_peered":"2024-08-17T02:45:41.842827+0000","last_clean":"2024-08-17T02:45:41.842827+0000","last_became_active":"2024-08-17T02:45:40.860760+0000","last_became_peered":"2024-08-17T02:45:40.860760+0000","last_unstale":"2024-08-17T02:45:41.842827+0000","last_undegraded":"2024-08-17T02:45:41.842827+0000","last_fullsized":"2024-08-17T02:45:41.842827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:19.561224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.869792+0000","last_change":"2024-08-17T02:45:41.863001+0000","last_active":"2024-08-17T02:45:41.869792+0000","last_peered":"2024-08-17T02:45:41.869792+0000","last_clean":"2024-08-17T02:45:41.869792+0000","last_became_active":"2024-08-17T02:45:41.862662+0000","last_became_peered":"2024-08-17T02:45:41.862662+0000","last_unstale":"2024-08-17T02:45:41.869792+0000","last_undegraded":"2024-08-17T02:45:41.869792+0000","last_fullsized":"2024-08-17T02:45:41.869792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:10:57.188283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.889508+0000","last_change":"2024-08-17T02:45:40.853331+0000","last_active":"2024-08-17T02:45:41.889508+0000","last_peered":"2024-08-17T02:45:41.889508+0000","last_clean":"2024-08-17T02:45:41.889508+0000","last_became_active":"2024-08-17T02:45:40.853029+0000","last_became_peered":"2024-08-17T02:45:40.853029+0000","last_unstale":"2024-08-17T02:45:41.889508+0000","last_undegraded":"2024-08-17T02:45:41.889508+0000","last_fullsized":"2024-08-17T02:45:41.889508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:43.905610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.879140+0000","last_change":"2024-08-17T02:45:41.872156+0000","last_active":"2024-08-17T02:45:41.879140+0000","last_peered":"2024-08-17T02:45:41.879140+0000","last_clean":"2024-08-17T02:45:41.879140+0000","last_became_active":"2024-08-17T02:45:41.867463+0000","last_became_peered":"2024-08-17T02:45:41.867463+0000","last_unstale":"2024-08-17T02:45:41.879140+0000","last_undegraded":"2024-08-17T02:45:41.879140+0000","last_fullsized":"2024-08-17T02:45:41.879140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:21.073718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886214+0000","last_change":"2024-08-17T02:45:40.843999+0000","last_active":"2024-08-17T02:45:41.886214+0000","last_peered":"2024-08-17T02:45:41.886214+0000","last_clean":"2024-08-17T02:45:41.886214+0000","last_became_active":"2024-08-17T02:45:40.843713+0000","last_became_peered":"2024-08-17T02:45:40.843713+0000","last_unstale":"2024-08-17T02:45:41.886214+0000","last_undegraded":"2024-08-17T02:45:41.886214+0000","last_fullsized":"2024-08-17T02:45:41.886214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:11.722334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.875620+0000","last_change":"2024-08-17T02:45:41.866615+0000","last_active":"2024-08-17T02:45:41.875620+0000","last_peered":"2024-08-17T02:45:41.875620+0000","last_clean":"2024-08-17T02:45:41.875620+0000","last_became_active":"2024-08-17T02:45:41.865961+0000","last_became_peered":"2024-08-17T02:45:41.865961+0000","last_unstale":"2024-08-17T02:45:41.875620+0000","last_undegraded":"2024-08-17T02:45:41.875620+0000","last_fullsized":"2024-08-17T02:45:41.875620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:05.492164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.884888+0000","last_change":"2024-08-17T02:45:40.847584+0000","last_active":"2024-08-17T02:45:41.884888+0000","last_peered":"2024-08-17T02:45:41.884888+0000","last_clean":"2024-08-17T02:45:41.884888+0000","last_became_active":"2024-08-17T02:45:40.847259+0000","last_became_peered":"2024-08-17T02:45:40.847259+0000","last_unstale":"2024-08-17T02:45:41.884888+0000","last_undegraded":"2024-08-17T02:45:41.884888+0000","last_fullsized":"2024-08-17T02:45:41.884888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:00:43.864087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.872881+0000","last_change":"2024-08-17T02:45:41.864969+0000","last_active":"2024-08-17T02:45:41.872881+0000","last_peered":"2024-08-17T02:45:41.872881+0000","last_clean":"2024-08-17T02:45:41.872881+0000","last_became_active":"2024-08-17T02:45:41.860538+0000","last_became_peered":"2024-08-17T02:45:41.860538+0000","last_unstale":"2024-08-17T02:45:41.872881+0000","last_undegraded":"2024-08-17T02:45:41.872881+0000","last_fullsized":"2024-08-17T02:45:41.872881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:16:34.733391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.842294+0000","last_change":"2024-08-17T02:45:40.853949+0000","last_active":"2024-08-17T02:45:41.842294+0000","last_peered":"2024-08-17T02:45:41.842294+0000","last_clean":"2024-08-17T02:45:41.842294+0000","last_became_active":"2024-08-17T02:45:40.852638+0000","last_became_peered":"2024-08-17T02:45:40.852638+0000","last_unstale":"2024-08-17T02:45:41.842294+0000","last_undegraded":"2024-08-17T02:45:41.842294+0000","last_fullsized":"2024-08-17T02:45:41.842294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:03.324359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.884327+0000","last_change":"2024-08-17T02:45:41.876365+0000","last_active":"2024-08-17T02:45:41.884327+0000","last_peered":"2024-08-17T02:45:41.884327+0000","last_clean":"2024-08-17T02:45:41.884327+0000","last_became_active":"2024-08-17T02:45:41.876110+0000","last_became_peered":"2024-08-17T02:45:41.876110+0000","last_unstale":"2024-08-17T02:45:41.884327+0000","last_undegraded":"2024-08-17T02:45:41.884327+0000","last_fullsized":"2024-08-17T02:45:41.884327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:52.363743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.851754+0000","last_change":"2024-08-17T02:45:40.845008+0000","last_active":"2024-08-17T02:45:41.851754+0000","last_peered":"2024-08-17T02:45:41.851754+0000","last_clean":"2024-08-17T02:45:41.851754+0000","last_became_active":"2024-08-17T02:45:40.842289+0000","last_became_peered":"2024-08-17T02:45:40.842289+0000","last_unstale":"2024-08-17T02:45:41.851754+0000","last_undegraded":"2024-08-17T02:45:41.851754+0000","last_fullsized":"2024-08-17T02:45:41.851754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:48.334950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.870954+0000","last_change":"2024-08-17T02:45:41.864016+0000","last_active":"2024-08-17T02:45:41.870954+0000","last_peered":"2024-08-17T02:45:41.870954+0000","last_clean":"2024-08-17T02:45:41.870954+0000","last_became_active":"2024-08-17T02:45:41.863757+0000","last_became_peered":"2024-08-17T02:45:41.863757+0000","last_unstale":"2024-08-17T02:45:41.870954+0000","last_undegraded":"2024-08-17T02:45:41.870954+0000","last_fullsized":"2024-08-17T02:45:41.870954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:03.754114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.878538+0000","last_change":"2024-08-17T02:45:40.835613+0000","last_active":"2024-08-17T02:45:41.878538+0000","last_peered":"2024-08-17T02:45:41.878538+0000","last_clean":"2024-08-17T02:45:41.878538+0000","last_became_active":"2024-08-17T02:45:40.835051+0000","last_became_peered":"2024-08-17T02:45:40.835051+0000","last_unstale":"2024-08-17T02:45:41.878538+0000","last_undegraded":"2024-08-17T02:45:41.878538+0000","last_fullsized":"2024-08-17T02:45:41.878538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:13.885252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.879176+0000","last_change":"2024-08-17T02:45:41.876204+0000","last_active":"2024-08-17T02:45:41.879176+0000","last_peered":"2024-08-17T02:45:41.879176+0000","last_clean":"2024-08-17T02:45:41.879176+0000","last_became_active":"2024-08-17T02:45:41.875536+0000","last_became_peered":"2024-08-17T02:45:41.875536+0000","last_unstale":"2024-08-17T02:45:41.879176+0000","last_undegraded":"2024-08-17T02:45:41.879176+0000","last_fullsized":"2024-08-17T02:45:41.879176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:47:30.233998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.884435+0000","last_change":"2024-08-17T02:45:40.852072+0000","last_active":"2024-08-17T02:45:41.884435+0000","last_peered":"2024-08-17T02:45:41.884435+0000","last_clean":"2024-08-17T02:45:41.884435+0000","last_became_active":"2024-08-17T02:45:40.851346+0000","last_became_peered":"2024-08-17T02:45:40.851346+0000","last_unstale":"2024-08-17T02:45:41.884435+0000","last_undegraded":"2024-08-17T02:45:41.884435+0000","last_fullsized":"2024-08-17T02:45:41.884435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:26:40.603861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886342+0000","last_change":"2024-08-17T02:45:41.884514+0000","last_active":"2024-08-17T02:45:41.886342+0000","last_peered":"2024-08-17T02:45:41.886342+0000","last_clean":"2024-08-17T02:45:41.886342+0000","last_became_active":"2024-08-17T02:45:41.883843+0000","last_became_peered":"2024-08-17T02:45:41.883843+0000","last_unstale":"2024-08-17T02:45:41.886342+0000","last_undegraded":"2024-08-17T02:45:41.886342+0000","last_fullsized":"2024-08-17T02:45:41.886342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:08:27.775215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.873328+0000","last_change":"2024-08-17T02:45:40.842420+0000","last_active":"2024-08-17T02:45:41.873328+0000","last_peered":"2024-08-17T02:45:41.873328+0000","last_clean":"2024-08-17T02:45:41.873328+0000","last_became_active":"2024-08-17T02:45:40.842134+0000","last_became_peered":"2024-08-17T02:45:40.842134+0000","last_unstale":"2024-08-17T02:45:41.873328+0000","last_undegraded":"2024-08-17T02:45:41.873328+0000","last_fullsized":"2024-08-17T02:45:41.873328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:19.561224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886470+0000","last_change":"2024-08-17T02:45:41.885453+0000","last_active":"2024-08-17T02:45:41.886470+0000","last_peered":"2024-08-17T02:45:41.886470+0000","last_clean":"2024-08-17T02:45:41.886470+0000","last_became_active":"2024-08-17T02:45:41.885194+0000","last_became_peered":"2024-08-17T02:45:41.885194+0000","last_unstale":"2024-08-17T02:45:41.886470+0000","last_undegraded":"2024-08-17T02:45:41.886470+0000","last_fullsized":"2024-08-17T02:45:41.886470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:41:42.486969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886577+0000","last_change":"2024-08-17T02:45:40.843903+0000","last_active":"2024-08-17T02:45:41.886577+0000","last_peered":"2024-08-17T02:45:41.886577+0000","last_clean":"2024-08-17T02:45:41.886577+0000","last_became_active":"2024-08-17T02:45:40.841473+0000","last_became_peered":"2024-08-17T02:45:40.841473+0000","last_unstale":"2024-08-17T02:45:41.886577+0000","last_undegraded":"2024-08-17T02:45:41.886577+0000","last_fullsized":"2024-08-17T02:45:41.886577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:20.067847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.855084+0000","last_change":"2024-08-17T02:45:41.849797+0000","last_active":"2024-08-17T02:45:41.855084+0000","last_peered":"2024-08-17T02:45:41.855084+0000","last_clean":"2024-08-17T02:45:41.855084+0000","last_became_active":"2024-08-17T02:45:41.849495+0000","last_became_peered":"2024-08-17T02:45:41.849495+0000","last_unstale":"2024-08-17T02:45:41.855084+0000","last_undegraded":"2024-08-17T02:45:41.855084+0000","last_fullsized":"2024-08-17T02:45:41.855084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:44.220882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.841551+0000","last_change":"2024-08-17T02:45:40.858186+0000","last_active":"2024-08-17T02:45:41.841551+0000","last_peered":"2024-08-17T02:45:41.841551+0000","last_clean":"2024-08-17T02:45:41.841551+0000","last_became_active":"2024-08-17T02:45:40.857956+0000","last_became_peered":"2024-08-17T02:45:40.857956+0000","last_unstale":"2024-08-17T02:45:41.841551+0000","last_undegraded":"2024-08-17T02:45:41.841551+0000","last_fullsized":"2024-08-17T02:45:41.841551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:52:22.103135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.874128+0000","last_change":"2024-08-17T02:45:41.866120+0000","last_active":"2024-08-17T02:45:41.874128+0000","last_peered":"2024-08-17T02:45:41.874128+0000","last_clean":"2024-08-17T02:45:41.874128+0000","last_became_active":"2024-08-17T02:45:41.865856+0000","last_became_peered":"2024-08-17T02:45:41.865856+0000","last_unstale":"2024-08-17T02:45:41.874128+0000","last_undegraded":"2024-08-17T02:45:41.874128+0000","last_fullsized":"2024-08-17T02:45:41.874128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:50:37.265026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.852465+0000","last_change":"2024-08-17T02:45:37.011679+0000","last_active":"2024-08-17T02:45:41.852465+0000","last_peered":"2024-08-17T02:45:41.852465+0000","last_clean":"2024-08-17T02:45:41.852465+0000","last_became_active":"2024-08-17T02:45:37.010559+0000","last_became_peered":"2024-08-17T02:45:37.010559+0000","last_unstale":"2024-08-17T02:45:41.852465+0000","last_undegraded":"2024-08-17T02:45:41.852465+0000","last_fullsized":"2024-08-17T02:45:41.852465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:35.708391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:35.708391+0000","last_clean_scrub_stamp":"2024-08-17T02:45:35.708391+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:11.380093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.840462+0000","last_change":"2024-08-17T02:45:40.848763+0000","last_active":"2024-08-17T02:45:41.840462+0000","last_peered":"2024-08-17T02:45:41.840462+0000","last_clean":"2024-08-17T02:45:41.840462+0000","last_became_active":"2024-08-17T02:45:40.847935+0000","last_became_peered":"2024-08-17T02:45:40.847935+0000","last_unstale":"2024-08-17T02:45:41.840462+0000","last_undegraded":"2024-08-17T02:45:41.840462+0000","last_fullsized":"2024-08-17T02:45:41.840462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:15.864750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.851312+0000","last_change":"2024-08-17T02:45:41.846412+0000","last_active":"2024-08-17T02:45:41.851312+0000","last_peered":"2024-08-17T02:45:41.851312+0000","last_clean":"2024-08-17T02:45:41.851312+0000","last_became_active":"2024-08-17T02:45:41.846136+0000","last_became_peered":"2024-08-17T02:45:41.846136+0000","last_unstale":"2024-08-17T02:45:41.851312+0000","last_undegraded":"2024-08-17T02:45:41.851312+0000","last_fullsized":"2024-08-17T02:45:41.851312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:06.130481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.852345+0000","last_change":"2024-08-17T02:45:40.858420+0000","last_active":"2024-08-17T02:45:41.852345+0000","last_peered":"2024-08-17T02:45:41.852345+0000","last_clean":"2024-08-17T02:45:41.852345+0000","last_became_active":"2024-08-17T02:45:40.858149+0000","last_became_peered":"2024-08-17T02:45:40.858149+0000","last_unstale":"2024-08-17T02:45:41.852345+0000","last_undegraded":"2024-08-17T02:45:41.852345+0000","last_fullsized":"2024-08-17T02:45:41.852345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:48.334950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.872483+0000","last_change":"2024-08-17T02:45:41.864808+0000","last_active":"2024-08-17T02:45:41.872483+0000","last_peered":"2024-08-17T02:45:41.872483+0000","last_clean":"2024-08-17T02:45:41.872483+0000","last_became_active":"2024-08-17T02:45:41.864397+0000","last_became_peered":"2024-08-17T02:45:41.864397+0000","last_unstale":"2024-08-17T02:45:41.872483+0000","last_undegraded":"2024-08-17T02:45:41.872483+0000","last_fullsized":"2024-08-17T02:45:41.872483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:44.425401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.842270+0000","last_change":"2024-08-17T02:45:40.843284+0000","last_active":"2024-08-17T02:45:41.842270+0000","last_peered":"2024-08-17T02:45:41.842270+0000","last_clean":"2024-08-17T02:45:41.842270+0000","last_became_active":"2024-08-17T02:45:40.842914+0000","last_became_peered":"2024-08-17T02:45:40.842914+0000","last_unstale":"2024-08-17T02:45:41.842270+0000","last_undegraded":"2024-08-17T02:45:41.842270+0000","last_fullsized":"2024-08-17T02:45:41.842270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:03.324359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.859058+0000","last_change":"2024-08-17T02:45:41.855267+0000","last_active":"2024-08-17T02:45:41.859058+0000","last_peered":"2024-08-17T02:45:41.859058+0000","last_clean":"2024-08-17T02:45:41.859058+0000","last_became_active":"2024-08-17T02:45:41.854987+0000","last_became_peered":"2024-08-17T02:45:41.854987+0000","last_unstale":"2024-08-17T02:45:41.859058+0000","last_undegraded":"2024-08-17T02:45:41.859058+0000","last_fullsized":"2024-08-17T02:45:41.859058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:00.504734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.842257+0000","last_change":"2024-08-17T02:45:40.848058+0000","last_active":"2024-08-17T02:45:41.842257+0000","last_peered":"2024-08-17T02:45:41.842257+0000","last_clean":"2024-08-17T02:45:41.842257+0000","last_became_active":"2024-08-17T02:45:40.846274+0000","last_became_peered":"2024-08-17T02:45:40.846274+0000","last_unstale":"2024-08-17T02:45:41.842257+0000","last_undegraded":"2024-08-17T02:45:41.842257+0000","last_fullsized":"2024-08-17T02:45:41.842257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:13.885252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.876964+0000","last_change":"2024-08-17T02:45:41.864247+0000","last_active":"2024-08-17T02:45:41.876964+0000","last_peered":"2024-08-17T02:45:41.876964+0000","last_clean":"2024-08-17T02:45:41.876964+0000","last_became_active":"2024-08-17T02:45:41.861904+0000","last_became_peered":"2024-08-17T02:45:41.861904+0000","last_unstale":"2024-08-17T02:45:41.876964+0000","last_undegraded":"2024-08-17T02:45:41.876964+0000","last_fullsized":"2024-08-17T02:45:41.876964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:25.446485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.847751+0000","last_change":"2024-08-17T02:45:40.851172+0000","last_active":"2024-08-17T02:45:41.847751+0000","last_peered":"2024-08-17T02:45:41.847751+0000","last_clean":"2024-08-17T02:45:41.847751+0000","last_became_active":"2024-08-17T02:45:40.850891+0000","last_became_peered":"2024-08-17T02:45:40.850891+0000","last_unstale":"2024-08-17T02:45:41.847751+0000","last_undegraded":"2024-08-17T02:45:41.847751+0000","last_fullsized":"2024-08-17T02:45:41.847751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:30.021288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.865063+0000","last_change":"2024-08-17T02:45:41.853051+0000","last_active":"2024-08-17T02:45:41.865063+0000","last_peered":"2024-08-17T02:45:41.865063+0000","last_clean":"2024-08-17T02:45:41.865063+0000","last_became_active":"2024-08-17T02:45:41.852732+0000","last_became_peered":"2024-08-17T02:45:41.852732+0000","last_unstale":"2024-08-17T02:45:41.865063+0000","last_undegraded":"2024-08-17T02:45:41.865063+0000","last_fullsized":"2024-08-17T02:45:41.865063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:06.130481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.856490+0000","last_change":"2024-08-17T02:45:40.863294+0000","last_active":"2024-08-17T02:45:41.856490+0000","last_peered":"2024-08-17T02:45:41.856490+0000","last_clean":"2024-08-17T02:45:41.856490+0000","last_became_active":"2024-08-17T02:45:40.863098+0000","last_became_peered":"2024-08-17T02:45:40.863098+0000","last_unstale":"2024-08-17T02:45:41.856490+0000","last_undegraded":"2024-08-17T02:45:41.856490+0000","last_fullsized":"2024-08-17T02:45:41.856490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:34:13.760542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.858888+0000","last_change":"2024-08-17T02:45:41.852369+0000","last_active":"2024-08-17T02:45:41.858888+0000","last_peered":"2024-08-17T02:45:41.858888+0000","last_clean":"2024-08-17T02:45:41.858888+0000","last_became_active":"2024-08-17T02:45:41.852188+0000","last_became_peered":"2024-08-17T02:45:41.852188+0000","last_unstale":"2024-08-17T02:45:41.858888+0000","last_undegraded":"2024-08-17T02:45:41.858888+0000","last_fullsized":"2024-08-17T02:45:41.858888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:35:47.023580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:45:42.859165+0000","last_change":"2024-08-17T02:45:40.854078+0000","last_active":"2024-08-17T02:45:42.859165+0000","last_peered":"2024-08-17T02:45:42.859165+0000","last_clean":"2024-08-17T02:45:42.859165+0000","last_became_active":"2024-08-17T02:45:40.853737+0000","last_became_peered":"2024-08-17T02:45:40.853737+0000","last_unstale":"2024-08-17T02:45:42.859165+0000","last_undegraded":"2024-08-17T02:45:42.859165+0000","last_fullsized":"2024-08-17T02:45:42.859165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:43.419530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.865212+0000","last_change":"2024-08-17T02:45:41.861623+0000","last_active":"2024-08-17T02:45:41.865212+0000","last_peered":"2024-08-17T02:45:41.865212+0000","last_clean":"2024-08-17T02:45:41.865212+0000","last_became_active":"2024-08-17T02:45:41.861378+0000","last_became_peered":"2024-08-17T02:45:41.861378+0000","last_unstale":"2024-08-17T02:45:41.865212+0000","last_undegraded":"2024-08-17T02:45:41.865212+0000","last_fullsized":"2024-08-17T02:45:41.865212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:01.344799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.881441+0000","last_change":"2024-08-17T02:45:40.857808+0000","last_active":"2024-08-17T02:45:41.881441+0000","last_peered":"2024-08-17T02:45:41.881441+0000","last_clean":"2024-08-17T02:45:41.881441+0000","last_became_active":"2024-08-17T02:45:40.857551+0000","last_became_peered":"2024-08-17T02:45:40.857551+0000","last_unstale":"2024-08-17T02:45:41.881441+0000","last_undegraded":"2024-08-17T02:45:41.881441+0000","last_fullsized":"2024-08-17T02:45:41.881441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:08.041685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.872662+0000","last_change":"2024-08-17T02:45:41.864378+0000","last_active":"2024-08-17T02:45:41.872662+0000","last_peered":"2024-08-17T02:45:41.872662+0000","last_clean":"2024-08-17T02:45:41.872662+0000","last_became_active":"2024-08-17T02:45:41.864154+0000","last_became_peered":"2024-08-17T02:45:41.864154+0000","last_unstale":"2024-08-17T02:45:41.872662+0000","last_undegraded":"2024-08-17T02:45:41.872662+0000","last_fullsized":"2024-08-17T02:45:41.872662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:02.801412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.852235+0000","last_change":"2024-08-17T02:45:40.857559+0000","last_active":"2024-08-17T02:45:41.852235+0000","last_peered":"2024-08-17T02:45:41.852235+0000","last_clean":"2024-08-17T02:45:41.852235+0000","last_became_active":"2024-08-17T02:45:40.856889+0000","last_became_peered":"2024-08-17T02:45:40.856889+0000","last_unstale":"2024-08-17T02:45:41.852235+0000","last_undegraded":"2024-08-17T02:45:41.852235+0000","last_fullsized":"2024-08-17T02:45:41.852235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:26.959391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.873161+0000","last_change":"2024-08-17T02:45:41.861090+0000","last_active":"2024-08-17T02:45:41.873161+0000","last_peered":"2024-08-17T02:45:41.873161+0000","last_clean":"2024-08-17T02:45:41.873161+0000","last_became_active":"2024-08-17T02:45:41.860752+0000","last_became_peered":"2024-08-17T02:45:41.860752+0000","last_unstale":"2024-08-17T02:45:41.873161+0000","last_undegraded":"2024-08-17T02:45:41.873161+0000","last_fullsized":"2024-08-17T02:45:41.873161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:44.425401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.849695+0000","last_change":"2024-08-17T02:45:40.855151+0000","last_active":"2024-08-17T02:45:41.849695+0000","last_peered":"2024-08-17T02:45:41.849695+0000","last_clean":"2024-08-17T02:45:41.849695+0000","last_became_active":"2024-08-17T02:45:40.854968+0000","last_became_peered":"2024-08-17T02:45:40.854968+0000","last_unstale":"2024-08-17T02:45:41.849695+0000","last_undegraded":"2024-08-17T02:45:41.849695+0000","last_fullsized":"2024-08-17T02:45:41.849695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:13.885252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.861997+0000","last_change":"2024-08-17T02:45:41.857268+0000","last_active":"2024-08-17T02:45:41.861997+0000","last_peered":"2024-08-17T02:45:41.861997+0000","last_clean":"2024-08-17T02:45:41.861997+0000","last_became_active":"2024-08-17T02:45:41.856839+0000","last_became_peered":"2024-08-17T02:45:41.856839+0000","last_unstale":"2024-08-17T02:45:41.861997+0000","last_undegraded":"2024-08-17T02:45:41.861997+0000","last_fullsized":"2024-08-17T02:45:41.861997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:25.446485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.848840+0000","last_change":"2024-08-17T02:45:40.843100+0000","last_active":"2024-08-17T02:45:41.848840+0000","last_peered":"2024-08-17T02:45:41.848840+0000","last_clean":"2024-08-17T02:45:41.848840+0000","last_became_active":"2024-08-17T02:45:40.842206+0000","last_became_peered":"2024-08-17T02:45:40.842206+0000","last_unstale":"2024-08-17T02:45:41.848840+0000","last_undegraded":"2024-08-17T02:45:41.848840+0000","last_fullsized":"2024-08-17T02:45:41.848840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:52:22.103135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.872919+0000","last_change":"2024-08-17T02:45:41.865819+0000","last_active":"2024-08-17T02:45:41.872919+0000","last_peered":"2024-08-17T02:45:41.872919+0000","last_clean":"2024-08-17T02:45:41.872919+0000","last_became_active":"2024-08-17T02:45:41.865537+0000","last_became_peered":"2024-08-17T02:45:41.865537+0000","last_unstale":"2024-08-17T02:45:41.872919+0000","last_undegraded":"2024-08-17T02:45:41.872919+0000","last_fullsized":"2024-08-17T02:45:41.872919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:44.220882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.887173+0000","last_change":"2024-08-17T02:45:40.861158+0000","last_active":"2024-08-17T02:45:41.887173+0000","last_peered":"2024-08-17T02:45:41.887173+0000","last_clean":"2024-08-17T02:45:41.887173+0000","last_became_active":"2024-08-17T02:45:40.860714+0000","last_became_peered":"2024-08-17T02:45:40.860714+0000","last_unstale":"2024-08-17T02:45:41.887173+0000","last_undegraded":"2024-08-17T02:45:41.887173+0000","last_fullsized":"2024-08-17T02:45:41.887173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:52:04.471737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.885525+0000","last_change":"2024-08-17T02:45:41.881747+0000","last_active":"2024-08-17T02:45:41.885525+0000","last_peered":"2024-08-17T02:45:41.885525+0000","last_clean":"2024-08-17T02:45:41.885525+0000","last_became_active":"2024-08-17T02:45:41.880618+0000","last_became_peered":"2024-08-17T02:45:41.880618+0000","last_unstale":"2024-08-17T02:45:41.885525+0000","last_undegraded":"2024-08-17T02:45:41.885525+0000","last_fullsized":"2024-08-17T02:45:41.885525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:03:23.967191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.867016+0000","last_change":"2024-08-17T02:45:41.862264+0000","last_active":"2024-08-17T02:45:41.867016+0000","last_peered":"2024-08-17T02:45:41.867016+0000","last_clean":"2024-08-17T02:45:41.867016+0000","last_became_active":"2024-08-17T02:45:41.862036+0000","last_became_peered":"2024-08-17T02:45:41.862036+0000","last_unstale":"2024-08-17T02:45:41.867016+0000","last_undegraded":"2024-08-17T02:45:41.867016+0000","last_fullsized":"2024-08-17T02:45:41.867016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:31:57.128164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886946+0000","last_change":"2024-08-17T02:45:40.860423+0000","last_active":"2024-08-17T02:45:41.886946+0000","last_peered":"2024-08-17T02:45:41.886946+0000","last_clean":"2024-08-17T02:45:41.886946+0000","last_became_active":"2024-08-17T02:45:40.860126+0000","last_became_peered":"2024-08-17T02:45:40.860126+0000","last_unstale":"2024-08-17T02:45:41.886946+0000","last_undegraded":"2024-08-17T02:45:41.886946+0000","last_fullsized":"2024-08-17T02:45:41.886946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:43:21.770605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886285+0000","last_change":"2024-08-17T02:45:41.880348+0000","last_active":"2024-08-17T02:45:41.886285+0000","last_peered":"2024-08-17T02:45:41.886285+0000","last_clean":"2024-08-17T02:45:41.886285+0000","last_became_active":"2024-08-17T02:45:41.879896+0000","last_became_peered":"2024-08-17T02:45:41.879896+0000","last_unstale":"2024-08-17T02:45:41.886285+0000","last_undegraded":"2024-08-17T02:45:41.886285+0000","last_fullsized":"2024-08-17T02:45:41.886285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:09.195225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.886135+0000","last_change":"2024-08-17T02:45:40.862857+0000","last_active":"2024-08-17T02:45:41.886135+0000","last_peered":"2024-08-17T02:45:41.886135+0000","last_clean":"2024-08-17T02:45:41.886135+0000","last_became_active":"2024-08-17T02:45:40.862629+0000","last_became_peered":"2024-08-17T02:45:40.862629+0000","last_unstale":"2024-08-17T02:45:41.886135+0000","last_undegraded":"2024-08-17T02:45:41.886135+0000","last_fullsized":"2024-08-17T02:45:41.886135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:30:25.700503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.869810+0000","last_change":"2024-08-17T02:45:41.863606+0000","last_active":"2024-08-17T02:45:41.869810+0000","last_peered":"2024-08-17T02:45:41.869810+0000","last_clean":"2024-08-17T02:45:41.869810+0000","last_became_active":"2024-08-17T02:45:41.863332+0000","last_became_peered":"2024-08-17T02:45:41.863332+0000","last_unstale":"2024-08-17T02:45:41.869810+0000","last_undegraded":"2024-08-17T02:45:41.869810+0000","last_fullsized":"2024-08-17T02:45:41.869810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:09.195225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.875437+0000","last_change":"2024-08-17T02:45:40.851226+0000","last_active":"2024-08-17T02:45:41.875437+0000","last_peered":"2024-08-17T02:45:41.875437+0000","last_clean":"2024-08-17T02:45:41.875437+0000","last_became_active":"2024-08-17T02:45:40.850945+0000","last_became_peered":"2024-08-17T02:45:40.850945+0000","last_unstale":"2024-08-17T02:45:41.875437+0000","last_undegraded":"2024-08-17T02:45:41.875437+0000","last_fullsized":"2024-08-17T02:45:41.875437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:00:43.864087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.875679+0000","last_change":"2024-08-17T02:45:41.871607+0000","last_active":"2024-08-17T02:45:41.875679+0000","last_peered":"2024-08-17T02:45:41.875679+0000","last_clean":"2024-08-17T02:45:41.875679+0000","last_became_active":"2024-08-17T02:45:41.871278+0000","last_became_peered":"2024-08-17T02:45:41.871278+0000","last_unstale":"2024-08-17T02:45:41.875679+0000","last_undegraded":"2024-08-17T02:45:41.875679+0000","last_fullsized":"2024-08-17T02:45:41.875679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:40.820418+0000","last_clean_scrub_stamp":"2024-08-17T02:45:40.820418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:02.143166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:45:41.884575+0000","last_change":"2024-08-17T02:45:40.857851+0000","last_active":"2024-08-17T02:45:41.884575+0000","last_peered":"2024-08-17T02:45:41.884575+0000","last_clean":"2024-08-17T02:45:41.884575+0000","last_became_active":"2024-08-17T02:45:40.857532+0000","last_became_peered":"2024-08-17T02:45:40.857532+0000","last_unstale":"2024-08-17T02:45:41.884575+0000","last_undegraded":"2024-08-17T02:45:41.884575+0000","last_fullsized":"2024-08-17T02:45:41.884575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:39.814547+0000","last_clean_scrub_stamp":"2024-08-17T02:45:39.814547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:25:01.252070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":823296,"data_stored":669460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":237568,"data_stored":80074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":229376,"data_stored":78612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":237568,"data_stored":78648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":237568,"data_stored":80074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":225280,"data_stored":78522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":233472,"data_stored":78682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298168,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073672,"statfs":{"total":96636764160,"available":96331440128,"internally_reserved":0,"allocated":831488,"data_stored":669516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:45:51.314 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:45:51.314 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-17T02:45:51.314 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-17T02:45:51.314 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-17T02:45:51.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.495+0000 7f54a8200640 1 Processor -- start 2024-08-17T02:45:51.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.495+0000 7f54a8200640 1 -- start start 2024-08-17T02:45:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.496+0000 7f54a8200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54a0155a20 0x7f54a00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.496+0000 7f54a8200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f54a006df00 0x7f54a00ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.496+0000 7f54a8200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a0156670 con 0x7f54a0155df0 2024-08-17T02:45:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.496+0000 7f54a8200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a00b0350 con 0x7f54a006df00 2024-08-17T02:45:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.496+0000 7f54a8200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a006e5e0 con 0x7f54a0155a20 2024-08-17T02:45:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.496+0000 7f54a6200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f54a006df00 0x7f54a00ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.496+0000 7f54a6200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f54a006df00 0x7f54a00ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33286/0 (socket says 172.21.15.100:33286) 2024-08-17T02:45:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.496+0000 7f54a4e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f54a0155df0 0x7f54a006d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37520/0 (socket says 172.21.15.100:37520) 2024-08-17T02:45:51.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.496+0000 7f54a6200640 1 -- 172.21.15.100:0/1265186792 learned_addr learned my addr 172.21.15.100:0/1265186792 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:51.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.497+0000 7f54a5800640 1 --2- 172.21.15.100:0/1265186792 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54a0155a20 0x7f54a00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:51.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.497+0000 7f54a6200640 1 -- 172.21.15.100:0/1265186792 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54a0155a20 msgr2=0x7f54a00adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:51.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.497+0000 7f54a6200640 1 --2- 172.21.15.100:0/1265186792 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54a0155a20 0x7f54a00adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.497+0000 7f54a6200640 1 -- 172.21.15.100:0/1265186792 >> v1:172.21.15.100:6789/0 conn(0x7f54a0155df0 legacy=0x7f54a006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:51.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.497+0000 7f54a6200640 1 -- 172.21.15.100:0/1265186792 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a006e8c0 con 0x7f54a006df00 2024-08-17T02:45:51.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.497+0000 7f549fe00640 1 -- 172.21.15.100:0/1265186792 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091143482 0 0) 0x7f54a0156670 con 0x7f54a0155df0 2024-08-17T02:45:51.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.498+0000 7f54a6200640 1 --2- 172.21.15.100:0/1265186792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a006df00 0x7f54a00ad9b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5498009f20 tx=0x7f5498009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63b2797125f1279 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:51.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.498+0000 7f549fe00640 1 -- 172.21.15.100:0/1265186792 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5498031400 con 0x7f54a006df00 2024-08-17T02:45:51.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.498+0000 7f549fe00640 1 -- 172.21.15.100:0/1265186792 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549802d050 con 0x7f54a006df00 2024-08-17T02:45:51.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.498+0000 7f549fe00640 1 -- 172.21.15.100:0/1265186792 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5498031790 con 0x7f54a006df00 2024-08-17T02:45:51.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.499+0000 7f54a8200640 1 -- 172.21.15.100:0/1265186792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a006df00 msgr2=0x7f54a00ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:51.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.499+0000 7f54a8200640 1 --2- 172.21.15.100:0/1265186792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a006df00 0x7f54a00ad9b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5498009f20 tx=0x7f5498009840 comp rx=0 tx=0).stop 2024-08-17T02:45:51.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.499+0000 7f54a8200640 1 -- 172.21.15.100:0/1265186792 shutdown_connections 2024-08-17T02:45:51.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.499+0000 7f54a8200640 1 --2- 172.21.15.100:0/1265186792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a006df00 0x7f54a00ad9b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.499+0000 7f54a8200640 1 --2- 172.21.15.100:0/1265186792 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54a0155a20 0x7f54a00adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.499+0000 7f54a8200640 1 -- 172.21.15.100:0/1265186792 >> 172.21.15.100:0/1265186792 conn(0x7f54a00cb9b0 msgr2=0x7f54a00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:51.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.499+0000 7f54a8200640 1 -- 172.21.15.100:0/1265186792 shutdown_connections 2024-08-17T02:45:51.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.499+0000 7f54a8200640 1 -- 172.21.15.100:0/1265186792 wait complete. 2024-08-17T02:45:51.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.500+0000 7f54a8200640 1 Processor -- start 2024-08-17T02:45:51.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.500+0000 7f54a8200640 1 -- start start 2024-08-17T02:45:51.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.501+0000 7f54a8200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54a006df00 0x7f54a0146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:51.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.501+0000 7f54a8200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54a0155a20 0x7f54a0149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:51.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.501+0000 7f54a8200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a0155df0 0x7f54a00c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:51.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.501+0000 7f54a8200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00c2870 con 0x7f54a0155df0 2024-08-17T02:45:51.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.501+0000 7f54a8200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00aa8f0 con 0x7f54a006df00 2024-08-17T02:45:51.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.501+0000 7f54a8200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00aabd0 con 0x7f54a0155a20 2024-08-17T02:45:51.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.501+0000 7f54a6200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a0155df0 0x7f54a00c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:51.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.502+0000 7f54a6200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a0155df0 0x7f54a00c13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33292/0 (socket says 172.21.15.100:33292) 2024-08-17T02:45:51.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.502+0000 7f54a6200640 1 -- 172.21.15.100:0/3557376212 learned_addr learned my addr 172.21.15.100:0/3557376212 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:51.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.502+0000 7f54a5800640 1 --2- 172.21.15.100:0/3557376212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54a006df00 0x7f54a0146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:51.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.502+0000 7f54a4e00640 1 --2- 172.21.15.100:0/3557376212 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54a0155a20 0x7f54a0149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:51.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.502+0000 7f54a6200640 1 -- 172.21.15.100:0/3557376212 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54a0155a20 msgr2=0x7f54a0149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:51.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.502+0000 7f54a6200640 1 --2- 172.21.15.100:0/3557376212 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54a0155a20 0x7f54a0149610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.502+0000 7f54a6200640 1 -- 172.21.15.100:0/3557376212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54a006df00 msgr2=0x7f54a0146da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:51.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.502+0000 7f54a6200640 1 --2- 172.21.15.100:0/3557376212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54a006df00 0x7f54a0146da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.502+0000 7f54a6200640 1 -- 172.21.15.100:0/3557376212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5498009ae0 con 0x7f54a0155df0 2024-08-17T02:45:51.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.502+0000 7f54a5800640 1 --2- 172.21.15.100:0/3557376212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54a006df00 0x7f54a0146da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:45:51.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.502+0000 7f54a4e00640 1 --2- 172.21.15.100:0/3557376212 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54a0155a20 0x7f54a0149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:45:51.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.502+0000 7f54a6200640 1 --2- 172.21.15.100:0/3557376212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a0155df0 0x7f54a00c13b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5498009f80 tx=0x7f5498036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:51.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.502+0000 7f549cc00640 1 -- 172.21.15.100:0/3557376212 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5498031e80 con 0x7f54a0155df0 2024-08-17T02:45:51.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.502+0000 7f549cc00640 1 -- 172.21.15.100:0/3557376212 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5498008ad0 con 0x7f54a0155df0 2024-08-17T02:45:51.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.502+0000 7f549cc00640 1 -- 172.21.15.100:0/3557376212 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5498008e70 con 0x7f54a0155df0 2024-08-17T02:45:51.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.502+0000 7f54a8200640 1 -- 172.21.15.100:0/3557376212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a00aaeb0 con 0x7f54a0155df0 2024-08-17T02:45:51.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.503+0000 7f54a8200640 1 -- 172.21.15.100:0/3557376212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a00c1f20 con 0x7f54a0155df0 2024-08-17T02:45:51.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.504+0000 7f54a8200640 1 -- 172.21.15.100:0/3557376212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a00ab3b0 con 0x7f54a0155df0 2024-08-17T02:45:51.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.504+0000 7f549cc00640 1 -- 172.21.15.100:0/3557376212 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5498038050 con 0x7f54a0155df0 2024-08-17T02:45:51.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.505+0000 7f549cc00640 1 --2- 172.21.15.100:0/3557376212 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5480065150 0x7f5480067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:51.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.505+0000 7f549cc00640 1 -- 172.21.15.100:0/3557376212 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f54980a31d0 con 0x7f54a0155df0 2024-08-17T02:45:51.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.505+0000 7f54a5800640 1 --2- 172.21.15.100:0/3557376212 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5480065150 0x7f5480067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:51.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.506+0000 7f54a5800640 1 --2- 172.21.15.100:0/3557376212 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5480065150 0x7f5480067600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5494007df0 tx=0x7f549400d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:51.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.509+0000 7f549cc00640 1 -- 172.21.15.100:0/3557376212 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f54980711f0 con 0x7f54a0155df0 2024-08-17T02:45:51.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.713+0000 7f54a8200640 1 -- 172.21.15.100:0/3557376212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f54a0064db0 con 0x7f54a0155df0 2024-08-17T02:45:51.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.714+0000 7f549cc00640 1 -- 172.21.15.100:0/3557376212 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f5498033ed0 con 0x7f54a0155df0 2024-08-17T02:45:51.715 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:51.715 INFO:teuthology.orchestra.run.smithi100.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-17T02:45:51.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.716+0000 7f54a8200640 1 -- 172.21.15.100:0/3557376212 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5480065150 msgr2=0x7f5480067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:51.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.716+0000 7f54a8200640 1 --2- 172.21.15.100:0/3557376212 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5480065150 0x7f5480067600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5494007df0 tx=0x7f549400d040 comp rx=0 tx=0).stop 2024-08-17T02:45:51.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.716+0000 7f54a8200640 1 -- 172.21.15.100:0/3557376212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a0155df0 msgr2=0x7f54a00c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:51.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.716+0000 7f54a8200640 1 --2- 172.21.15.100:0/3557376212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a0155df0 0x7f54a00c13b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5498009f80 tx=0x7f5498036000 comp rx=0 tx=0).stop 2024-08-17T02:45:51.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.716+0000 7f54a8200640 1 -- 172.21.15.100:0/3557376212 shutdown_connections 2024-08-17T02:45:51.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.716+0000 7f54a8200640 1 --2- 172.21.15.100:0/3557376212 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5480065150 0x7f5480067600 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.716+0000 7f54a8200640 1 --2- 172.21.15.100:0/3557376212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a0155df0 0x7f54a00c13b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.716+0000 7f54a8200640 1 --2- 172.21.15.100:0/3557376212 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54a0155a20 0x7f54a0149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.716+0000 7f54a8200640 1 --2- 172.21.15.100:0/3557376212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54a006df00 0x7f54a0146da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.716+0000 7f54a8200640 1 -- 172.21.15.100:0/3557376212 >> 172.21.15.100:0/3557376212 conn(0x7f54a00cb9b0 msgr2=0x7f54a00cafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:51.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.716+0000 7f54a8200640 1 -- 172.21.15.100:0/3557376212 shutdown_connections 2024-08-17T02:45:51.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.716+0000 7f54a8200640 1 -- 172.21.15.100:0/3557376212 wait complete. 2024-08-17T02:45:51.732 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-17T02:45:51.733 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:45:51.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.878+0000 7f62aee00640 1 Processor -- start 2024-08-17T02:45:51.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.879+0000 7f62aee00640 1 -- start start 2024-08-17T02:45:51.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.880+0000 7f62aee00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62a80afdd0 0x7f62a81563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:51.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.880+0000 7f62aee00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a8157690 con 0x7f62a80b0270 2024-08-17T02:45:51.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.880+0000 7f62aee00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a8156a80 con 0x7f62a8155900 2024-08-17T02:45:51.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.880+0000 7f62aee00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a8156d60 con 0x7f62a80afdd0 2024-08-17T02:45:51.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.880+0000 7f62ad000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f62a80b0270 0x7f62a80ae6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37534/0 (socket says 172.21.15.100:37534) 2024-08-17T02:45:51.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.880+0000 7f62ad000640 1 -- 172.21.15.100:0/3346266063 learned_addr learned my addr 172.21.15.100:0/3346266063 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:51.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.880+0000 7f62ae400640 1 --2- 172.21.15.100:0/3346266063 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62a80afdd0 0x7f62a81563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:51.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.881+0000 7f62a7e00640 1 -- 172.21.15.100:0/3346266063 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534544198 0 0) 0x7f62a8157690 con 0x7f62a80b0270 2024-08-17T02:45:51.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.881+0000 7f62a7e00640 1 -- 172.21.15.100:0/3346266063 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62900034e0 con 0x7f62a80b0270 2024-08-17T02:45:51.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.881+0000 7f62a7e00640 1 -- 172.21.15.100:0/3346266063 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149080988 0 0) 0x7f62a8156a80 con 0x7f62a8155900 2024-08-17T02:45:51.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.881+0000 7f62a7e00640 1 -- 172.21.15.100:0/3346266063 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62a8157690 con 0x7f62a8155900 2024-08-17T02:45:51.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.881+0000 7f62a7e00640 1 -- 172.21.15.100:0/3346266063 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2141160280 0 0) 0x7f62900034e0 con 0x7f62a80b0270 2024-08-17T02:45:51.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.881+0000 7f62a7e00640 1 -- 172.21.15.100:0/3346266063 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62a80afdd0 msgr2=0x7f62a81563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:51.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.881+0000 7f62a7e00640 1 --2- 172.21.15.100:0/3346266063 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62a80afdd0 0x7f62a81563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.881+0000 7f62a7e00640 1 -- 172.21.15.100:0/3346266063 >> v1:172.21.15.123:6789/0 conn(0x7f62a8155900 legacy=0x7f62a8155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:51.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.881+0000 7f62a7e00640 1 -- 172.21.15.100:0/3346266063 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a8157040 con 0x7f62a80b0270 2024-08-17T02:45:51.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.881+0000 7f62a7e00640 1 -- 172.21.15.100:0/3346266063 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1817143124 0 0) 0x7f6294001470 con 0x7f62a80b0270 2024-08-17T02:45:51.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.881+0000 7f62a7e00640 1 -- 172.21.15.100:0/3346266063 >> v1:172.21.15.100:6789/0 conn(0x7f62a80b0270 legacy=0x7f62a80ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:51.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.881+0000 7f62a7e00640 1 --2- 172.21.15.100:0/3346266063 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6290003b90 0x7f6290003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:51.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.881+0000 7f62a7e00640 1 --2- 172.21.15.100:0/3346266063 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62a80afdd0 0x7f6290004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:51.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.881+0000 7f62a7e00640 1 --2- 172.21.15.100:0/3346266063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6290004cc0 0x7f6290005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:51.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.881+0000 7f62a7e00640 1 -- 172.21.15.100:0/3346266063 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a8156d60 con 0x7f6290004cc0 2024-08-17T02:45:51.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.881+0000 7f62a7e00640 1 -- 172.21.15.100:0/3346266063 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629000bb60 con 0x7f6290003b90 2024-08-17T02:45:51.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.881+0000 7f62a7e00640 1 -- 172.21.15.100:0/3346266063 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629000bcd0 con 0x7f62a80afdd0 2024-08-17T02:45:51.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.881+0000 7f62ae400640 1 --2- 172.21.15.100:0/3346266063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6290004cc0 0x7f6290005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:51.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.881+0000 7f62ad000640 1 --2- 172.21.15.100:0/3346266063 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62a80afdd0 0x7f6290004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:51.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.881+0000 7f62ada00640 1 --2- 172.21.15.100:0/3346266063 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6290003b90 0x7f6290003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:51.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.882+0000 7f62ae400640 1 -- 172.21.15.100:0/3346266063 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62a80afdd0 msgr2=0x7f6290004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:51.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.882+0000 7f62ae400640 1 --2- 172.21.15.100:0/3346266063 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62a80afdd0 0x7f6290004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.882+0000 7f62ae400640 1 -- 172.21.15.100:0/3346266063 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6290003b90 msgr2=0x7f6290003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:51.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.882+0000 7f62ae400640 1 --2- 172.21.15.100:0/3346266063 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6290003b90 0x7f6290003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.882+0000 7f62ae400640 1 -- 172.21.15.100:0/3346266063 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62900034e0 con 0x7f6290004cc0 2024-08-17T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.883+0000 7f62ae400640 1 --2- 172.21.15.100:0/3346266063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6290004cc0 0x7f6290005130 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f62a0006e70 tx=0x7f62a00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3306648d854e310a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.883+0000 7f62a7e00640 1 -- 172.21.15.100:0/3346266063 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a0031400 con 0x7f6290004cc0 2024-08-17T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.883+0000 7f62a7e00640 1 -- 172.21.15.100:0/3346266063 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a002d050 con 0x7f6290004cc0 2024-08-17T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.883+0000 7f62a7e00640 1 -- 172.21.15.100:0/3346266063 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a0031790 con 0x7f6290004cc0 2024-08-17T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.883+0000 7f62aee00640 1 -- 172.21.15.100:0/3346266063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6290004cc0 msgr2=0x7f6290005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.883+0000 7f62aee00640 1 --2- 172.21.15.100:0/3346266063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6290004cc0 0x7f6290005130 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f62a0006e70 tx=0x7f62a00090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.883+0000 7f62ae400640 1 -- 172.21.15.100:0/3346266063 reap_dead start 2024-08-17T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.883+0000 7f62aee00640 1 -- 172.21.15.100:0/3346266063 shutdown_connections 2024-08-17T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.883+0000 7f62aee00640 1 -- 172.21.15.100:0/3346266063 >> 172.21.15.100:0/3346266063 conn(0x7f62a8067750 msgr2=0x7f62a80cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.884+0000 7f62aee00640 1 -- 172.21.15.100:0/3346266063 shutdown_connections 2024-08-17T02:45:51.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.884+0000 7f62aee00640 1 -- 172.21.15.100:0/3346266063 wait complete. 2024-08-17T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.885+0000 7f62aee00640 1 Processor -- start 2024-08-17T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.885+0000 7f62aee00640 1 -- start start 2024-08-17T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.886+0000 7f62aee00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6290004cc0 0x7f62a8142950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.886+0000 7f62aee00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62a8142e90 0x7f62a80ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.886+0000 7f62aee00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62a80abe30 0x7f62a8143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.886+0000 7f62aee00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a80ac2a0 con 0x7f62a8142e90 2024-08-17T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.886+0000 7f62aee00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a8144290 con 0x7f6290004cc0 2024-08-17T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.886+0000 7f62aee00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a8144570 con 0x7f62a80abe30 2024-08-17T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.886+0000 7f62ad000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62a8142e90 0x7f62a80ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.886+0000 7f62ad000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62a8142e90 0x7f62a80ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33312/0 (socket says 172.21.15.100:33312) 2024-08-17T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.886+0000 7f62ad000640 1 -- 172.21.15.100:0/798352424 learned_addr learned my addr 172.21.15.100:0/798352424 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.886+0000 7f62ada00640 1 --2- 172.21.15.100:0/798352424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6290004cc0 0x7f62a8142950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:51.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.886+0000 7f62ae400640 1 --2- 172.21.15.100:0/798352424 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62a80abe30 0x7f62a8143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.886+0000 7f62ad000640 1 -- 172.21.15.100:0/798352424 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62a80abe30 msgr2=0x7f62a8143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.886+0000 7f62ad000640 1 --2- 172.21.15.100:0/798352424 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62a80abe30 0x7f62a8143560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.886+0000 7f62ad000640 1 -- 172.21.15.100:0/798352424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6290004cc0 msgr2=0x7f62a8142950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.886+0000 7f62ad000640 1 --2- 172.21.15.100:0/798352424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6290004cc0 0x7f62a8142950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.886+0000 7f62ad000640 1 -- 172.21.15.100:0/798352424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a8144850 con 0x7f62a8142e90 2024-08-17T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.886+0000 7f62ae400640 1 --2- 172.21.15.100:0/798352424 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62a80abe30 0x7f62a8143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.887+0000 7f62ad000640 1 --2- 172.21.15.100:0/798352424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62a8142e90 0x7f62a80ab8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6294007fd0 tx=0x7f62a8157600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.887+0000 7f62a4c00640 1 -- 172.21.15.100:0/798352424 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6294018030 con 0x7f62a8142e90 2024-08-17T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.887+0000 7f62a4c00640 1 -- 172.21.15.100:0/798352424 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6294000f70 con 0x7f62a8142e90 2024-08-17T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.887+0000 7f62a4c00640 1 -- 172.21.15.100:0/798352424 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6294004ea0 con 0x7f62a8142e90 2024-08-17T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.887+0000 7f62aee00640 1 -- 172.21.15.100:0/798352424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a8144b30 con 0x7f62a8142e90 2024-08-17T02:45:51.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.887+0000 7f62aee00640 1 -- 172.21.15.100:0/798352424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a8146930 con 0x7f62a8142e90 2024-08-17T02:45:51.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.888+0000 7f62aee00640 1 -- 172.21.15.100:0/798352424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a8145030 con 0x7f62a8142e90 2024-08-17T02:45:51.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.889+0000 7f62a4c00640 1 -- 172.21.15.100:0/798352424 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f629401b070 con 0x7f62a8142e90 2024-08-17T02:45:51.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.890+0000 7f62a4c00640 1 --2- 172.21.15.100:0/798352424 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6288065170 0x7f6288067620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:51.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.890+0000 7f62a4c00640 1 -- 172.21.15.100:0/798352424 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6294019070 con 0x7f62a8142e90 2024-08-17T02:45:51.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.890+0000 7f62ada00640 1 --2- 172.21.15.100:0/798352424 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6288065170 0x7f6288067620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:51.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.891+0000 7f62ada00640 1 --2- 172.21.15.100:0/798352424 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6288065170 0x7f6288067620 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f629c001460 tx=0x7f629c007f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:51.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:51.894+0000 7f62a4c00640 1 -- 172.21.15.100:0/798352424 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f62940b3e40 con 0x7f62a8142e90 2024-08-17T02:45:52.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.070+0000 7f62aee00640 1 -- 172.21.15.100:0/798352424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62a8071050 con 0x7f62a8142e90 2024-08-17T02:45:52.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.071+0000 7f62a4c00640 1 -- 172.21.15.100:0/798352424 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f6294050250 con 0x7f62a8142e90 2024-08-17T02:45:52.072 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:52.072 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:42.845503+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:45:39.036964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:45:40.232954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:45:52.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.073+0000 7f62aee00640 1 -- 172.21.15.100:0/798352424 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6288065170 msgr2=0x7f6288067620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:52.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.073+0000 7f62aee00640 1 --2- 172.21.15.100:0/798352424 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6288065170 0x7f6288067620 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f629c001460 tx=0x7f629c007f90 comp rx=0 tx=0).stop 2024-08-17T02:45:52.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.073+0000 7f62aee00640 1 -- 172.21.15.100:0/798352424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62a8142e90 msgr2=0x7f62a80ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:52.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.073+0000 7f62aee00640 1 --2- 172.21.15.100:0/798352424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62a8142e90 0x7f62a80ab8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6294007fd0 tx=0x7f62a8157600 comp rx=0 tx=0).stop 2024-08-17T02:45:52.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.073+0000 7f62aee00640 1 -- 172.21.15.100:0/798352424 shutdown_connections 2024-08-17T02:45:52.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.073+0000 7f62aee00640 1 --2- 172.21.15.100:0/798352424 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6288065170 0x7f6288067620 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.073+0000 7f62aee00640 1 --2- 172.21.15.100:0/798352424 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62a80abe30 0x7f62a8143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.073+0000 7f62aee00640 1 --2- 172.21.15.100:0/798352424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62a8142e90 0x7f62a80ab8f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.073+0000 7f62aee00640 1 --2- 172.21.15.100:0/798352424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6290004cc0 0x7f62a8142950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.073+0000 7f62aee00640 1 -- 172.21.15.100:0/798352424 >> 172.21.15.100:0/798352424 conn(0x7f62a8067750 msgr2=0x7f62a8069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:52.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.073+0000 7f62aee00640 1 -- 172.21.15.100:0/798352424 shutdown_connections 2024-08-17T02:45:52.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.073+0000 7f62aee00640 1 -- 172.21.15.100:0/798352424 wait complete. 2024-08-17T02:45:52.089 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:45:35.140990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:45:39.036964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:45:40.232954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:45:52.090 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:45:52.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.239+0000 7ffb4fe00640 1 Processor -- start 2024-08-17T02:45:52.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.239+0000 7ffb4fe00640 1 -- start start 2024-08-17T02:45:52.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.240+0000 7ffb4fe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffb48158b90 0x7ffb480aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:52.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.240+0000 7ffb4fe00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb480ac390 con 0x7ffb480cc5f0 2024-08-17T02:45:52.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.240+0000 7ffb4fe00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb480ab4a0 con 0x7ffb48158f60 2024-08-17T02:45:52.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.240+0000 7ffb4fe00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb480ab780 con 0x7ffb48158b90 2024-08-17T02:45:52.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.240+0000 7ffb4de00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ffb480cc5f0 0x7ffb4806d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37538/0 (socket says 172.21.15.100:37538) 2024-08-17T02:45:52.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.240+0000 7ffb4de00640 1 -- 172.21.15.100:0/292893431 learned_addr learned my addr 172.21.15.100:0/292893431 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:52.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.241+0000 7ffb4d400640 1 --2- 172.21.15.100:0/292893431 >> v2:172.21.15.123:3300/0 conn(0x7ffb48158b90 0x7ffb480aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:52.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.241+0000 7ffb47e00640 1 -- 172.21.15.100:0/292893431 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233980016 0 0) 0x7ffb480ac390 con 0x7ffb480cc5f0 2024-08-17T02:45:52.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.241+0000 7ffb47e00640 1 -- 172.21.15.100:0/292893431 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb300034e0 con 0x7ffb480cc5f0 2024-08-17T02:45:52.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.241+0000 7ffb47e00640 1 -- 172.21.15.100:0/292893431 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963201582 0 0) 0x7ffb480ab4a0 con 0x7ffb48158f60 2024-08-17T02:45:52.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.241+0000 7ffb47e00640 1 -- 172.21.15.100:0/292893431 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb480ac390 con 0x7ffb48158f60 2024-08-17T02:45:52.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.241+0000 7ffb4d400640 1 -- 172.21.15.100:0/292893431 >> v1:172.21.15.123:6789/0 conn(0x7ffb48158f60 legacy=0x7ffb480ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:52.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.241+0000 7ffb47e00640 1 -- 172.21.15.100:0/292893431 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2544807485 0 0) 0x7ffb300034e0 con 0x7ffb480cc5f0 2024-08-17T02:45:52.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.241+0000 7ffb4d400640 1 -- 172.21.15.100:0/292893431 >> v1:172.21.15.100:6789/0 conn(0x7ffb480cc5f0 legacy=0x7ffb4806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:52.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.241+0000 7ffb4d400640 1 -- 172.21.15.100:0/292893431 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb480aba60 con 0x7ffb48158b90 2024-08-17T02:45:52.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.242+0000 7ffb4d400640 1 --2- 172.21.15.100:0/292893431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb48158b90 0x7ffb480aea40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c009850 tx=0x7ffb3c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19ed49d6eb60b965 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:52.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.242+0000 7ffb47e00640 1 -- 172.21.15.100:0/292893431 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb400017f0 con 0x7ffb48158b90 2024-08-17T02:45:52.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.243+0000 7ffb47e00640 1 -- 172.21.15.100:0/292893431 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3c02ab00 con 0x7ffb48158b90 2024-08-17T02:45:52.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.243+0000 7ffb47e00640 1 -- 172.21.15.100:0/292893431 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c02aea0 con 0x7ffb48158b90 2024-08-17T02:45:52.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.243+0000 7ffb4fe00640 1 -- 172.21.15.100:0/292893431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb48158b90 msgr2=0x7ffb480aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:52.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.243+0000 7ffb4fe00640 1 --2- 172.21.15.100:0/292893431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb48158b90 0x7ffb480aea40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c009850 tx=0x7ffb3c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.243+0000 7ffb4fe00640 1 -- 172.21.15.100:0/292893431 shutdown_connections 2024-08-17T02:45:52.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.243+0000 7ffb4fe00640 1 --2- 172.21.15.100:0/292893431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb48158b90 0x7ffb480aea40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.243+0000 7ffb4fe00640 1 -- 172.21.15.100:0/292893431 >> 172.21.15.100:0/292893431 conn(0x7ffb48067750 msgr2=0x7ffb480cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:52.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.243+0000 7ffb4fe00640 1 -- 172.21.15.100:0/292893431 shutdown_connections 2024-08-17T02:45:52.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.243+0000 7ffb4fe00640 1 -- 172.21.15.100:0/292893431 wait complete. 2024-08-17T02:45:52.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.245+0000 7ffb4fe00640 1 Processor -- start 2024-08-17T02:45:52.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.245+0000 7ffb4fe00640 1 -- start start 2024-08-17T02:45:52.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.245+0000 7ffb4fe00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ffb480cc5f0 0x7ffb480cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:52.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.245+0000 7ffb4fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb48158b90 0x7ffb480af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:52.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.245+0000 7ffb4fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb48158f60 0x7ffb480c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:52.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.246+0000 7ffb4fe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4814ad70 con 0x7ffb48158f60 2024-08-17T02:45:52.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.246+0000 7ffb4fe00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb480afb60 con 0x7ffb48158b90 2024-08-17T02:45:52.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.246+0000 7ffb4fe00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb480b0660 con 0x7ffb480cc5f0 2024-08-17T02:45:52.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.246+0000 7ffb4d400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ffb480cc5f0 0x7ffb480cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:52.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.246+0000 7ffb4de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb48158f60 0x7ffb480c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:52.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.246+0000 7ffb4d400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ffb480cc5f0 0x7ffb480cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:33224/0 (socket says 172.21.15.100:33224) 2024-08-17T02:45:52.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.246+0000 7ffb4d400640 1 -- 172.21.15.100:0/3792309670 learned_addr learned my addr 172.21.15.100:0/3792309670 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:52.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.246+0000 7ffb4ca00640 1 --2- 172.21.15.100:0/3792309670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb48158b90 0x7ffb480af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:52.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.246+0000 7ffb4de00640 1 -- 172.21.15.100:0/3792309670 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ffb480cc5f0 msgr2=0x7ffb480cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:52.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.246+0000 7ffb4de00640 1 --2- 172.21.15.100:0/3792309670 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ffb480cc5f0 0x7ffb480cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.246+0000 7ffb4de00640 1 -- 172.21.15.100:0/3792309670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb48158b90 msgr2=0x7ffb480af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:52.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.246+0000 7ffb4de00640 1 --2- 172.21.15.100:0/3792309670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb48158b90 0x7ffb480af620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.246+0000 7ffb4de00640 1 -- 172.21.15.100:0/3792309670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c009390 con 0x7ffb48158f60 2024-08-17T02:45:52.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.246+0000 7ffb4de00640 1 --2- 172.21.15.100:0/3792309670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb48158f60 0x7ffb480c9590 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffb40001560 tx=0x7ffb40007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:52.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.247+0000 7ffb44c00640 1 -- 172.21.15.100:0/3792309670 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40004d30 con 0x7ffb48158f60 2024-08-17T02:45:52.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.247+0000 7ffb44c00640 1 -- 172.21.15.100:0/3792309670 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4000a7d0 con 0x7ffb48158f60 2024-08-17T02:45:52.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.247+0000 7ffb44c00640 1 -- 172.21.15.100:0/3792309670 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4000ab90 con 0x7ffb48158f60 2024-08-17T02:45:52.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.247+0000 7ffb4fe00640 1 -- 172.21.15.100:0/3792309670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb480afdc0 con 0x7ffb48158f60 2024-08-17T02:45:52.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.247+0000 7ffb4fe00640 1 -- 172.21.15.100:0/3792309670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb480b0380 con 0x7ffb48158f60 2024-08-17T02:45:52.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.248+0000 7ffb4fe00640 1 -- 172.21.15.100:0/3792309670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb4814af20 con 0x7ffb48158f60 2024-08-17T02:45:52.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.249+0000 7ffb44c00640 1 -- 172.21.15.100:0/3792309670 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffb40007150 con 0x7ffb48158f60 2024-08-17T02:45:52.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.249+0000 7ffb44c00640 1 --2- 172.21.15.100:0/3792309670 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ffb28065150 0x7ffb28067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:52.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.250+0000 7ffb44c00640 1 -- 172.21.15.100:0/3792309670 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffb40081e90 con 0x7ffb48158f60 2024-08-17T02:45:52.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.250+0000 7ffb4d400640 1 --2- 172.21.15.100:0/3792309670 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ffb28065150 0x7ffb28067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:52.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.250+0000 7ffb4d400640 1 --2- 172.21.15.100:0/3792309670 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ffb28065150 0x7ffb28067600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c009130 tx=0x7ffb3c032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:52.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.253+0000 7ffb44c00640 1 -- 172.21.15.100:0/3792309670 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ffb4004ce40 con 0x7ffb48158f60 2024-08-17T02:45:52.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.423+0000 7ffb4fe00640 1 -- 172.21.15.100:0/3792309670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb48064db0 con 0x7ffb48158f60 2024-08-17T02:45:52.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.424+0000 7ffb44c00640 1 -- 172.21.15.100:0/3792309670 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb4814af20 con 0x7ffb48158f60 2024-08-17T02:45:52.425 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-08-17T02:45:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.426+0000 7ffb4fe00640 1 -- 172.21.15.100:0/3792309670 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ffb28065150 msgr2=0x7ffb28067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.426+0000 7ffb4fe00640 1 --2- 172.21.15.100:0/3792309670 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ffb28065150 0x7ffb28067600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c009130 tx=0x7ffb3c032000 comp rx=0 tx=0).stop 2024-08-17T02:45:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.426+0000 7ffb4fe00640 1 -- 172.21.15.100:0/3792309670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb48158f60 msgr2=0x7ffb480c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.426+0000 7ffb4fe00640 1 --2- 172.21.15.100:0/3792309670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb48158f60 0x7ffb480c9590 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffb40001560 tx=0x7ffb40007c90 comp rx=0 tx=0).stop 2024-08-17T02:45:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.426+0000 7ffb4fe00640 1 -- 172.21.15.100:0/3792309670 shutdown_connections 2024-08-17T02:45:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.426+0000 7ffb4fe00640 1 --2- 172.21.15.100:0/3792309670 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ffb28065150 0x7ffb28067600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.426+0000 7ffb4fe00640 1 --2- 172.21.15.100:0/3792309670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb48158f60 0x7ffb480c9590 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.426+0000 7ffb4fe00640 1 --2- 172.21.15.100:0/3792309670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb48158b90 0x7ffb480af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.426+0000 7ffb4fe00640 1 --2- 172.21.15.100:0/3792309670 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ffb480cc5f0 0x7ffb480cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.426+0000 7ffb4fe00640 1 -- 172.21.15.100:0/3792309670 >> 172.21.15.100:0/3792309670 conn(0x7ffb48067750 msgr2=0x7ffb481593f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:52.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.426+0000 7ffb4fe00640 1 -- 172.21.15.100:0/3792309670 shutdown_connections 2024-08-17T02:45:52.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.426+0000 7ffb4fe00640 1 -- 172.21.15.100:0/3792309670 wait complete. 2024-08-17T02:45:52.442 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:45:52.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.592+0000 7fbfa7600640 1 Processor -- start 2024-08-17T02:45:52.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.592+0000 7fbfa7600640 1 -- start start 2024-08-17T02:45:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.593+0000 7fbfa7600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbfa00c92e0 0x7fbfa0160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.593+0000 7fbfa7600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa01598f0 con 0x7fbfa00c7db0 2024-08-17T02:45:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.593+0000 7fbfa7600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa0159bd0 con 0x7fbfa0155a80 2024-08-17T02:45:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.593+0000 7fbfa7600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa0159eb0 con 0x7fbfa00c92e0 2024-08-17T02:45:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.593+0000 7fbf9fe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fbfa00c7db0 0x7fbfa00c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37548/0 (socket says 172.21.15.100:37548) 2024-08-17T02:45:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.593+0000 7fbf9fe00640 1 -- 172.21.15.100:0/1536883628 learned_addr learned my addr 172.21.15.100:0/1536883628 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.593+0000 7fbfa5600640 1 --2- 172.21.15.100:0/1536883628 >> v2:172.21.15.123:3300/0 conn(0x7fbfa00c92e0 0x7fbfa0160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.594+0000 7fbf9f400640 1 -- 172.21.15.100:0/1536883628 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227372735 0 0) 0x7fbfa01598f0 con 0x7fbfa00c7db0 2024-08-17T02:45:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.594+0000 7fbf9f400640 1 -- 172.21.15.100:0/1536883628 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf880034e0 con 0x7fbfa00c7db0 2024-08-17T02:45:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.594+0000 7fbfa5600640 1 -- 172.21.15.100:0/1536883628 >> v1:172.21.15.123:6789/0 conn(0x7fbfa0155a80 legacy=0x7fbfa006dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.594+0000 7fbfa5600640 1 -- 172.21.15.100:0/1536883628 >> v1:172.21.15.100:6789/0 conn(0x7fbfa00c7db0 legacy=0x7fbfa00c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.594+0000 7fbfa5600640 1 -- 172.21.15.100:0/1536883628 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa015a190 con 0x7fbfa00c92e0 2024-08-17T02:45:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.595+0000 7fbfa5600640 1 --2- 172.21.15.100:0/1536883628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfa00c92e0 0x7fbfa0160b90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbf98009e60 tx=0x7fbf98009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea996164cd305753 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.595+0000 7fbf9f400640 1 -- 172.21.15.100:0/1536883628 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98030560 con 0x7fbfa00c92e0 2024-08-17T02:45:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.595+0000 7fbf9f400640 1 -- 172.21.15.100:0/1536883628 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf980306c0 con 0x7fbfa00c92e0 2024-08-17T02:45:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.595+0000 7fbf9f400640 1 -- 172.21.15.100:0/1536883628 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98030a60 con 0x7fbfa00c92e0 2024-08-17T02:45:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.596+0000 7fbfa7600640 1 -- 172.21.15.100:0/1536883628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfa00c92e0 msgr2=0x7fbfa0160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.596+0000 7fbfa7600640 1 --2- 172.21.15.100:0/1536883628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfa00c92e0 0x7fbfa0160b90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbf98009e60 tx=0x7fbf98009780 comp rx=0 tx=0).stop 2024-08-17T02:45:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.596+0000 7fbfa7600640 1 -- 172.21.15.100:0/1536883628 shutdown_connections 2024-08-17T02:45:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.596+0000 7fbfa7600640 1 --2- 172.21.15.100:0/1536883628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfa00c92e0 0x7fbfa0160b90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.596+0000 7fbfa7600640 1 -- 172.21.15.100:0/1536883628 >> 172.21.15.100:0/1536883628 conn(0x7fbfa0067750 msgr2=0x7fbfa00c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.596+0000 7fbfa7600640 1 -- 172.21.15.100:0/1536883628 shutdown_connections 2024-08-17T02:45:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.596+0000 7fbfa7600640 1 -- 172.21.15.100:0/1536883628 wait complete. 2024-08-17T02:45:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.597+0000 7fbfa7600640 1 Processor -- start 2024-08-17T02:45:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.598+0000 7fbfa7600640 1 -- start start 2024-08-17T02:45:52.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.598+0000 7fbfa7600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfa00c7db0 0x7fbfa014d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:52.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.598+0000 7fbfa7600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbfa00c92e0 0x7fbfa013f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:52.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.598+0000 7fbfa7600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfa0155a80 0x7fbfa0068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:52.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.598+0000 7fbfa7600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa006a730 con 0x7fbfa00c7db0 2024-08-17T02:45:52.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.598+0000 7fbfa7600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa014d860 con 0x7fbfa0155a80 2024-08-17T02:45:52.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.598+0000 7fbfa7600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa014db40 con 0x7fbfa00c92e0 2024-08-17T02:45:52.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.599+0000 7fbfa4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfa00c7db0 0x7fbfa014d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:52.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.599+0000 7fbfa4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfa00c7db0 0x7fbfa014d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33328/0 (socket says 172.21.15.100:33328) 2024-08-17T02:45:52.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.599+0000 7fbfa4c00640 1 -- 172.21.15.100:0/2481645564 learned_addr learned my addr 172.21.15.100:0/2481645564 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:52.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.599+0000 7fbf9fe00640 1 --2- 172.21.15.100:0/2481645564 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbfa00c92e0 0x7fbfa013f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:52.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.599+0000 7fbfa5600640 1 --2- 172.21.15.100:0/2481645564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfa0155a80 0x7fbfa0068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:52.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.599+0000 7fbfa4c00640 1 -- 172.21.15.100:0/2481645564 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbfa00c92e0 msgr2=0x7fbfa013f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:52.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.599+0000 7fbfa4c00640 1 --2- 172.21.15.100:0/2481645564 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbfa00c92e0 0x7fbfa013f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.599+0000 7fbfa4c00640 1 -- 172.21.15.100:0/2481645564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfa0155a80 msgr2=0x7fbfa0068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:52.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.599+0000 7fbfa4c00640 1 --2- 172.21.15.100:0/2481645564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfa0155a80 0x7fbfa0068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.599+0000 7fbfa4c00640 1 -- 172.21.15.100:0/2481645564 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf98009a20 con 0x7fbfa00c7db0 2024-08-17T02:45:52.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.599+0000 7fbfa4c00640 1 --2- 172.21.15.100:0/2481645564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfa00c7db0 0x7fbfa014d1d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400c4c0 tx=0x7fbf94007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:52.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.600+0000 7fbf93e00640 1 -- 172.21.15.100:0/2481645564 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf94011590 con 0x7fbfa00c7db0 2024-08-17T02:45:52.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.600+0000 7fbf93e00640 1 -- 172.21.15.100:0/2481645564 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf94011710 con 0x7fbfa00c7db0 2024-08-17T02:45:52.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.600+0000 7fbf93e00640 1 -- 172.21.15.100:0/2481645564 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf94011ad0 con 0x7fbfa00c7db0 2024-08-17T02:45:52.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.600+0000 7fbfa7600640 1 -- 172.21.15.100:0/2481645564 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa014de20 con 0x7fbfa00c7db0 2024-08-17T02:45:52.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.600+0000 7fbfa7600640 1 -- 172.21.15.100:0/2481645564 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa014e3e0 con 0x7fbfa00c7db0 2024-08-17T02:45:52.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.601+0000 7fbfa7600640 1 -- 172.21.15.100:0/2481645564 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa0071050 con 0x7fbfa00c7db0 2024-08-17T02:45:52.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.602+0000 7fbf93e00640 1 -- 172.21.15.100:0/2481645564 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbf9401b3b0 con 0x7fbfa00c7db0 2024-08-17T02:45:52.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.602+0000 7fbf93e00640 1 --2- 172.21.15.100:0/2481645564 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbf80065150 0x7fbf80067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:52.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.602+0000 7fbf93e00640 1 -- 172.21.15.100:0/2481645564 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf94081900 con 0x7fbfa00c7db0 2024-08-17T02:45:52.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.603+0000 7fbf9fe00640 1 --2- 172.21.15.100:0/2481645564 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbf80065150 0x7fbf80067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:52.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.603+0000 7fbf9fe00640 1 --2- 172.21.15.100:0/2481645564 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbf80065150 0x7fbf80067600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0149620 tx=0x7fbf8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:52.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.607+0000 7fbf93e00640 1 -- 172.21.15.100:0/2481645564 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbf9404f9d0 con 0x7fbfa00c7db0 2024-08-17T02:45:52.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.780+0000 7fbfa7600640 1 -- 172.21.15.100:0/2481645564 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbfa00b0510 con 0x7fbfa00c7db0 2024-08-17T02:45:52.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.780+0000 7fbf93e00640 1 -- 172.21.15.100:0/2481645564 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbf94017020 con 0x7fbfa00c7db0 2024-08-17T02:45:52.781 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-08-17T02:45:52.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.782+0000 7fbfa7600640 1 -- 172.21.15.100:0/2481645564 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbf80065150 msgr2=0x7fbf80067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:52.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.782+0000 7fbfa7600640 1 --2- 172.21.15.100:0/2481645564 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbf80065150 0x7fbf80067600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0149620 tx=0x7fbf8c009040 comp rx=0 tx=0).stop 2024-08-17T02:45:52.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.782+0000 7fbfa7600640 1 -- 172.21.15.100:0/2481645564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfa00c7db0 msgr2=0x7fbfa014d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:52.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.782+0000 7fbfa7600640 1 --2- 172.21.15.100:0/2481645564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfa00c7db0 0x7fbfa014d1d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400c4c0 tx=0x7fbf94007ef0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.782+0000 7fbfa7600640 1 -- 172.21.15.100:0/2481645564 shutdown_connections 2024-08-17T02:45:52.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.782+0000 7fbfa7600640 1 --2- 172.21.15.100:0/2481645564 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbf80065150 0x7fbf80067600 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.782+0000 7fbfa7600640 1 --2- 172.21.15.100:0/2481645564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfa0155a80 0x7fbfa0068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.782+0000 7fbfa7600640 1 --2- 172.21.15.100:0/2481645564 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbfa00c92e0 0x7fbfa013f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.782+0000 7fbfa7600640 1 --2- 172.21.15.100:0/2481645564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfa00c7db0 0x7fbfa014d1d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.782+0000 7fbfa7600640 1 -- 172.21.15.100:0/2481645564 >> 172.21.15.100:0/2481645564 conn(0x7fbfa0067750 msgr2=0x7fbfa0151d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:52.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.783+0000 7fbfa7600640 1 -- 172.21.15.100:0/2481645564 shutdown_connections 2024-08-17T02:45:52.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.783+0000 7fbfa7600640 1 -- 172.21.15.100:0/2481645564 wait complete. 2024-08-17T02:45:52.798 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:45:52.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.948+0000 7fd7caa00640 1 Processor -- start 2024-08-17T02:45:52.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.948+0000 7fd7caa00640 1 -- start start 2024-08-17T02:45:52.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.949+0000 7fd7caa00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd7c4156c50 0x7fd7c40c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:52.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.949+0000 7fd7caa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd7c40adcf0 0x7fd7c40ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:52.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.949+0000 7fd7caa00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd7c40abb00 0x7fd7c40c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:52.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.949+0000 7fd7caa00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c40ab130 con 0x7fd7c40adcf0 2024-08-17T02:45:52.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.949+0000 7fd7caa00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c40ae5a0 con 0x7fd7c40abb00 2024-08-17T02:45:52.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.949+0000 7fd7caa00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c40ae2c0 con 0x7fd7c4156c50 2024-08-17T02:45:52.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.949+0000 7fd7c3400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd7c40adcf0 0x7fd7c40ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:52.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.949+0000 7fd7c3400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd7c40adcf0 0x7fd7c40ab5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33336/0 (socket says 172.21.15.100:33336) 2024-08-17T02:45:52.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.949+0000 7fd7c3400640 1 -- 172.21.15.100:0/2112774264 learned_addr learned my addr 172.21.15.100:0/2112774264 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:52.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.950+0000 7fd7c8a00640 1 --2- 172.21.15.100:0/2112774264 >> v2:172.21.15.123:3300/0 conn(0x7fd7c40abb00 0x7fd7c40c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:52.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.950+0000 7fd7c3e00640 1 --2- 172.21.15.100:0/2112774264 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd7c4156c50 0x7fd7c40c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:52.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.950+0000 7fd7c3400640 1 -- 172.21.15.100:0/2112774264 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd7c4156c50 msgr2=0x7fd7c40c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:52.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.950+0000 7fd7c3400640 1 --2- 172.21.15.100:0/2112774264 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd7c4156c50 0x7fd7c40c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.950+0000 7fd7c3400640 1 -- 172.21.15.100:0/2112774264 >> v2:172.21.15.123:3300/0 conn(0x7fd7c40abb00 msgr2=0x7fd7c40c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:52.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.950+0000 7fd7c3400640 1 --2- 172.21.15.100:0/2112774264 >> v2:172.21.15.123:3300/0 conn(0x7fd7c40abb00 0x7fd7c40c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.950+0000 7fd7c3400640 1 -- 172.21.15.100:0/2112774264 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c40aaae0 con 0x7fd7c40adcf0 2024-08-17T02:45:52.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.951+0000 7fd7c3400640 1 --2- 172.21.15.100:0/2112774264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7c40adcf0 0x7fd7c40ab5c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd7c406ef40 tx=0x7fd7b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd62005d249060d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:52.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.951+0000 7fd7c2a00640 1 -- 172.21.15.100:0/2112774264 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b002ad40 con 0x7fd7c40adcf0 2024-08-17T02:45:52.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.951+0000 7fd7c2a00640 1 -- 172.21.15.100:0/2112774264 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b0032440 con 0x7fd7c40adcf0 2024-08-17T02:45:52.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.951+0000 7fd7c2a00640 1 -- 172.21.15.100:0/2112774264 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b002aea0 con 0x7fd7c40adcf0 2024-08-17T02:45:52.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.952+0000 7fd7caa00640 1 -- 172.21.15.100:0/2112774264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7c40adcf0 msgr2=0x7fd7c40ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:52.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.952+0000 7fd7caa00640 1 --2- 172.21.15.100:0/2112774264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7c40adcf0 0x7fd7c40ab5c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd7c406ef40 tx=0x7fd7b00091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.952+0000 7fd7caa00640 1 -- 172.21.15.100:0/2112774264 shutdown_connections 2024-08-17T02:45:52.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.952+0000 7fd7caa00640 1 --2- 172.21.15.100:0/2112774264 >> v2:172.21.15.123:3300/0 conn(0x7fd7c40abb00 0x7fd7c40c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.952+0000 7fd7caa00640 1 --2- 172.21.15.100:0/2112774264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7c40adcf0 0x7fd7c40ab5c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.952+0000 7fd7caa00640 1 --2- 172.21.15.100:0/2112774264 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd7c4156c50 0x7fd7c40c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.952+0000 7fd7caa00640 1 -- 172.21.15.100:0/2112774264 >> 172.21.15.100:0/2112774264 conn(0x7fd7c4067750 msgr2=0x7fd7c40c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:52.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.952+0000 7fd7caa00640 1 -- 172.21.15.100:0/2112774264 shutdown_connections 2024-08-17T02:45:52.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.952+0000 7fd7caa00640 1 -- 172.21.15.100:0/2112774264 wait complete. 2024-08-17T02:45:52.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.953+0000 7fd7caa00640 1 Processor -- start 2024-08-17T02:45:52.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.953+0000 7fd7caa00640 1 -- start start 2024-08-17T02:45:52.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.954+0000 7fd7caa00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd7c40abb00 0x7fd7c414b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:52.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.954+0000 7fd7caa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c40adcf0 0x7fd7c41516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:52.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.954+0000 7fd7caa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7c4156c50 0x7fd7c4151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:52.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.954+0000 7fd7caa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c4157020 con 0x7fd7c4156c50 2024-08-17T02:45:52.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.954+0000 7fd7caa00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c4157e80 con 0x7fd7c40adcf0 2024-08-17T02:45:52.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.954+0000 7fd7caa00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c4157270 con 0x7fd7c40abb00 2024-08-17T02:45:52.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.954+0000 7fd7c8a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7c4156c50 0x7fd7c4151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:52.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.954+0000 7fd7c8a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7c4156c50 0x7fd7c4151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33346/0 (socket says 172.21.15.100:33346) 2024-08-17T02:45:52.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.954+0000 7fd7c8a00640 1 -- 172.21.15.100:0/2021774817 learned_addr learned my addr 172.21.15.100:0/2021774817 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:52.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.954+0000 7fd7c3400640 1 --2- 172.21.15.100:0/2021774817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c40adcf0 0x7fd7c41516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:52.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.954+0000 7fd7c3e00640 1 --2- 172.21.15.100:0/2021774817 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd7c40abb00 0x7fd7c414b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.955+0000 7fd7c8a00640 1 -- 172.21.15.100:0/2021774817 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd7c40abb00 msgr2=0x7fd7c414b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.955+0000 7fd7c8a00640 1 --2- 172.21.15.100:0/2021774817 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd7c40abb00 0x7fd7c414b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.955+0000 7fd7c8a00640 1 -- 172.21.15.100:0/2021774817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c40adcf0 msgr2=0x7fd7c41516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.955+0000 7fd7c8a00640 1 --2- 172.21.15.100:0/2021774817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c40adcf0 0x7fd7c41516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.955+0000 7fd7c8a00640 1 -- 172.21.15.100:0/2021774817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b0009450 con 0x7fd7c4156c50 2024-08-17T02:45:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.955+0000 7fd7c3400640 1 --2- 172.21.15.100:0/2021774817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c40adcf0 0x7fd7c41516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.955+0000 7fd7c3e00640 1 --2- 172.21.15.100:0/2021774817 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd7c40abb00 0x7fd7c414b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.955+0000 7fd7c8a00640 1 --2- 172.21.15.100:0/2021774817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7c4156c50 0x7fd7c4151c20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009f20 tx=0x7fd7bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.955+0000 7fd7bb400640 1 -- 172.21.15.100:0/2021774817 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc00ce10 con 0x7fd7c4156c50 2024-08-17T02:45:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.955+0000 7fd7bb400640 1 -- 172.21.15.100:0/2021774817 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc00f040 con 0x7fd7c4156c50 2024-08-17T02:45:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.955+0000 7fd7bb400640 1 -- 172.21.15.100:0/2021774817 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc0146d0 con 0x7fd7c4156c50 2024-08-17T02:45:52.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.955+0000 7fd7caa00640 1 -- 172.21.15.100:0/2021774817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c4157550 con 0x7fd7c4156c50 2024-08-17T02:45:52.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.955+0000 7fd7caa00640 1 -- 172.21.15.100:0/2021774817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c4157b10 con 0x7fd7c4156c50 2024-08-17T02:45:52.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.956+0000 7fd7caa00640 1 -- 172.21.15.100:0/2021774817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c4071050 con 0x7fd7c4156c50 2024-08-17T02:45:52.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.957+0000 7fd7bb400640 1 -- 172.21.15.100:0/2021774817 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd7bc014a80 con 0x7fd7c4156c50 2024-08-17T02:45:52.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.958+0000 7fd7bb400640 1 --2- 172.21.15.100:0/2021774817 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd7a4065150 0x7fd7a4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:52.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.958+0000 7fd7bb400640 1 -- 172.21.15.100:0/2021774817 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd7bc0833b0 con 0x7fd7c4156c50 2024-08-17T02:45:52.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.958+0000 7fd7c3e00640 1 --2- 172.21.15.100:0/2021774817 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd7a4065150 0x7fd7a4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:52.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.959+0000 7fd7c3e00640 1 --2- 172.21.15.100:0/2021774817 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd7a4065150 0x7fd7a4067600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400bb20 tx=0x7fd7b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:52.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:52.962+0000 7fd7bb400640 1 -- 172.21.15.100:0/2021774817 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd7bc0513d0 con 0x7fd7c4156c50 2024-08-17T02:45:53.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.135+0000 7fd7caa00640 1 -- 172.21.15.100:0/2021774817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd7c4157fc0 con 0x7fd7c4156c50 2024-08-17T02:45:53.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.136+0000 7fd7bb400640 1 -- 172.21.15.100:0/2021774817 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd7bc0549f0 con 0x7fd7c4156c50 2024-08-17T02:45:53.136 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-08-17T02:45:53.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.138+0000 7fd7caa00640 1 -- 172.21.15.100:0/2021774817 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd7a4065150 msgr2=0x7fd7a4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:53.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.138+0000 7fd7caa00640 1 --2- 172.21.15.100:0/2021774817 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd7a4065150 0x7fd7a4067600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400bb20 tx=0x7fd7b4008040 comp rx=0 tx=0).stop 2024-08-17T02:45:53.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.138+0000 7fd7caa00640 1 -- 172.21.15.100:0/2021774817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7c4156c50 msgr2=0x7fd7c4151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:53.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.138+0000 7fd7caa00640 1 --2- 172.21.15.100:0/2021774817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7c4156c50 0x7fd7c4151c20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009f20 tx=0x7fd7bc00b040 comp rx=0 tx=0).stop 2024-08-17T02:45:53.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.138+0000 7fd7caa00640 1 -- 172.21.15.100:0/2021774817 shutdown_connections 2024-08-17T02:45:53.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.138+0000 7fd7caa00640 1 --2- 172.21.15.100:0/2021774817 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd7a4065150 0x7fd7a4067600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.138+0000 7fd7caa00640 1 --2- 172.21.15.100:0/2021774817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7c4156c50 0x7fd7c4151c20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.138+0000 7fd7caa00640 1 --2- 172.21.15.100:0/2021774817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c40adcf0 0x7fd7c41516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.138+0000 7fd7caa00640 1 --2- 172.21.15.100:0/2021774817 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd7c40abb00 0x7fd7c414b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.138+0000 7fd7caa00640 1 -- 172.21.15.100:0/2021774817 >> 172.21.15.100:0/2021774817 conn(0x7fd7c4067750 msgr2=0x7fd7c415e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:53.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.138+0000 7fd7caa00640 1 -- 172.21.15.100:0/2021774817 shutdown_connections 2024-08-17T02:45:53.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.138+0000 7fd7caa00640 1 -- 172.21.15.100:0/2021774817 wait complete. 2024-08-17T02:45:53.155 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:45:53.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.301+0000 7f5718e00640 1 Processor -- start 2024-08-17T02:45:53.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.301+0000 7f5718e00640 1 -- start start 2024-08-17T02:45:53.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.302+0000 7f5718e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f57141401b0 0x7f57140caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:53.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.302+0000 7f5718e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5714140580 0x7f57140b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:53.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.302+0000 7f5718e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57140b16d0 con 0x7f57140b1270 2024-08-17T02:45:53.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.302+0000 7f5718e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57140cb450 con 0x7f57141401b0 2024-08-17T02:45:53.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.302+0000 7f5718e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57140caa80 con 0x7f5714140580 2024-08-17T02:45:53.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.303+0000 7f5711400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5714140580 0x7f57140b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:53.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.303+0000 7f5711400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5714140580 0x7f57140b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:33260/0 (socket says 172.21.15.100:33260) 2024-08-17T02:45:53.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.303+0000 7f5711400640 1 -- 172.21.15.100:0/3346740314 learned_addr learned my addr 172.21.15.100:0/3346740314 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:53.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.303+0000 7f5711e00640 1 --2- 172.21.15.100:0/3346740314 >> v2:172.21.15.123:3300/0 conn(0x7f57141401b0 0x7f57140caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:53.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.303+0000 7f5711400640 1 -- 172.21.15.100:0/3346740314 >> v2:172.21.15.123:3300/0 conn(0x7f57141401b0 msgr2=0x7f57140caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:53.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.303+0000 7f5711400640 1 --2- 172.21.15.100:0/3346740314 >> v2:172.21.15.123:3300/0 conn(0x7f57141401b0 0x7f57140caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.303+0000 7f5711400640 1 -- 172.21.15.100:0/3346740314 >> v1:172.21.15.123:6789/0 conn(0x7f57140b1270 legacy=0x7f57140c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:53.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.303+0000 7f5711400640 1 -- 172.21.15.100:0/3346740314 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57140c9e70 con 0x7f5714140580 2024-08-17T02:45:53.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.304+0000 7f5711400640 1 --2- 172.21.15.100:0/3346740314 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5714140580 0x7f57140b0d30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5700009910 tx=0x7f57000091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb509f88e6f50c86 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:53.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.304+0000 7f5710a00640 1 -- 172.21.15.100:0/3346740314 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570002adb0 con 0x7f5714140580 2024-08-17T02:45:53.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.305+0000 7f5710a00640 1 -- 172.21.15.100:0/3346740314 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5700032440 con 0x7f5714140580 2024-08-17T02:45:53.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.305+0000 7f5710a00640 1 -- 172.21.15.100:0/3346740314 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5700032820 con 0x7f5714140580 2024-08-17T02:45:53.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.305+0000 7f5718e00640 1 -- 172.21.15.100:0/3346740314 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5714140580 msgr2=0x7f57140b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:53.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.305+0000 7f5718e00640 1 --2- 172.21.15.100:0/3346740314 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5714140580 0x7f57140b0d30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5700009910 tx=0x7f57000091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.305+0000 7f5718e00640 1 -- 172.21.15.100:0/3346740314 shutdown_connections 2024-08-17T02:45:53.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.305+0000 7f5718e00640 1 --2- 172.21.15.100:0/3346740314 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5714140580 0x7f57140b0d30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.305+0000 7f5718e00640 1 --2- 172.21.15.100:0/3346740314 >> v2:172.21.15.123:3300/0 conn(0x7f57141401b0 0x7f57140caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.305+0000 7f5718e00640 1 -- 172.21.15.100:0/3346740314 >> 172.21.15.100:0/3346740314 conn(0x7f57140cb9b0 msgr2=0x7f57140cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:53.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.305+0000 7f5718e00640 1 -- 172.21.15.100:0/3346740314 shutdown_connections 2024-08-17T02:45:53.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.305+0000 7f5718e00640 1 -- 172.21.15.100:0/3346740314 wait complete. 2024-08-17T02:45:53.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.306+0000 7f5718e00640 1 Processor -- start 2024-08-17T02:45:53.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.307+0000 7f5718e00640 1 -- start start 2024-08-17T02:45:53.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.307+0000 7f5718e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57140b1270 0x7f57140c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:53.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.307+0000 7f5718e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f57141401b0 0x7f57140c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:53.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.308+0000 7f5718e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5714140580 0x7f571416a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:53.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.308+0000 7f5718e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57140abaa0 con 0x7f57140b1270 2024-08-17T02:45:53.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.308+0000 7f5718e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571413eab0 con 0x7f5714140580 2024-08-17T02:45:53.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.308+0000 7f5718e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57140c74e0 con 0x7f57141401b0 2024-08-17T02:45:53.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.308+0000 7f5711e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57140b1270 0x7f57140c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:53.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.308+0000 7f5711e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57140b1270 0x7f57140c6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33358/0 (socket says 172.21.15.100:33358) 2024-08-17T02:45:53.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.308+0000 7f5711e00640 1 -- 172.21.15.100:0/420504799 learned_addr learned my addr 172.21.15.100:0/420504799 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:53.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.308+0000 7f5711400640 1 --2- 172.21.15.100:0/420504799 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f57141401b0 0x7f57140c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:53.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.308+0000 7f5712800640 1 --2- 172.21.15.100:0/420504799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5714140580 0x7f571416a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:53.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.308+0000 7f5711e00640 1 -- 172.21.15.100:0/420504799 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f57141401b0 msgr2=0x7f57140c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:53.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.308+0000 7f5711e00640 1 --2- 172.21.15.100:0/420504799 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f57141401b0 0x7f57140c6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.308+0000 7f5711e00640 1 -- 172.21.15.100:0/420504799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5714140580 msgr2=0x7f571416a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:53.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.308+0000 7f5711e00640 1 --2- 172.21.15.100:0/420504799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5714140580 0x7f571416a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.308+0000 7f5711e00640 1 -- 172.21.15.100:0/420504799 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5700009450 con 0x7f57140b1270 2024-08-17T02:45:53.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.308+0000 7f5711e00640 1 --2- 172.21.15.100:0/420504799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57140b1270 0x7f57140c6900 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f570400e900 tx=0x7f57040090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:53.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.309+0000 7f5709600640 1 -- 172.21.15.100:0/420504799 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570400c8e0 con 0x7f57140b1270 2024-08-17T02:45:53.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.309+0000 7f5709600640 1 -- 172.21.15.100:0/420504799 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570400ca40 con 0x7f57140b1270 2024-08-17T02:45:53.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.309+0000 7f5709600640 1 -- 172.21.15.100:0/420504799 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570400cde0 con 0x7f57140b1270 2024-08-17T02:45:53.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.309+0000 7f5718e00640 1 -- 172.21.15.100:0/420504799 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57140c77c0 con 0x7f57140b1270 2024-08-17T02:45:53.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.309+0000 7f5718e00640 1 -- 172.21.15.100:0/420504799 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57140c7d80 con 0x7f57140b1270 2024-08-17T02:45:53.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.310+0000 7f5718e00640 1 -- 172.21.15.100:0/420504799 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5714064db0 con 0x7f57140b1270 2024-08-17T02:45:53.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.311+0000 7f5709600640 1 -- 172.21.15.100:0/420504799 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5704013680 con 0x7f57140b1270 2024-08-17T02:45:53.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.311+0000 7f5709600640 1 --2- 172.21.15.100:0/420504799 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f56f4065180 0x7f56f4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:53.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.311+0000 7f5709600640 1 -- 172.21.15.100:0/420504799 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f57040824f0 con 0x7f57140b1270 2024-08-17T02:45:53.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.312+0000 7f5711400640 1 --2- 172.21.15.100:0/420504799 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f56f4065180 0x7f56f4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:53.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.312+0000 7f5711400640 1 --2- 172.21.15.100:0/420504799 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f56f4065180 0x7f56f4067630 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5700034000 tx=0x7f5700032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:53.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.315+0000 7f5709600640 1 -- 172.21.15.100:0/420504799 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5704050720 con 0x7f57140b1270 2024-08-17T02:45:53.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.524+0000 7f5718e00640 1 -- 172.21.15.100:0/420504799 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57140cc190 con 0x7f57140b1270 2024-08-17T02:45:53.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.524+0000 7f5709600640 1 -- 172.21.15.100:0/420504799 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f5704053d40 con 0x7f57140b1270 2024-08-17T02:45:53.525 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:53.526 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3043714204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3043714204},{"type":"v1","addr":"172.21.15.100:6835","nonce":3043714204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/543049926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":543049926},{"type":"v1","addr":"172.21.15.100:6837","nonce":543049926}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2733092927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2733092927},{"type":"v1","addr":"172.21.15.123:6834","nonce":2733092927}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:45:41.237121+0000","modified":"2024-08-17T02:45:44.862501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/2872394530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2872394530},{"type":"v1","addr":"172.21.15.123:6835","nonce":2872394530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:45:53.526 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-08-17T02:45:53.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.527+0000 7f5718e00640 1 -- 172.21.15.100:0/420504799 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f56f4065180 msgr2=0x7f56f4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:53.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.527+0000 7f5718e00640 1 --2- 172.21.15.100:0/420504799 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f56f4065180 0x7f56f4067630 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5700034000 tx=0x7f5700032000 comp rx=0 tx=0).stop 2024-08-17T02:45:53.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.527+0000 7f5718e00640 1 -- 172.21.15.100:0/420504799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57140b1270 msgr2=0x7f57140c6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:53.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.527+0000 7f5718e00640 1 --2- 172.21.15.100:0/420504799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57140b1270 0x7f57140c6900 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f570400e900 tx=0x7f57040090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.527+0000 7f5718e00640 1 -- 172.21.15.100:0/420504799 shutdown_connections 2024-08-17T02:45:53.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.527+0000 7f5718e00640 1 --2- 172.21.15.100:0/420504799 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f56f4065180 0x7f56f4067630 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.527+0000 7f5718e00640 1 --2- 172.21.15.100:0/420504799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5714140580 0x7f571416a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.527+0000 7f5718e00640 1 --2- 172.21.15.100:0/420504799 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f57141401b0 0x7f57140c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.527+0000 7f5718e00640 1 --2- 172.21.15.100:0/420504799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57140b1270 0x7f57140c6900 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.527+0000 7f5718e00640 1 -- 172.21.15.100:0/420504799 >> 172.21.15.100:0/420504799 conn(0x7f57140cb9b0 msgr2=0x7f571413ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:53.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.527+0000 7f5718e00640 1 -- 172.21.15.100:0/420504799 shutdown_connections 2024-08-17T02:45:53.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.527+0000 7f5718e00640 1 -- 172.21.15.100:0/420504799 wait complete. 2024-08-17T02:45:53.542 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:45:53.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.689+0000 7f7447000640 1 Processor -- start 2024-08-17T02:45:53.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.689+0000 7f7447000640 1 -- start start 2024-08-17T02:45:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.690+0000 7f7447000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7440069170 0x7f74400695c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.690+0000 7f7447000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f744015c8d0 0x7f744015cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.690+0000 7f7447000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7440069b00 con 0x7f7440068510 2024-08-17T02:45:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.690+0000 7f7447000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74400688e0 con 0x7f7440069170 2024-08-17T02:45:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.690+0000 7f7447000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744006e540 con 0x7f744015c8d0 2024-08-17T02:45:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.690+0000 7f7446600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f744015c8d0 0x7f744015cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.690+0000 7f7445200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7440069170 0x7f74400695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.691+0000 7f7446600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f744015c8d0 0x7f744015cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:33276/0 (socket says 172.21.15.100:33276) 2024-08-17T02:45:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.691+0000 7f7446600640 1 -- 172.21.15.100:0/4068398658 learned_addr learned my addr 172.21.15.100:0/4068398658 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.691+0000 7f7445c00640 1 --1- 172.21.15.100:0/4068398658 >> v1:172.21.15.123:6789/0 conn(0x7f7440068510 0x7f744006de30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.100:37136/0 (socket says 172.21.15.100:37136) 2024-08-17T02:45:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.691+0000 7f7446600640 1 -- 172.21.15.100:0/4068398658 >> v2:172.21.15.123:3300/0 conn(0x7f7440069170 msgr2=0x7f74400695c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.691+0000 7f7446600640 1 --2- 172.21.15.100:0/4068398658 >> v2:172.21.15.123:3300/0 conn(0x7f7440069170 0x7f74400695c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.691+0000 7f7446600640 1 -- 172.21.15.100:0/4068398658 >> v1:172.21.15.123:6789/0 conn(0x7f7440068510 legacy=0x7f744006de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:53.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.691+0000 7f7446600640 1 -- 172.21.15.100:0/4068398658 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744006d0b0 con 0x7f744015c8d0 2024-08-17T02:45:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.692+0000 7f7446600640 1 --2- 172.21.15.100:0/4068398658 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f744015c8d0 0x7f744015cd30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7438009f20 tx=0x7f7438009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fad68274c6c76841 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.692+0000 7f743fe00640 1 -- 172.21.15.100:0/4068398658 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438031400 con 0x7f744015c8d0 2024-08-17T02:45:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.692+0000 7f743fe00640 1 -- 172.21.15.100:0/4068398658 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743802d050 con 0x7f744015c8d0 2024-08-17T02:45:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.692+0000 7f743fe00640 1 -- 172.21.15.100:0/4068398658 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74380317d0 con 0x7f744015c8d0 2024-08-17T02:45:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.693+0000 7f7447000640 1 -- 172.21.15.100:0/4068398658 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f744015c8d0 msgr2=0x7f744015cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.693+0000 7f7447000640 1 --2- 172.21.15.100:0/4068398658 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f744015c8d0 0x7f744015cd30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7438009f20 tx=0x7f7438009840 comp rx=0 tx=0).stop 2024-08-17T02:45:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.693+0000 7f7447000640 1 -- 172.21.15.100:0/4068398658 shutdown_connections 2024-08-17T02:45:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.693+0000 7f7447000640 1 --2- 172.21.15.100:0/4068398658 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f744015c8d0 0x7f744015cd30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.693+0000 7f7447000640 1 --2- 172.21.15.100:0/4068398658 >> v2:172.21.15.123:3300/0 conn(0x7f7440069170 0x7f74400695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.693+0000 7f7447000640 1 -- 172.21.15.100:0/4068398658 >> 172.21.15.100:0/4068398658 conn(0x7f74400cc040 msgr2=0x7f74400cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:53.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.693+0000 7f7447000640 1 -- 172.21.15.100:0/4068398658 shutdown_connections 2024-08-17T02:45:53.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.693+0000 7f7447000640 1 -- 172.21.15.100:0/4068398658 wait complete. 2024-08-17T02:45:53.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.694+0000 7f7447000640 1 Processor -- start 2024-08-17T02:45:53.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.694+0000 7f7447000640 1 -- start start 2024-08-17T02:45:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.695+0000 7f7447000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7440068510 0x7f7440169a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.695+0000 7f7447000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7440069170 0x7f74400cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.695+0000 7f7447000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f744015c8d0 0x7f74400cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.695+0000 7f7447000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744015d8a0 con 0x7f744015c8d0 2024-08-17T02:45:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.695+0000 7f7447000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7440169f40 con 0x7f7440069170 2024-08-17T02:45:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.695+0000 7f7447000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7440098dc0 con 0x7f7440068510 2024-08-17T02:45:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.695+0000 7f7446600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f744015c8d0 0x7f74400cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.696+0000 7f7446600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f744015c8d0 0x7f74400cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33368/0 (socket says 172.21.15.100:33368) 2024-08-17T02:45:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.696+0000 7f7446600640 1 -- 172.21.15.100:0/991817403 learned_addr learned my addr 172.21.15.100:0/991817403 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.696+0000 7f7445c00640 1 --2- 172.21.15.100:0/991817403 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7440068510 0x7f7440169a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.696+0000 7f7445200640 1 --2- 172.21.15.100:0/991817403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7440069170 0x7f74400cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.696+0000 7f7446600640 1 -- 172.21.15.100:0/991817403 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7440068510 msgr2=0x7f7440169a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.696+0000 7f7446600640 1 --2- 172.21.15.100:0/991817403 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7440068510 0x7f7440169a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.696+0000 7f7446600640 1 -- 172.21.15.100:0/991817403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7440069170 msgr2=0x7f74400cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.696+0000 7f7446600640 1 --2- 172.21.15.100:0/991817403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7440069170 0x7f74400cb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.696+0000 7f7446600640 1 -- 172.21.15.100:0/991817403 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7438009ae0 con 0x7f744015c8d0 2024-08-17T02:45:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.696+0000 7f7446600640 1 --2- 172.21.15.100:0/991817403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f744015c8d0 0x7f74400cb8a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7438009f80 tx=0x7f7438036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.697+0000 7f743cc00640 1 -- 172.21.15.100:0/991817403 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438008e50 con 0x7f744015c8d0 2024-08-17T02:45:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.697+0000 7f743cc00640 1 -- 172.21.15.100:0/991817403 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743803b410 con 0x7f744015c8d0 2024-08-17T02:45:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.697+0000 7f743cc00640 1 -- 172.21.15.100:0/991817403 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743803b7d0 con 0x7f744015c8d0 2024-08-17T02:45:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.697+0000 7f7447000640 1 -- 172.21.15.100:0/991817403 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74400990a0 con 0x7f744015c8d0 2024-08-17T02:45:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.697+0000 7f7447000640 1 -- 172.21.15.100:0/991817403 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7440099660 con 0x7f744015c8d0 2024-08-17T02:45:53.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.698+0000 7f7447000640 1 -- 172.21.15.100:0/991817403 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7440071050 con 0x7f744015c8d0 2024-08-17T02:45:53.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.699+0000 7f743cc00640 1 -- 172.21.15.100:0/991817403 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7438038050 con 0x7f744015c8d0 2024-08-17T02:45:53.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.699+0000 7f743cc00640 1 --2- 172.21.15.100:0/991817403 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7420065150 0x7f7420067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:53.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.699+0000 7f743cc00640 1 -- 172.21.15.100:0/991817403 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f74380a2fc0 con 0x7f744015c8d0 2024-08-17T02:45:53.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.700+0000 7f7445c00640 1 --2- 172.21.15.100:0/991817403 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7420065150 0x7f7420067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:53.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.700+0000 7f7445c00640 1 --2- 172.21.15.100:0/991817403 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7420065150 0x7f7420067600 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f744016a160 tx=0x7f7430007e20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:53.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.703+0000 7f743cc00640 1 -- 172.21.15.100:0/991817403 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f74380d4e40 con 0x7f744015c8d0 2024-08-17T02:45:53.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.876+0000 7f7447000640 1 -- 172.21.15.100:0/991817403 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7440066e50 con 0x7f744015c8d0 2024-08-17T02:45:53.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.877+0000 7f743cc00640 1 -- 172.21.15.100:0/991817403 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f7438071130 con 0x7f744015c8d0 2024-08-17T02:45:53.877 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:53.878 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:42.845503+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:45:39.036964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:45:40.232954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:45:53.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.879+0000 7f7447000640 1 -- 172.21.15.100:0/991817403 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7420065150 msgr2=0x7f7420067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:53.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.879+0000 7f7447000640 1 --2- 172.21.15.100:0/991817403 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7420065150 0x7f7420067600 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f744016a160 tx=0x7f7430007e20 comp rx=0 tx=0).stop 2024-08-17T02:45:53.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.879+0000 7f7447000640 1 -- 172.21.15.100:0/991817403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f744015c8d0 msgr2=0x7f74400cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:53.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.879+0000 7f7447000640 1 --2- 172.21.15.100:0/991817403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f744015c8d0 0x7f74400cb8a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7438009f80 tx=0x7f7438036000 comp rx=0 tx=0).stop 2024-08-17T02:45:53.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.879+0000 7f7447000640 1 -- 172.21.15.100:0/991817403 shutdown_connections 2024-08-17T02:45:53.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.879+0000 7f7447000640 1 --2- 172.21.15.100:0/991817403 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7420065150 0x7f7420067600 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.879+0000 7f7447000640 1 --2- 172.21.15.100:0/991817403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f744015c8d0 0x7f74400cb8a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.879+0000 7f7447000640 1 --2- 172.21.15.100:0/991817403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7440069170 0x7f74400cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.879+0000 7f7447000640 1 --2- 172.21.15.100:0/991817403 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7440068510 0x7f7440169a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.879+0000 7f7447000640 1 -- 172.21.15.100:0/991817403 >> 172.21.15.100:0/991817403 conn(0x7f74400cc040 msgr2=0x7f744006fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:53.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.879+0000 7f7447000640 1 -- 172.21.15.100:0/991817403 shutdown_connections 2024-08-17T02:45:53.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:53.879+0000 7f7447000640 1 -- 172.21.15.100:0/991817403 wait complete. 2024-08-17T02:45:53.896 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:45:35.140990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:45:39.036964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:45:40.232954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:45:53.896 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:45:54.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.047+0000 7ff2a1c00640 1 Processor -- start 2024-08-17T02:45:54.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.047+0000 7ff2a1c00640 1 -- start start 2024-08-17T02:45:54.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.048+0000 7ff2a1c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff29c157e10 0x7ff29c0b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.048+0000 7ff2a1c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff29c0adec0 0x7ff29c15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.048+0000 7ff2a1c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff29c157070 con 0x7ff29c0b0a80 2024-08-17T02:45:54.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.048+0000 7ff2a1c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29c0b1390 con 0x7ff29c157e10 2024-08-17T02:45:54.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.048+0000 7ff2a1c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c15b410 con 0x7ff29c0adec0 2024-08-17T02:45:54.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.048+0000 7ff29aa00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff29c0b0a80 0x7ff29c0ad7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37562/0 (socket says 172.21.15.100:37562) 2024-08-17T02:45:54.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.048+0000 7ff29aa00640 1 -- 172.21.15.100:0/3235243213 learned_addr learned my addr 172.21.15.100:0/3235243213 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:54.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.049+0000 7ff29a000640 1 --2- 172.21.15.100:0/3235243213 >> v2:172.21.15.123:3300/0 conn(0x7ff29c157e10 0x7ff29c0b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.049+0000 7ff29b400640 1 --2- 172.21.15.100:0/3235243213 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff29c0adec0 0x7ff29c15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.049+0000 7ff299600640 1 -- 172.21.15.100:0/3235243213 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2409314184 0 0) 0x7ff29c157070 con 0x7ff29c0b0a80 2024-08-17T02:45:54.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.049+0000 7ff299600640 1 -- 172.21.15.100:0/3235243213 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2800034e0 con 0x7ff29c0b0a80 2024-08-17T02:45:54.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.049+0000 7ff299600640 1 -- 172.21.15.100:0/3235243213 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 859459010 0 0) 0x7ff2800034e0 con 0x7ff29c0b0a80 2024-08-17T02:45:54.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.049+0000 7ff299600640 1 -- 172.21.15.100:0/3235243213 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff29c0adec0 msgr2=0x7ff29c15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:54.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.049+0000 7ff299600640 1 --2- 172.21.15.100:0/3235243213 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff29c0adec0 0x7ff29c15a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.049+0000 7ff299600640 1 -- 172.21.15.100:0/3235243213 >> v2:172.21.15.123:3300/0 conn(0x7ff29c157e10 msgr2=0x7ff29c0b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:54.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.049+0000 7ff299600640 1 --2- 172.21.15.100:0/3235243213 >> v2:172.21.15.123:3300/0 conn(0x7ff29c157e10 0x7ff29c0b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.049+0000 7ff299600640 1 -- 172.21.15.100:0/3235243213 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c157330 con 0x7ff29c0b0a80 2024-08-17T02:45:54.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.049+0000 7ff299600640 1 -- 172.21.15.100:0/3235243213 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1817143124 0 0) 0x7ff28c001470 con 0x7ff29c0b0a80 2024-08-17T02:45:54.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.049+0000 7ff299600640 1 -- 172.21.15.100:0/3235243213 >> v1:172.21.15.100:6789/0 conn(0x7ff29c0b0a80 legacy=0x7ff29c0ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.049+0000 7ff299600640 1 --2- 172.21.15.100:0/3235243213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2800039d0 0x7ff280003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.049+0000 7ff299600640 1 --2- 172.21.15.100:0/3235243213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff280004780 0x7ff280004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.049+0000 7ff299600640 1 --2- 172.21.15.100:0/3235243213 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff29c0adec0 0x7ff280005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.049+0000 7ff299600640 1 -- 172.21.15.100:0/3235243213 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c15b410 con 0x7ff2800039d0 2024-08-17T02:45:54.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.049+0000 7ff299600640 1 -- 172.21.15.100:0/3235243213 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28000b9d0 con 0x7ff280004780 2024-08-17T02:45:54.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.049+0000 7ff299600640 1 -- 172.21.15.100:0/3235243213 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28000bb10 con 0x7ff29c0adec0 2024-08-17T02:45:54.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.049+0000 7ff29aa00640 1 --2- 172.21.15.100:0/3235243213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2800039d0 0x7ff280003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.050+0000 7ff29a000640 1 --2- 172.21.15.100:0/3235243213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff280004780 0x7ff280004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.050+0000 7ff29b400640 1 --2- 172.21.15.100:0/3235243213 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff29c0adec0 0x7ff280005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.050+0000 7ff29aa00640 1 -- 172.21.15.100:0/3235243213 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff29c0adec0 msgr2=0x7ff280005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:54.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.050+0000 7ff29aa00640 1 --2- 172.21.15.100:0/3235243213 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff29c0adec0 0x7ff280005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.050+0000 7ff29aa00640 1 -- 172.21.15.100:0/3235243213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff280004780 msgr2=0x7ff280004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:54.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.050+0000 7ff29aa00640 1 --2- 172.21.15.100:0/3235243213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff280004780 0x7ff280004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.050+0000 7ff29aa00640 1 -- 172.21.15.100:0/3235243213 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2800034e0 con 0x7ff2800039d0 2024-08-17T02:45:54.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.050+0000 7ff29b400640 1 --2- 172.21.15.100:0/3235243213 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff29c0adec0 0x7ff280005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:54.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.051+0000 7ff29aa00640 1 --2- 172.21.15.100:0/3235243213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2800039d0 0x7ff280003de0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00c2d0 tx=0x7ff28c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f6a3d81d264b45 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:54.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.051+0000 7ff299600640 1 -- 172.21.15.100:0/3235243213 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c005890 con 0x7ff2800039d0 2024-08-17T02:45:54.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.051+0000 7ff299600640 1 -- 172.21.15.100:0/3235243213 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c005a30 con 0x7ff2800039d0 2024-08-17T02:45:54.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.051+0000 7ff299600640 1 -- 172.21.15.100:0/3235243213 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c005e30 con 0x7ff2800039d0 2024-08-17T02:45:54.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.052+0000 7ff2a1c00640 1 -- 172.21.15.100:0/3235243213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2800039d0 msgr2=0x7ff280003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.052+0000 7ff2a1c00640 1 --2- 172.21.15.100:0/3235243213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2800039d0 0x7ff280003de0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00c2d0 tx=0x7ff28c001e90 comp rx=0 tx=0).stop 2024-08-17T02:45:54.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.052+0000 7ff29b400640 1 -- 172.21.15.100:0/3235243213 reap_dead start 2024-08-17T02:45:54.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.052+0000 7ff2a1c00640 1 -- 172.21.15.100:0/3235243213 shutdown_connections 2024-08-17T02:45:54.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.052+0000 7ff2a1c00640 1 -- 172.21.15.100:0/3235243213 >> 172.21.15.100:0/3235243213 conn(0x7ff29c067750 msgr2=0x7ff29c0cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:54.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.052+0000 7ff2a1c00640 1 -- 172.21.15.100:0/3235243213 shutdown_connections 2024-08-17T02:45:54.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.052+0000 7ff2a1c00640 1 -- 172.21.15.100:0/3235243213 wait complete. 2024-08-17T02:45:54.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.053+0000 7ff2a1c00640 1 Processor -- start 2024-08-17T02:45:54.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.053+0000 7ff2a1c00640 1 -- start start 2024-08-17T02:45:54.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.054+0000 7ff2a1c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2800039d0 0x7ff29c06d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.054+0000 7ff2a1c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff29c0ad870 0x7ff29c13f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.054+0000 7ff2a1c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff29c0ab680 0x7ff29c14ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.054+0000 7ff2a1c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c13faf0 con 0x7ff29c0ab680 2024-08-17T02:45:54.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.054+0000 7ff2a1c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c06ce50 con 0x7ff29c0ad870 2024-08-17T02:45:54.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.054+0000 7ff2a1c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c0adcc0 con 0x7ff2800039d0 2024-08-17T02:45:54.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.054+0000 7ff29b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff29c0ab680 0x7ff29c14ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.054+0000 7ff29b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff29c0ab680 0x7ff29c14ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33390/0 (socket says 172.21.15.100:33390) 2024-08-17T02:45:54.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.054+0000 7ff29b400640 1 -- 172.21.15.100:0/1631411120 learned_addr learned my addr 172.21.15.100:0/1631411120 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:54.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.054+0000 7ff29a000640 1 --2- 172.21.15.100:0/1631411120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff29c0ad870 0x7ff29c13f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.054+0000 7ff29aa00640 1 --2- 172.21.15.100:0/1631411120 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2800039d0 0x7ff29c06d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.055+0000 7ff29b400640 1 -- 172.21.15.100:0/1631411120 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2800039d0 msgr2=0x7ff29c06d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.055+0000 7ff29b400640 1 --2- 172.21.15.100:0/1631411120 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2800039d0 0x7ff29c06d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.055+0000 7ff29b400640 1 -- 172.21.15.100:0/1631411120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff29c0ad870 msgr2=0x7ff29c13f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.055+0000 7ff29b400640 1 --2- 172.21.15.100:0/1631411120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff29c0ad870 0x7ff29c13f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.055+0000 7ff29b400640 1 -- 172.21.15.100:0/1631411120 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c0abdf0 con 0x7ff29c0ab680 2024-08-17T02:45:54.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.055+0000 7ff29aa00640 1 --2- 172.21.15.100:0/1631411120 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2800039d0 0x7ff29c06d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:54.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.055+0000 7ff29b400640 1 --2- 172.21.15.100:0/1631411120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff29c0ab680 0x7ff29c14ca40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0ae2c0 tx=0x7ff29400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:54.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.055+0000 7ff292000640 1 -- 172.21.15.100:0/1631411120 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29400e030 con 0x7ff29c0ab680 2024-08-17T02:45:54.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.055+0000 7ff292000640 1 -- 172.21.15.100:0/1631411120 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff294016680 con 0x7ff29c0ab680 2024-08-17T02:45:54.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.055+0000 7ff2a1c00640 1 -- 172.21.15.100:0/1631411120 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29c0ac0d0 con 0x7ff29c0ab680 2024-08-17T02:45:54.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.055+0000 7ff292000640 1 -- 172.21.15.100:0/1631411120 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff294016a40 con 0x7ff29c0ab680 2024-08-17T02:45:54.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.055+0000 7ff2a1c00640 1 -- 172.21.15.100:0/1631411120 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29c06cae0 con 0x7ff29c0ab680 2024-08-17T02:45:54.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.056+0000 7ff2a1c00640 1 -- 172.21.15.100:0/1631411120 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29c06cfe0 con 0x7ff29c0ab680 2024-08-17T02:45:54.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.057+0000 7ff292000640 1 -- 172.21.15.100:0/1631411120 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff294011460 con 0x7ff29c0ab680 2024-08-17T02:45:54.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.058+0000 7ff292000640 1 --2- 172.21.15.100:0/1631411120 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff27c065180 0x7ff27c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.058+0000 7ff292000640 1 -- 172.21.15.100:0/1631411120 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff29400f070 con 0x7ff29c0ab680 2024-08-17T02:45:54.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.058+0000 7ff29aa00640 1 --2- 172.21.15.100:0/1631411120 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff27c065180 0x7ff27c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.059+0000 7ff29aa00640 1 --2- 172.21.15.100:0/1631411120 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff27c065180 0x7ff27c067630 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff28c033000 tx=0x7ff28c034000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:54.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.062+0000 7ff292000640 1 -- 172.21.15.100:0/1631411120 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff294050690 con 0x7ff29c0ab680 2024-08-17T02:45:54.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.233+0000 7ff2a1c00640 1 -- 172.21.15.100:0/1631411120 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff29c064db0 con 0x7ff29c0ab680 2024-08-17T02:45:54.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.234+0000 7ff292000640 1 -- 172.21.15.100:0/1631411120 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff294053cb0 con 0x7ff29c0ab680 2024-08-17T02:45:54.234 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-08-17T02:45:54.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.235+0000 7ff2a1c00640 1 -- 172.21.15.100:0/1631411120 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff27c065180 msgr2=0x7ff27c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.235+0000 7ff2a1c00640 1 --2- 172.21.15.100:0/1631411120 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff27c065180 0x7ff27c067630 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff28c033000 tx=0x7ff28c034000 comp rx=0 tx=0).stop 2024-08-17T02:45:54.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.235+0000 7ff2a1c00640 1 -- 172.21.15.100:0/1631411120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff29c0ab680 msgr2=0x7ff29c14ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.235+0000 7ff2a1c00640 1 --2- 172.21.15.100:0/1631411120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff29c0ab680 0x7ff29c14ca40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0ae2c0 tx=0x7ff29400b040 comp rx=0 tx=0).stop 2024-08-17T02:45:54.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.236+0000 7ff2a1c00640 1 -- 172.21.15.100:0/1631411120 shutdown_connections 2024-08-17T02:45:54.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.236+0000 7ff2a1c00640 1 --2- 172.21.15.100:0/1631411120 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff27c065180 0x7ff27c067630 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.236+0000 7ff2a1c00640 1 --2- 172.21.15.100:0/1631411120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff29c0ab680 0x7ff29c14ca40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.236+0000 7ff2a1c00640 1 --2- 172.21.15.100:0/1631411120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff29c0ad870 0x7ff29c13f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.236+0000 7ff2a1c00640 1 --2- 172.21.15.100:0/1631411120 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2800039d0 0x7ff29c06d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.236+0000 7ff2a1c00640 1 -- 172.21.15.100:0/1631411120 >> 172.21.15.100:0/1631411120 conn(0x7ff29c067750 msgr2=0x7ff29c069890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:54.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.236+0000 7ff2a1c00640 1 -- 172.21.15.100:0/1631411120 shutdown_connections 2024-08-17T02:45:54.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.236+0000 7ff2a1c00640 1 -- 172.21.15.100:0/1631411120 wait complete. 2024-08-17T02:45:54.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:45:54.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.400+0000 7fd87aa00640 1 Processor -- start 2024-08-17T02:45:54.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.401+0000 7fd87aa00640 1 -- start start 2024-08-17T02:45:54.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.402+0000 7fd87aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd8740ad3e0 0x7fd87406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.402+0000 7fd87aa00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd874156e60 con 0x7fd8740abef0 2024-08-17T02:45:54.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.402+0000 7fd87aa00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8740c95e0 con 0x7fd87406d930 2024-08-17T02:45:54.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.402+0000 7fd87aa00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8740ac2c0 con 0x7fd8740ad3e0 2024-08-17T02:45:54.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.402+0000 7fd878c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd8740ad3e0 0x7fd87406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.402+0000 7fd878c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd8740ad3e0 0x7fd87406d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33400/0 (socket says 172.21.15.100:33400) 2024-08-17T02:45:54.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.402+0000 7fd878c00640 1 -- 172.21.15.100:0/2158903234 learned_addr learned my addr 172.21.15.100:0/2158903234 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:54.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.402+0000 7fd878c00640 1 -- 172.21.15.100:0/2158903234 >> v1:172.21.15.123:6789/0 conn(0x7fd87406d930 legacy=0x7fd8740c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.402+0000 7fd878c00640 1 -- 172.21.15.100:0/2158903234 >> v1:172.21.15.100:6789/0 conn(0x7fd8740abef0 legacy=0x7fd8740accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.403+0000 7fd878c00640 1 -- 172.21.15.100:0/2158903234 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87406e100 con 0x7fd8740ad3e0 2024-08-17T02:45:54.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.403+0000 7fd873e00640 1 -- 172.21.15.100:0/2158903234 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822339814 0 0) 0x7fd874156e60 con 0x7fd8740abef0 2024-08-17T02:45:54.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.403+0000 7fd878c00640 1 --2- 172.21.15.100:0/2158903234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8740ad3e0 0x7fd87406d3f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd860009910 tx=0x7fd8600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430369099dbd8495 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:54.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.404+0000 7fd873e00640 1 -- 172.21.15.100:0/2158903234 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd860032440 con 0x7fd8740ad3e0 2024-08-17T02:45:54.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.404+0000 7fd873e00640 1 -- 172.21.15.100:0/2158903234 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8600325a0 con 0x7fd8740ad3e0 2024-08-17T02:45:54.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.404+0000 7fd873e00640 1 -- 172.21.15.100:0/2158903234 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd860032940 con 0x7fd8740ad3e0 2024-08-17T02:45:54.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.404+0000 7fd87aa00640 1 -- 172.21.15.100:0/2158903234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8740ad3e0 msgr2=0x7fd87406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.404+0000 7fd87aa00640 1 --2- 172.21.15.100:0/2158903234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8740ad3e0 0x7fd87406d3f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd860009910 tx=0x7fd8600091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.404+0000 7fd87aa00640 1 -- 172.21.15.100:0/2158903234 shutdown_connections 2024-08-17T02:45:54.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.404+0000 7fd87aa00640 1 --2- 172.21.15.100:0/2158903234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8740ad3e0 0x7fd87406d3f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.404+0000 7fd87aa00640 1 -- 172.21.15.100:0/2158903234 >> 172.21.15.100:0/2158903234 conn(0x7fd874066cd0 msgr2=0x7fd8740670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:54.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.405+0000 7fd87aa00640 1 -- 172.21.15.100:0/2158903234 shutdown_connections 2024-08-17T02:45:54.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.405+0000 7fd87aa00640 1 -- 172.21.15.100:0/2158903234 wait complete. 2024-08-17T02:45:54.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.406+0000 7fd87aa00640 1 Processor -- start 2024-08-17T02:45:54.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.406+0000 7fd87aa00640 1 -- start start 2024-08-17T02:45:54.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.407+0000 7fd87aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd87406d930 0x7fd874144320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.407+0000 7fd87aa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8740abef0 0x7fd8741556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.407+0000 7fd87aa00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8740ad3e0 0x7fd874155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.407+0000 7fd87aa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd874152ff0 con 0x7fd87406d930 2024-08-17T02:45:54.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.407+0000 7fd87aa00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8740aef20 con 0x7fd8740abef0 2024-08-17T02:45:54.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.407+0000 7fd87aa00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8740afaa0 con 0x7fd8740ad3e0 2024-08-17T02:45:54.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.407+0000 7fd879600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd87406d930 0x7fd874144320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.407+0000 7fd879600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd87406d930 0x7fd874144320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33404/0 (socket says 172.21.15.100:33404) 2024-08-17T02:45:54.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.407+0000 7fd879600640 1 -- 172.21.15.100:0/436494465 learned_addr learned my addr 172.21.15.100:0/436494465 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:54.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.407+0000 7fd878c00640 1 --2- 172.21.15.100:0/436494465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8740abef0 0x7fd8741556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.407+0000 7fd87a000640 1 --2- 172.21.15.100:0/436494465 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8740ad3e0 0x7fd874155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.408+0000 7fd879600640 1 -- 172.21.15.100:0/436494465 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8740ad3e0 msgr2=0x7fd874155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.408+0000 7fd879600640 1 --2- 172.21.15.100:0/436494465 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8740ad3e0 0x7fd874155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.408+0000 7fd879600640 1 -- 172.21.15.100:0/436494465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8740abef0 msgr2=0x7fd8741556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.408+0000 7fd879600640 1 --2- 172.21.15.100:0/436494465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8740abef0 0x7fd8741556f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.408+0000 7fd879600640 1 -- 172.21.15.100:0/436494465 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd860009450 con 0x7fd87406d930 2024-08-17T02:45:54.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.408+0000 7fd879600640 1 --2- 172.21.15.100:0/436494465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd87406d930 0x7fd874144320 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd8680011e0 tx=0x7fd868007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:54.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.408+0000 7fd870c00640 1 -- 172.21.15.100:0/436494465 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd868011590 con 0x7fd87406d930 2024-08-17T02:45:54.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.408+0000 7fd870c00640 1 -- 172.21.15.100:0/436494465 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8680116f0 con 0x7fd87406d930 2024-08-17T02:45:54.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.408+0000 7fd870c00640 1 -- 172.21.15.100:0/436494465 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd868011ab0 con 0x7fd87406d930 2024-08-17T02:45:54.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.408+0000 7fd87aa00640 1 -- 172.21.15.100:0/436494465 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8740af170 con 0x7fd87406d930 2024-08-17T02:45:54.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.408+0000 7fd87aa00640 1 -- 172.21.15.100:0/436494465 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8740af730 con 0x7fd87406d930 2024-08-17T02:45:54.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.409+0000 7fd87aa00640 1 -- 172.21.15.100:0/436494465 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd874071050 con 0x7fd87406d930 2024-08-17T02:45:54.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.410+0000 7fd870c00640 1 -- 172.21.15.100:0/436494465 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd86801b3b0 con 0x7fd87406d930 2024-08-17T02:45:54.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.411+0000 7fd870c00640 1 --2- 172.21.15.100:0/436494465 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd854065150 0x7fd854067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.411+0000 7fd870c00640 1 -- 172.21.15.100:0/436494465 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd868081980 con 0x7fd87406d930 2024-08-17T02:45:54.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.411+0000 7fd878c00640 1 --2- 172.21.15.100:0/436494465 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd854065150 0x7fd854067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.412+0000 7fd878c00640 1 --2- 172.21.15.100:0/436494465 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd854065150 0x7fd854067600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd860034000 tx=0x7fd860032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:54.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.415+0000 7fd870c00640 1 -- 172.21.15.100:0/436494465 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd86804fa50 con 0x7fd87406d930 2024-08-17T02:45:54.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.586+0000 7fd87aa00640 1 -- 172.21.15.100:0/436494465 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd8741518b0 con 0x7fd87406d930 2024-08-17T02:45:54.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.586+0000 7fd870c00640 1 -- 172.21.15.100:0/436494465 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd868017020 con 0x7fd87406d930 2024-08-17T02:45:54.587 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-08-17T02:45:54.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.588+0000 7fd87aa00640 1 -- 172.21.15.100:0/436494465 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd854065150 msgr2=0x7fd854067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.588+0000 7fd87aa00640 1 --2- 172.21.15.100:0/436494465 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd854065150 0x7fd854067600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd860034000 tx=0x7fd860032000 comp rx=0 tx=0).stop 2024-08-17T02:45:54.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.588+0000 7fd87aa00640 1 -- 172.21.15.100:0/436494465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd87406d930 msgr2=0x7fd874144320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.588+0000 7fd87aa00640 1 --2- 172.21.15.100:0/436494465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd87406d930 0x7fd874144320 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd8680011e0 tx=0x7fd868007d10 comp rx=0 tx=0).stop 2024-08-17T02:45:54.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.588+0000 7fd87aa00640 1 -- 172.21.15.100:0/436494465 shutdown_connections 2024-08-17T02:45:54.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.588+0000 7fd87aa00640 1 --2- 172.21.15.100:0/436494465 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd854065150 0x7fd854067600 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.588+0000 7fd87aa00640 1 --2- 172.21.15.100:0/436494465 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8740ad3e0 0x7fd874155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.588+0000 7fd87aa00640 1 --2- 172.21.15.100:0/436494465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8740abef0 0x7fd8741556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.588+0000 7fd87aa00640 1 --2- 172.21.15.100:0/436494465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd87406d930 0x7fd874144320 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.588+0000 7fd87aa00640 1 -- 172.21.15.100:0/436494465 >> 172.21.15.100:0/436494465 conn(0x7fd874066cd0 msgr2=0x7fd8740ab2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:54.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.588+0000 7fd87aa00640 1 -- 172.21.15.100:0/436494465 shutdown_connections 2024-08-17T02:45:54.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.588+0000 7fd87aa00640 1 -- 172.21.15.100:0/436494465 wait complete. 2024-08-17T02:45:54.604 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:45:54.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.755+0000 7f62ff800640 1 Processor -- start 2024-08-17T02:45:54.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.755+0000 7f62ff800640 1 -- start start 2024-08-17T02:45:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.756+0000 7f62ff800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62f80b0f20 0x7f62f8163b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.756+0000 7f62ff800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f80afbb0 con 0x7f62f80d0890 2024-08-17T02:45:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.756+0000 7f62ff800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f80afe90 con 0x7f62f815c2f0 2024-08-17T02:45:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.756+0000 7f62ff800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f80b1e10 con 0x7f62f80b0f20 2024-08-17T02:45:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.756+0000 7f62f7e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f62f80d0890 0x7f62f80b0810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37574/0 (socket says 172.21.15.100:37574) 2024-08-17T02:45:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.756+0000 7f62f7e00640 1 -- 172.21.15.100:0/2757363227 learned_addr learned my addr 172.21.15.100:0/2757363227 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:45:54.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.757+0000 7f62fd800640 1 --2- 172.21.15.100:0/2757363227 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62f80b0f20 0x7f62f8163b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.757+0000 7f62f7400640 1 -- 172.21.15.100:0/2757363227 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068083555 0 0) 0x7f62f80afbb0 con 0x7f62f80d0890 2024-08-17T02:45:54.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.757+0000 7f62f7400640 1 -- 172.21.15.100:0/2757363227 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62e00034e0 con 0x7f62f80d0890 2024-08-17T02:45:54.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.757+0000 7f62f7400640 1 -- 172.21.15.100:0/2757363227 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104407985 0 0) 0x7f62f80afe90 con 0x7f62f815c2f0 2024-08-17T02:45:54.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.757+0000 7f62f7400640 1 -- 172.21.15.100:0/2757363227 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62f80afbb0 con 0x7f62f815c2f0 2024-08-17T02:45:54.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.757+0000 7f62fd800640 1 -- 172.21.15.100:0/2757363227 >> v1:172.21.15.123:6789/0 conn(0x7f62f815c2f0 legacy=0x7f62f80af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.757+0000 7f62fd800640 1 -- 172.21.15.100:0/2757363227 >> v1:172.21.15.100:6789/0 conn(0x7f62f80d0890 legacy=0x7f62f80b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.757+0000 7f62f7400640 1 -- 172.21.15.100:0/2757363227 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 101008128 0 0) 0x7f62e00034e0 con 0x7f62f80d0890 2024-08-17T02:45:54.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.757+0000 7f62fd800640 1 -- 172.21.15.100:0/2757363227 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f80b0170 con 0x7f62f80b0f20 2024-08-17T02:45:54.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.758+0000 7f62fd800640 1 --2- 172.21.15.100:0/2757363227 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62f80b0f20 0x7f62f8163b20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009e90 tx=0x7f62f0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1bcd6e92292b191 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:54.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.759+0000 7f62f7400640 1 -- 172.21.15.100:0/2757363227 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4001470 con 0x7f62f80b0f20 2024-08-17T02:45:54.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.759+0000 7f62f7400640 1 -- 172.21.15.100:0/2757363227 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f002d050 con 0x7f62f80b0f20 2024-08-17T02:45:54.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.759+0000 7f62f7400640 1 -- 172.21.15.100:0/2757363227 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f0031630 con 0x7f62f80b0f20 2024-08-17T02:45:54.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.759+0000 7f62ff800640 1 -- 172.21.15.100:0/2757363227 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62f80b0f20 msgr2=0x7f62f8163b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.759+0000 7f62ff800640 1 --2- 172.21.15.100:0/2757363227 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62f80b0f20 0x7f62f8163b20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009e90 tx=0x7f62f0009780 comp rx=0 tx=0).stop 2024-08-17T02:45:54.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.759+0000 7f62ff800640 1 -- 172.21.15.100:0/2757363227 shutdown_connections 2024-08-17T02:45:54.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.759+0000 7f62ff800640 1 --2- 172.21.15.100:0/2757363227 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62f80b0f20 0x7f62f8163b20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.759+0000 7f62ff800640 1 -- 172.21.15.100:0/2757363227 >> 172.21.15.100:0/2757363227 conn(0x7f62f80cfdb0 msgr2=0x7f62f80d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:54.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.759+0000 7f62ff800640 1 -- 172.21.15.100:0/2757363227 shutdown_connections 2024-08-17T02:45:54.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.759+0000 7f62ff800640 1 -- 172.21.15.100:0/2757363227 wait complete. 2024-08-17T02:45:54.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.761+0000 7f62ff800640 1 Processor -- start 2024-08-17T02:45:54.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.761+0000 7f62ff800640 1 -- start start 2024-08-17T02:45:54.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.762+0000 7f62ff800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62f80b0f20 0x7f62f8099aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.762+0000 7f62ff800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62f80d0890 0x7f62f8168e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.762+0000 7f62ff800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62f815c2f0 0x7f62f815ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.762+0000 7f62ff800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f8169e80 con 0x7f62f815c2f0 2024-08-17T02:45:54.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.762+0000 7f62ff800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f81693d0 con 0x7f62f80d0890 2024-08-17T02:45:54.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.762+0000 7f62ff800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f8155e20 con 0x7f62f80b0f20 2024-08-17T02:45:54.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.762+0000 7f62fd800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62f815c2f0 0x7f62f815ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.762+0000 7f62fce00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62f80b0f20 0x7f62f8099aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.762+0000 7f62fd800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62f815c2f0 0x7f62f815ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33406/0 (socket says 172.21.15.100:33406) 2024-08-17T02:45:54.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.762+0000 7f62fd800640 1 -- 172.21.15.100:0/2077898810 learned_addr learned my addr 172.21.15.100:0/2077898810 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:54.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.762+0000 7f62f7e00640 1 --2- 172.21.15.100:0/2077898810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62f80d0890 0x7f62f8168e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.762+0000 7f62fd800640 1 -- 172.21.15.100:0/2077898810 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62f80b0f20 msgr2=0x7f62f8099aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.762+0000 7f62fd800640 1 --2- 172.21.15.100:0/2077898810 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62f80b0f20 0x7f62f8099aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.762+0000 7f62fd800640 1 -- 172.21.15.100:0/2077898810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62f80d0890 msgr2=0x7f62f8168e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.762+0000 7f62fd800640 1 --2- 172.21.15.100:0/2077898810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62f80d0890 0x7f62f8168e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.762+0000 7f62fd800640 1 -- 172.21.15.100:0/2077898810 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f0009a20 con 0x7f62f815c2f0 2024-08-17T02:45:54.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.763+0000 7f62fd800640 1 --2- 172.21.15.100:0/2077898810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62f815c2f0 0x7f62f815ae80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009e90 tx=0x7f62f0037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:54.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.763+0000 7f62ebe00640 1 -- 172.21.15.100:0/2077898810 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f003ba70 con 0x7f62f815c2f0 2024-08-17T02:45:54.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.763+0000 7f62ebe00640 1 -- 172.21.15.100:0/2077898810 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f0040070 con 0x7f62f815c2f0 2024-08-17T02:45:54.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.763+0000 7f62ff800640 1 -- 172.21.15.100:0/2077898810 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f816c610 con 0x7f62f815c2f0 2024-08-17T02:45:54.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.763+0000 7f62ebe00640 1 -- 172.21.15.100:0/2077898810 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f003be40 con 0x7f62f815c2f0 2024-08-17T02:45:54.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.763+0000 7f62ff800640 1 -- 172.21.15.100:0/2077898810 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f8169ba0 con 0x7f62f815c2f0 2024-08-17T02:45:54.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.764+0000 7f62ff800640 1 -- 172.21.15.100:0/2077898810 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f8071050 con 0x7f62f815c2f0 2024-08-17T02:45:54.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.765+0000 7f62ebe00640 1 -- 172.21.15.100:0/2077898810 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f62f003c420 con 0x7f62f815c2f0 2024-08-17T02:45:54.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.766+0000 7f62ebe00640 1 --2- 172.21.15.100:0/2077898810 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f62d8065150 0x7f62d8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.766+0000 7f62ebe00640 1 -- 172.21.15.100:0/2077898810 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f62f0042070 con 0x7f62f815c2f0 2024-08-17T02:45:54.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.766+0000 7f62fce00640 1 --2- 172.21.15.100:0/2077898810 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f62d8065150 0x7f62d8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.767+0000 7f62fce00640 1 --2- 172.21.15.100:0/2077898810 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f62d8065150 0x7f62d8067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f62f815b9e0 tx=0x7f62ec007cc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:54.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.770+0000 7f62ebe00640 1 -- 172.21.15.100:0/2077898810 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f62f0071c90 con 0x7f62f815c2f0 2024-08-17T02:45:54.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.944+0000 7f62ff800640 1 -- 172.21.15.100:0/2077898810 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f62f80899a0 con 0x7f62f815c2f0 2024-08-17T02:45:54.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.945+0000 7f62ebe00640 1 -- 172.21.15.100:0/2077898810 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f62f00752b0 con 0x7f62f815c2f0 2024-08-17T02:45:54.945 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-08-17T02:45:54.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.947+0000 7f62ff800640 1 -- 172.21.15.100:0/2077898810 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f62d8065150 msgr2=0x7f62d8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.947+0000 7f62ff800640 1 --2- 172.21.15.100:0/2077898810 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f62d8065150 0x7f62d8067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f62f815b9e0 tx=0x7f62ec007cc0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.947+0000 7f62ff800640 1 -- 172.21.15.100:0/2077898810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62f815c2f0 msgr2=0x7f62f815ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.947+0000 7f62ff800640 1 --2- 172.21.15.100:0/2077898810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62f815c2f0 0x7f62f815ae80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009e90 tx=0x7f62f0037000 comp rx=0 tx=0).stop 2024-08-17T02:45:54.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.947+0000 7f62ff800640 1 -- 172.21.15.100:0/2077898810 shutdown_connections 2024-08-17T02:45:54.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.947+0000 7f62ff800640 1 --2- 172.21.15.100:0/2077898810 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f62d8065150 0x7f62d8067600 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.947+0000 7f62ff800640 1 --2- 172.21.15.100:0/2077898810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62f815c2f0 0x7f62f815ae80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.947+0000 7f62ff800640 1 --2- 172.21.15.100:0/2077898810 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62f80d0890 0x7f62f8168e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.947+0000 7f62ff800640 1 --2- 172.21.15.100:0/2077898810 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62f80b0f20 0x7f62f8099aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.947+0000 7f62ff800640 1 -- 172.21.15.100:0/2077898810 >> 172.21.15.100:0/2077898810 conn(0x7f62f80cfdb0 msgr2=0x7f62f8157860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:54.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.947+0000 7f62ff800640 1 -- 172.21.15.100:0/2077898810 shutdown_connections 2024-08-17T02:45:54.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:54.947+0000 7f62ff800640 1 -- 172.21.15.100:0/2077898810 wait complete. 2024-08-17T02:45:54.963 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:45:55.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.108+0000 7f1c0c200640 1 Processor -- start 2024-08-17T02:45:55.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.108+0000 7f1c0c200640 1 -- start start 2024-08-17T02:45:55.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.109+0000 7f1c0c200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1c04155180 0x7f1c040aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.110+0000 7f1c0c200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c0406e080 0x7f1c0406e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.110+0000 7f1c0c200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c040afc10 con 0x7f1c04155550 2024-08-17T02:45:55.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.110+0000 7f1c0c200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c0406ea00 con 0x7f1c04155180 2024-08-17T02:45:55.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.110+0000 7f1c0c200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c040af000 con 0x7f1c0406e080 2024-08-17T02:45:55.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.110+0000 7f1c09800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1c04155180 0x7f1c040aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.110+0000 7f1c09800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1c04155180 0x7f1c040aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33408/0 (socket says 172.21.15.100:33408) 2024-08-17T02:45:55.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.110+0000 7f1c09800640 1 -- 172.21.15.100:0/358674496 learned_addr learned my addr 172.21.15.100:0/358674496 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:55.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.110+0000 7f1c08e00640 1 --1- 172.21.15.100:0/358674496 >> v1:172.21.15.100:6789/0 conn(0x7f1c04155550 0x7f1c040ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37584/0 (socket says 172.21.15.100:37584) 2024-08-17T02:45:55.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.110+0000 7f1c09800640 1 -- 172.21.15.100:0/358674496 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c0406e080 msgr2=0x7f1c0406e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:55.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.110+0000 7f1c09800640 1 --2- 172.21.15.100:0/358674496 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c0406e080 0x7f1c0406e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.110+0000 7f1c09800640 1 -- 172.21.15.100:0/358674496 >> v1:172.21.15.100:6789/0 conn(0x7f1c04155550 legacy=0x7f1c040ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.110+0000 7f1c09800640 1 -- 172.21.15.100:0/358674496 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c040af2e0 con 0x7f1c04155180 2024-08-17T02:45:55.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.110+0000 7f1c03e00640 1 -- 172.21.15.100:0/358674496 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632335405 0 0) 0x7f1c040afc10 con 0x7f1c04155550 2024-08-17T02:45:55.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.111+0000 7f1c09800640 1 --2- 172.21.15.100:0/358674496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c04155180 0x7f1c040aea20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8009910 tx=0x7f1bf80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15532ca339e2e94a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:55.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.111+0000 7f1c03e00640 1 -- 172.21.15.100:0/358674496 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf802ae40 con 0x7f1c04155180 2024-08-17T02:45:55.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.112+0000 7f1c03e00640 1 -- 172.21.15.100:0/358674496 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf8032440 con 0x7f1c04155180 2024-08-17T02:45:55.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.112+0000 7f1c03e00640 1 -- 172.21.15.100:0/358674496 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf80327e0 con 0x7f1c04155180 2024-08-17T02:45:55.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.112+0000 7f1c0c200640 1 -- 172.21.15.100:0/358674496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c04155180 msgr2=0x7f1c040aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.112+0000 7f1c0c200640 1 --2- 172.21.15.100:0/358674496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c04155180 0x7f1c040aea20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8009910 tx=0x7f1bf80091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.112+0000 7f1c0c200640 1 -- 172.21.15.100:0/358674496 shutdown_connections 2024-08-17T02:45:55.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.112+0000 7f1c0c200640 1 --2- 172.21.15.100:0/358674496 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c0406e080 0x7f1c0406e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.112+0000 7f1c0c200640 1 --2- 172.21.15.100:0/358674496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c04155180 0x7f1c040aea20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.112+0000 7f1c0c200640 1 -- 172.21.15.100:0/358674496 >> 172.21.15.100:0/358674496 conn(0x7f1c040cb9b0 msgr2=0x7f1c040cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:55.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.112+0000 7f1c0c200640 1 -- 172.21.15.100:0/358674496 shutdown_connections 2024-08-17T02:45:55.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.112+0000 7f1c0c200640 1 -- 172.21.15.100:0/358674496 wait complete. 2024-08-17T02:45:55.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.114+0000 7f1c0c200640 1 Processor -- start 2024-08-17T02:45:55.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.114+0000 7f1c0c200640 1 -- start start 2024-08-17T02:45:55.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.114+0000 7f1c0c200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c0406e080 0x7f1c04153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.114+0000 7f1c0c200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c04155180 0x7f1c040c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.114+0000 7f1c0c200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c04155550 0x7f1c040c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.114+0000 7f1c0c200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c040c75e0 con 0x7f1c04155180 2024-08-17T02:45:55.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.114+0000 7f1c0c200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c040687b0 con 0x7f1c0406e080 2024-08-17T02:45:55.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.114+0000 7f1c0c200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c04069610 con 0x7f1c04155550 2024-08-17T02:45:55.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.115+0000 7f1c08e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c04155180 0x7f1c040c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.115+0000 7f1c08e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c04155180 0x7f1c040c6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33424/0 (socket says 172.21.15.100:33424) 2024-08-17T02:45:55.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.115+0000 7f1c08e00640 1 -- 172.21.15.100:0/1292807733 learned_addr learned my addr 172.21.15.100:0/1292807733 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:55.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.115+0000 7f1c09800640 1 --2- 172.21.15.100:0/1292807733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c0406e080 0x7f1c04153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.115+0000 7f1c0a200640 1 --2- 172.21.15.100:0/1292807733 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c04155550 0x7f1c040c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.115+0000 7f1c08e00640 1 -- 172.21.15.100:0/1292807733 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c04155550 msgr2=0x7f1c040c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.115+0000 7f1c08e00640 1 --2- 172.21.15.100:0/1292807733 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c04155550 0x7f1c040c70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.115+0000 7f1c08e00640 1 -- 172.21.15.100:0/1292807733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c0406e080 msgr2=0x7f1c04153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.115+0000 7f1c08e00640 1 --2- 172.21.15.100:0/1292807733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c0406e080 0x7f1c04153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.115+0000 7f1c08e00640 1 -- 172.21.15.100:0/1292807733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf8009450 con 0x7f1c04155180 2024-08-17T02:45:55.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.115+0000 7f1c08e00640 1 --2- 172.21.15.100:0/1292807733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c04155180 0x7f1c040c6b60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000c5e0 tx=0x7f1bf0007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:55.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.116+0000 7f1c00c00640 1 -- 172.21.15.100:0/1292807733 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0007360 con 0x7f1c04155180 2024-08-17T02:45:55.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.116+0000 7f1c00c00640 1 -- 172.21.15.100:0/1292807733 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf00074c0 con 0x7f1c04155180 2024-08-17T02:45:55.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.116+0000 7f1c00c00640 1 -- 172.21.15.100:0/1292807733 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf00049b0 con 0x7f1c04155180 2024-08-17T02:45:55.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.116+0000 7f1c0c200640 1 -- 172.21.15.100:0/1292807733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c04068a00 con 0x7f1c04155180 2024-08-17T02:45:55.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.116+0000 7f1c0c200640 1 -- 172.21.15.100:0/1292807733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c04068fc0 con 0x7f1c04155180 2024-08-17T02:45:55.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.117+0000 7f1c0c200640 1 -- 172.21.15.100:0/1292807733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c04064db0 con 0x7f1c04155180 2024-08-17T02:45:55.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.118+0000 7f1c00c00640 1 -- 172.21.15.100:0/1292807733 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1bf001c3b0 con 0x7f1c04155180 2024-08-17T02:45:55.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.118+0000 7f1c00c00640 1 --2- 172.21.15.100:0/1292807733 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1be4065150 0x7f1be4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.119+0000 7f1c00c00640 1 -- 172.21.15.100:0/1292807733 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1bf0081820 con 0x7f1c04155180 2024-08-17T02:45:55.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.119+0000 7f1c09800640 1 --2- 172.21.15.100:0/1292807733 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1be4065150 0x7f1be4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.119+0000 7f1c09800640 1 --2- 172.21.15.100:0/1292807733 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1be4065150 0x7f1be4067600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8034000 tx=0x7f1bf8032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:55.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.122+0000 7f1c00c00640 1 -- 172.21.15.100:0/1292807733 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1bf004ce40 con 0x7f1c04155180 2024-08-17T02:45:55.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.328+0000 7f1c0c200640 1 -- 172.21.15.100:0/1292807733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c04069750 con 0x7f1c04155180 2024-08-17T02:45:55.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.329+0000 7f1c00c00640 1 -- 172.21.15.100:0/1292807733 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f1bf0018070 con 0x7f1c04155180 2024-08-17T02:45:55.330 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:55.330 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3043714204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3043714204},{"type":"v1","addr":"172.21.15.100:6835","nonce":3043714204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/543049926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":543049926},{"type":"v1","addr":"172.21.15.100:6837","nonce":543049926}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2733092927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2733092927},{"type":"v1","addr":"172.21.15.123:6834","nonce":2733092927}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:45:41.237121+0000","modified":"2024-08-17T02:45:44.862501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/2872394530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2872394530},{"type":"v1","addr":"172.21.15.123:6835","nonce":2872394530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:45:55.330 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-08-17T02:45:55.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.331+0000 7f1c0c200640 1 -- 172.21.15.100:0/1292807733 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1be4065150 msgr2=0x7f1be4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.331+0000 7f1c0c200640 1 --2- 172.21.15.100:0/1292807733 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1be4065150 0x7f1be4067600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8034000 tx=0x7f1bf8032000 comp rx=0 tx=0).stop 2024-08-17T02:45:55.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.331+0000 7f1c0c200640 1 -- 172.21.15.100:0/1292807733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c04155180 msgr2=0x7f1c040c6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.331+0000 7f1c0c200640 1 --2- 172.21.15.100:0/1292807733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c04155180 0x7f1c040c6b60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000c5e0 tx=0x7f1bf0007d50 comp rx=0 tx=0).stop 2024-08-17T02:45:55.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.331+0000 7f1c0c200640 1 -- 172.21.15.100:0/1292807733 shutdown_connections 2024-08-17T02:45:55.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.331+0000 7f1c0c200640 1 --2- 172.21.15.100:0/1292807733 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1be4065150 0x7f1be4067600 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.331+0000 7f1c0c200640 1 --2- 172.21.15.100:0/1292807733 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1c04155550 0x7f1c040c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.331+0000 7f1c0c200640 1 --2- 172.21.15.100:0/1292807733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c04155180 0x7f1c040c6b60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.331+0000 7f1c0c200640 1 --2- 172.21.15.100:0/1292807733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c0406e080 0x7f1c04153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.331+0000 7f1c0c200640 1 -- 172.21.15.100:0/1292807733 >> 172.21.15.100:0/1292807733 conn(0x7f1c040cb9b0 msgr2=0x7f1c041540d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:55.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.331+0000 7f1c0c200640 1 -- 172.21.15.100:0/1292807733 shutdown_connections 2024-08-17T02:45:55.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.331+0000 7f1c0c200640 1 -- 172.21.15.100:0/1292807733 wait complete. 2024-08-17T02:45:55.346 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:45:55.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.493+0000 7f3d39000640 1 Processor -- start 2024-08-17T02:45:55.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.493+0000 7f3d39000640 1 -- start start 2024-08-17T02:45:55.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.494+0000 7f3d39000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d34159ca0 0x7f3d340ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.494+0000 7f3d39000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3d340ccca0 0x7f3d34162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.494+0000 7f3d39000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d340cadc0 con 0x7f3d340ca8a0 2024-08-17T02:45:55.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.494+0000 7f3d39000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d340cd6e0 con 0x7f3d340ccca0 2024-08-17T02:45:55.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.494+0000 7f3d39000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d340cb060 con 0x7f3d34159ca0 2024-08-17T02:45:55.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.494+0000 7f3d33e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3d340ccca0 0x7f3d34162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.494+0000 7f3d33e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3d340ccca0 0x7f3d34162860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33428/0 (socket says 172.21.15.100:33428) 2024-08-17T02:45:55.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.494+0000 7f3d33e00640 1 -- 172.21.15.100:0/4186123749 learned_addr learned my addr 172.21.15.100:0/4186123749 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:55.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.495+0000 7f3d33400640 1 --2- 172.21.15.100:0/4186123749 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d34159ca0 0x7f3d340ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.495+0000 7f3d33e00640 1 -- 172.21.15.100:0/4186123749 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d34159ca0 msgr2=0x7f3d340ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:55.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.495+0000 7f3d33e00640 1 --2- 172.21.15.100:0/4186123749 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d34159ca0 0x7f3d340ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.495+0000 7f3d33e00640 1 -- 172.21.15.100:0/4186123749 >> v1:172.21.15.123:6789/0 conn(0x7f3d340ca8a0 legacy=0x7f3d340cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.495+0000 7f3d33e00640 1 -- 172.21.15.100:0/4186123749 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d340cb300 con 0x7f3d340ccca0 2024-08-17T02:45:55.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.496+0000 7f3d33e00640 1 --2- 172.21.15.100:0/4186123749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d340ccca0 0x7f3d34162860 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009f20 tx=0x7f3d2c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57dc21278a9a2ca3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:55.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.496+0000 7f3d32000640 1 -- 172.21.15.100:0/4186123749 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c031400 con 0x7f3d340ccca0 2024-08-17T02:45:55.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.496+0000 7f3d32000640 1 -- 172.21.15.100:0/4186123749 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2c02d050 con 0x7f3d340ccca0 2024-08-17T02:45:55.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.496+0000 7f3d32000640 1 -- 172.21.15.100:0/4186123749 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c0317d0 con 0x7f3d340ccca0 2024-08-17T02:45:55.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.497+0000 7f3d39000640 1 -- 172.21.15.100:0/4186123749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d340ccca0 msgr2=0x7f3d34162860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.497+0000 7f3d39000640 1 --2- 172.21.15.100:0/4186123749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d340ccca0 0x7f3d34162860 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009f20 tx=0x7f3d2c009840 comp rx=0 tx=0).stop 2024-08-17T02:45:55.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.497+0000 7f3d39000640 1 -- 172.21.15.100:0/4186123749 shutdown_connections 2024-08-17T02:45:55.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.497+0000 7f3d39000640 1 --2- 172.21.15.100:0/4186123749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d340ccca0 0x7f3d34162860 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.497+0000 7f3d39000640 1 --2- 172.21.15.100:0/4186123749 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d34159ca0 0x7f3d340ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.497+0000 7f3d39000640 1 -- 172.21.15.100:0/4186123749 >> 172.21.15.100:0/4186123749 conn(0x7f3d34098e00 msgr2=0x7f3d3406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:55.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.497+0000 7f3d39000640 1 -- 172.21.15.100:0/4186123749 shutdown_connections 2024-08-17T02:45:55.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.497+0000 7f3d39000640 1 -- 172.21.15.100:0/4186123749 wait complete. 2024-08-17T02:45:55.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.498+0000 7f3d39000640 1 Processor -- start 2024-08-17T02:45:55.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.498+0000 7f3d39000640 1 -- start start 2024-08-17T02:45:55.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.499+0000 7f3d39000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d340ca8a0 0x7f3d340c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.499+0000 7f3d39000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d340ccca0 0x7f3d34155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.499+0000 7f3d39000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d34159ca0 0x7f3d34156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.499+0000 7f3d39000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d341566b0 con 0x7f3d34159ca0 2024-08-17T02:45:55.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.499+0000 7f3d39000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d34168a80 con 0x7f3d340ca8a0 2024-08-17T02:45:55.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.499+0000 7f3d39000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d340c45e0 con 0x7f3d340ccca0 2024-08-17T02:45:55.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.499+0000 7f3d33e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d34159ca0 0x7f3d34156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.499+0000 7f3d33e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d34159ca0 0x7f3d34156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33444/0 (socket says 172.21.15.100:33444) 2024-08-17T02:45:55.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.499+0000 7f3d33e00640 1 -- 172.21.15.100:0/2194170474 learned_addr learned my addr 172.21.15.100:0/2194170474 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:55.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.500+0000 7f3d33400640 1 --2- 172.21.15.100:0/2194170474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d340ca8a0 0x7f3d340c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.500+0000 7f3d33e00640 1 -- 172.21.15.100:0/2194170474 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d340ccca0 msgr2=0x7f3d34155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.500+0000 7f3d32a00640 1 --2- 172.21.15.100:0/2194170474 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d340ccca0 0x7f3d34155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.500+0000 7f3d33e00640 1 --2- 172.21.15.100:0/2194170474 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d340ccca0 0x7f3d34155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.500+0000 7f3d33e00640 1 -- 172.21.15.100:0/2194170474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d340ca8a0 msgr2=0x7f3d340c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.500+0000 7f3d33e00640 1 --2- 172.21.15.100:0/2194170474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d340ca8a0 0x7f3d340c60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.500+0000 7f3d33e00640 1 -- 172.21.15.100:0/2194170474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c009ae0 con 0x7f3d34159ca0 2024-08-17T02:45:55.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.500+0000 7f3d33400640 1 --2- 172.21.15.100:0/2194170474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d340ca8a0 0x7f3d340c60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:45:55.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.500+0000 7f3d32a00640 1 --2- 172.21.15.100:0/2194170474 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d340ccca0 0x7f3d34155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:45:55.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.500+0000 7f3d33e00640 1 --2- 172.21.15.100:0/2194170474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d34159ca0 0x7f3d34156170 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009f20 tx=0x7f3d2c036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:55.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.500+0000 7f3d2aa00640 1 -- 172.21.15.100:0/2194170474 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c008e50 con 0x7f3d34159ca0 2024-08-17T02:45:55.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.500+0000 7f3d2aa00640 1 -- 172.21.15.100:0/2194170474 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2c044410 con 0x7f3d34159ca0 2024-08-17T02:45:55.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.500+0000 7f3d39000640 1 -- 172.21.15.100:0/2194170474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d340c48c0 con 0x7f3d34159ca0 2024-08-17T02:45:55.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.500+0000 7f3d2aa00640 1 -- 172.21.15.100:0/2194170474 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c0447d0 con 0x7f3d34159ca0 2024-08-17T02:45:55.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.501+0000 7f3d39000640 1 -- 172.21.15.100:0/2194170474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d340c4e80 con 0x7f3d34159ca0 2024-08-17T02:45:55.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.502+0000 7f3d39000640 1 -- 172.21.15.100:0/2194170474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d340c5070 con 0x7f3d34159ca0 2024-08-17T02:45:55.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.502+0000 7f3d2aa00640 1 -- 172.21.15.100:0/2194170474 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3d2c038050 con 0x7f3d34159ca0 2024-08-17T02:45:55.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.503+0000 7f3d2aa00640 1 --2- 172.21.15.100:0/2194170474 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3d14065150 0x7f3d14067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.503+0000 7f3d2aa00640 1 -- 172.21.15.100:0/2194170474 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d2c0a3250 con 0x7f3d34159ca0 2024-08-17T02:45:55.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.503+0000 7f3d33400640 1 --2- 172.21.15.100:0/2194170474 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3d14065150 0x7f3d14067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.504+0000 7f3d33400640 1 --2- 172.21.15.100:0/2194170474 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3d14065150 0x7f3d14067600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3d24006e70 tx=0x7f3d24008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:55.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.507+0000 7f3d2aa00640 1 -- 172.21.15.100:0/2194170474 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3d2c071270 con 0x7f3d34159ca0 2024-08-17T02:45:55.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.682+0000 7f3d39000640 1 -- 172.21.15.100:0/2194170474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d34168c10 con 0x7f3d34159ca0 2024-08-17T02:45:55.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.683+0000 7f3d2aa00640 1 -- 172.21.15.100:0/2194170474 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f3d2c074890 con 0x7f3d34159ca0 2024-08-17T02:45:55.684 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:55.684 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:42.845503+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:45:39.036964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:45:40.232954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:45:55.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.685+0000 7f3d39000640 1 -- 172.21.15.100:0/2194170474 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3d14065150 msgr2=0x7f3d14067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.685+0000 7f3d39000640 1 --2- 172.21.15.100:0/2194170474 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3d14065150 0x7f3d14067600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3d24006e70 tx=0x7f3d24008040 comp rx=0 tx=0).stop 2024-08-17T02:45:55.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.685+0000 7f3d39000640 1 -- 172.21.15.100:0/2194170474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d34159ca0 msgr2=0x7f3d34156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.685+0000 7f3d39000640 1 --2- 172.21.15.100:0/2194170474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d34159ca0 0x7f3d34156170 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009f20 tx=0x7f3d2c036000 comp rx=0 tx=0).stop 2024-08-17T02:45:55.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.685+0000 7f3d39000640 1 -- 172.21.15.100:0/2194170474 shutdown_connections 2024-08-17T02:45:55.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.685+0000 7f3d39000640 1 --2- 172.21.15.100:0/2194170474 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3d14065150 0x7f3d14067600 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.685+0000 7f3d39000640 1 --2- 172.21.15.100:0/2194170474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d34159ca0 0x7f3d34156170 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.685+0000 7f3d39000640 1 --2- 172.21.15.100:0/2194170474 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d340ccca0 0x7f3d34155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.685+0000 7f3d39000640 1 --2- 172.21.15.100:0/2194170474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d340ca8a0 0x7f3d340c60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.685+0000 7f3d39000640 1 -- 172.21.15.100:0/2194170474 >> 172.21.15.100:0/2194170474 conn(0x7f3d34098e00 msgr2=0x7f3d34156d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:55.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.685+0000 7f3d39000640 1 -- 172.21.15.100:0/2194170474 shutdown_connections 2024-08-17T02:45:55.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.685+0000 7f3d39000640 1 -- 172.21.15.100:0/2194170474 wait complete. 2024-08-17T02:45:55.701 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:45:55.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.847+0000 7f5bede00640 1 Processor -- start 2024-08-17T02:45:55.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.847+0000 7f5bede00640 1 -- start start 2024-08-17T02:45:55.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.848+0000 7f5bede00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5be8158d60 0x7f5be80b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.848+0000 7f5bede00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5be815cb30 0x7f5be80b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.848+0000 7f5bede00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5be8159130 0x7f5be80c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.848+0000 7f5bede00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be80b18d0 con 0x7f5be8158d60 2024-08-17T02:45:55.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.848+0000 7f5bede00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be80b0d00 con 0x7f5be815cb30 2024-08-17T02:45:55.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.848+0000 7f5bede00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be80b0fa0 con 0x7f5be8159130 2024-08-17T02:45:55.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.848+0000 7f5be6a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5be8158d60 0x7f5be80b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.848+0000 7f5be6a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5be8158d60 0x7f5be80b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33450/0 (socket says 172.21.15.100:33450) 2024-08-17T02:45:55.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.849+0000 7f5be6a00640 1 -- 172.21.15.100:0/1395357067 learned_addr learned my addr 172.21.15.100:0/1395357067 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:55.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.849+0000 7f5be7400640 1 --2- 172.21.15.100:0/1395357067 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5be8159130 0x7f5be80c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.849+0000 7f5be6000640 1 --2- 172.21.15.100:0/1395357067 >> v2:172.21.15.123:3300/0 conn(0x7f5be815cb30 0x7f5be80b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.849+0000 7f5be6a00640 1 -- 172.21.15.100:0/1395357067 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5be8159130 msgr2=0x7f5be80c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:55.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.849+0000 7f5be6a00640 1 --2- 172.21.15.100:0/1395357067 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5be8159130 0x7f5be80c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.849+0000 7f5be6a00640 1 -- 172.21.15.100:0/1395357067 >> v2:172.21.15.123:3300/0 conn(0x7f5be815cb30 msgr2=0x7f5be80b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:55.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.849+0000 7f5be6a00640 1 --2- 172.21.15.100:0/1395357067 >> v2:172.21.15.123:3300/0 conn(0x7f5be815cb30 0x7f5be80b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.849+0000 7f5be6a00640 1 -- 172.21.15.100:0/1395357067 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be80b1280 con 0x7f5be8158d60 2024-08-17T02:45:55.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.849+0000 7f5be7400640 1 --2- 172.21.15.100:0/1395357067 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5be8159130 0x7f5be80c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:55.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.850+0000 7f5be6a00640 1 --2- 172.21.15.100:0/1395357067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be8158d60 0x7f5be80b1d60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009910 tx=0x7f5bd80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a36aa3dccecb587 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:55.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.850+0000 7f5be5600640 1 -- 172.21.15.100:0/1395357067 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd802adb0 con 0x7f5be8158d60 2024-08-17T02:45:55.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.850+0000 7f5be5600640 1 -- 172.21.15.100:0/1395357067 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd8032440 con 0x7f5be8158d60 2024-08-17T02:45:55.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.850+0000 7f5be5600640 1 -- 172.21.15.100:0/1395357067 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8032820 con 0x7f5be8158d60 2024-08-17T02:45:55.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.851+0000 7f5bede00640 1 -- 172.21.15.100:0/1395357067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be8158d60 msgr2=0x7f5be80b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.851+0000 7f5bede00640 1 --2- 172.21.15.100:0/1395357067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be8158d60 0x7f5be80b1d60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009910 tx=0x7f5bd80091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.851+0000 7f5bede00640 1 -- 172.21.15.100:0/1395357067 shutdown_connections 2024-08-17T02:45:55.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.851+0000 7f5bede00640 1 --2- 172.21.15.100:0/1395357067 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5be8159130 0x7f5be80c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.851+0000 7f5bede00640 1 --2- 172.21.15.100:0/1395357067 >> v2:172.21.15.123:3300/0 conn(0x7f5be815cb30 0x7f5be80b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.851+0000 7f5bede00640 1 --2- 172.21.15.100:0/1395357067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be8158d60 0x7f5be80b1d60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.851+0000 7f5bede00640 1 -- 172.21.15.100:0/1395357067 >> 172.21.15.100:0/1395357067 conn(0x7f5be80b3040 msgr2=0x7f5be80b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:55.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.851+0000 7f5bede00640 1 -- 172.21.15.100:0/1395357067 shutdown_connections 2024-08-17T02:45:55.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.851+0000 7f5bede00640 1 -- 172.21.15.100:0/1395357067 wait complete. 2024-08-17T02:45:55.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.852+0000 7f5bede00640 1 Processor -- start 2024-08-17T02:45:55.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.852+0000 7f5bede00640 1 -- start start 2024-08-17T02:45:55.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.853+0000 7f5bede00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5be8158d60 0x7f5be809ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.853+0000 7f5bede00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5be8159130 0x7f5be8098560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.853+0000 7f5bede00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be815cb30 0x7f5be8099da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.853+0000 7f5bede00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be8098aa0 con 0x7f5be815cb30 2024-08-17T02:45:55.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.853+0000 7f5bede00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be8098d00 con 0x7f5be8159130 2024-08-17T02:45:55.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.853+0000 7f5bede00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be8098fe0 con 0x7f5be8158d60 2024-08-17T02:45:55.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.853+0000 7f5be7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be815cb30 0x7f5be8099da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.853+0000 7f5be6000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5be8159130 0x7f5be8098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.853+0000 7f5be7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be815cb30 0x7f5be8099da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33462/0 (socket says 172.21.15.100:33462) 2024-08-17T02:45:55.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.853+0000 7f5be7400640 1 -- 172.21.15.100:0/1881180700 learned_addr learned my addr 172.21.15.100:0/1881180700 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:55.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.853+0000 7f5be6a00640 1 --2- 172.21.15.100:0/1881180700 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5be8158d60 0x7f5be809ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.854+0000 7f5be7400640 1 -- 172.21.15.100:0/1881180700 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5be8158d60 msgr2=0x7f5be809ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.854+0000 7f5be7400640 1 --2- 172.21.15.100:0/1881180700 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5be8158d60 0x7f5be809ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.854+0000 7f5be7400640 1 -- 172.21.15.100:0/1881180700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5be8159130 msgr2=0x7f5be8098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.854+0000 7f5be7400640 1 --2- 172.21.15.100:0/1881180700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5be8159130 0x7f5be8098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.854+0000 7f5be7400640 1 -- 172.21.15.100:0/1881180700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd8009450 con 0x7f5be815cb30 2024-08-17T02:45:55.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.854+0000 7f5be7400640 1 --2- 172.21.15.100:0/1881180700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be815cb30 0x7f5be8099da0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5be000d180 tx=0x7f5be0009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:55.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.854+0000 7f5bde000640 1 -- 172.21.15.100:0/1881180700 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be0015440 con 0x7f5be815cb30 2024-08-17T02:45:55.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.854+0000 7f5bde000640 1 -- 172.21.15.100:0/1881180700 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be000f040 con 0x7f5be815cb30 2024-08-17T02:45:55.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.854+0000 7f5bde000640 1 -- 172.21.15.100:0/1881180700 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be0015810 con 0x7f5be815cb30 2024-08-17T02:45:55.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.854+0000 7f5bede00640 1 -- 172.21.15.100:0/1881180700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be80992c0 con 0x7f5be815cb30 2024-08-17T02:45:55.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.854+0000 7f5bede00640 1 -- 172.21.15.100:0/1881180700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be8099880 con 0x7f5be815cb30 2024-08-17T02:45:55.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.855+0000 7f5bede00640 1 -- 172.21.15.100:0/1881180700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be8064db0 con 0x7f5be815cb30 2024-08-17T02:45:55.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.856+0000 7f5bde000640 1 -- 172.21.15.100:0/1881180700 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5be001e3b0 con 0x7f5be815cb30 2024-08-17T02:45:55.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.857+0000 7f5bde000640 1 --2- 172.21.15.100:0/1881180700 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5bc8065150 0x7f5bc8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.857+0000 7f5bde000640 1 -- 172.21.15.100:0/1881180700 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5be0082e40 con 0x7f5be815cb30 2024-08-17T02:45:55.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.857+0000 7f5be6a00640 1 --2- 172.21.15.100:0/1881180700 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5bc8065150 0x7f5bc8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.858+0000 7f5be6a00640 1 --2- 172.21.15.100:0/1881180700 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5bc8065150 0x7f5bc8067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8034000 tx=0x7f5bd8032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:55.861+0000 7f5bde000640 1 -- 172.21.15.100:0/1881180700 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5be0050f10 con 0x7f5be815cb30 2024-08-17T02:45:56.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.070+0000 7f5bede00640 1 -- 172.21.15.100:0/1881180700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5be8069af0 con 0x7f5be815cb30 2024-08-17T02:45:56.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.070+0000 7f5bde000640 1 -- 172.21.15.100:0/1881180700 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f5be0054530 con 0x7f5be815cb30 2024-08-17T02:45:56.071 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:45:56.071 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3043714204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3043714204},{"type":"v1","addr":"172.21.15.100:6835","nonce":3043714204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/543049926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":543049926},{"type":"v1","addr":"172.21.15.100:6837","nonce":543049926}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2733092927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2733092927},{"type":"v1","addr":"172.21.15.123:6834","nonce":2733092927}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:45:41.237121+0000","modified":"2024-08-17T02:45:44.862501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/2872394530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2872394530},{"type":"v1","addr":"172.21.15.123:6835","nonce":2872394530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:45:56.072 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-08-17T02:45:56.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.072+0000 7f5bede00640 1 -- 172.21.15.100:0/1881180700 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5bc8065150 msgr2=0x7f5bc8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.072+0000 7f5bede00640 1 --2- 172.21.15.100:0/1881180700 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5bc8065150 0x7f5bc8067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8034000 tx=0x7f5bd8032000 comp rx=0 tx=0).stop 2024-08-17T02:45:56.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.072+0000 7f5bede00640 1 -- 172.21.15.100:0/1881180700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be815cb30 msgr2=0x7f5be8099da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.072+0000 7f5bede00640 1 --2- 172.21.15.100:0/1881180700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be815cb30 0x7f5be8099da0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5be000d180 tx=0x7f5be0009a50 comp rx=0 tx=0).stop 2024-08-17T02:45:56.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.073+0000 7f5bede00640 1 -- 172.21.15.100:0/1881180700 shutdown_connections 2024-08-17T02:45:56.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.073+0000 7f5bede00640 1 --2- 172.21.15.100:0/1881180700 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5bc8065150 0x7f5bc8067600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.073+0000 7f5bede00640 1 --2- 172.21.15.100:0/1881180700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be815cb30 0x7f5be8099da0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.073+0000 7f5bede00640 1 --2- 172.21.15.100:0/1881180700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5be8159130 0x7f5be8098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.073+0000 7f5bede00640 1 --2- 172.21.15.100:0/1881180700 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5be8158d60 0x7f5be809ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.073+0000 7f5bede00640 1 -- 172.21.15.100:0/1881180700 >> 172.21.15.100:0/1881180700 conn(0x7f5be80b3040 msgr2=0x7f5be815d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:56.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.073+0000 7f5bede00640 1 -- 172.21.15.100:0/1881180700 shutdown_connections 2024-08-17T02:45:56.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.073+0000 7f5bede00640 1 -- 172.21.15.100:0/1881180700 wait complete. 2024-08-17T02:45:56.490 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:45:41.237121+0000', 'modified': '2024-08-17T02:45:44.862501+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.123:6835/2872394530', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6833', 'nonce': 2872394530}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 2872394530}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:45:56.491 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:45:56.491 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-08-17T02:45:56.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.638+0000 7fbc62c00640 1 Processor -- start 2024-08-17T02:45:56.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.638+0000 7fbc62c00640 1 -- start start 2024-08-17T02:45:56.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.639+0000 7fbc62c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbc5c06da20 0x7fbc5c06ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.639+0000 7fbc62c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbc5c0aa7d0 0x7fbc5c158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.639+0000 7fbc62c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc5c158dd0 0x7fbc5c0ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.639+0000 7fbc62c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5c0ac400 con 0x7fbc5c0aa7d0 2024-08-17T02:45:56.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.639+0000 7fbc62c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5c0a9a10 con 0x7fbc5c06da20 2024-08-17T02:45:56.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.639+0000 7fbc62c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0a9cf0 con 0x7fbc5c158dd0 2024-08-17T02:45:56.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.640+0000 7fbc5b400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbc5c0aa7d0 0x7fbc5c158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.640+0000 7fbc5b400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbc5c0aa7d0 0x7fbc5c158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33464/0 (socket says 172.21.15.100:33464) 2024-08-17T02:45:56.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.640+0000 7fbc5b400640 1 -- 172.21.15.100:0/2890384540 learned_addr learned my addr 172.21.15.100:0/2890384540 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:56.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.640+0000 7fbc5be00640 1 --2- 172.21.15.100:0/2890384540 >> v2:172.21.15.123:3300/0 conn(0x7fbc5c06da20 0x7fbc5c06ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.640+0000 7fbc60c00640 1 --2- 172.21.15.100:0/2890384540 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc5c158dd0 0x7fbc5c0ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.640+0000 7fbc5b400640 1 -- 172.21.15.100:0/2890384540 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc5c158dd0 msgr2=0x7fbc5c0ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:56.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.640+0000 7fbc5b400640 1 --2- 172.21.15.100:0/2890384540 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc5c158dd0 0x7fbc5c0ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.640+0000 7fbc5b400640 1 -- 172.21.15.100:0/2890384540 >> v2:172.21.15.123:3300/0 conn(0x7fbc5c06da20 msgr2=0x7fbc5c06ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:56.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.640+0000 7fbc5b400640 1 --2- 172.21.15.100:0/2890384540 >> v2:172.21.15.123:3300/0 conn(0x7fbc5c06da20 0x7fbc5c06ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.640+0000 7fbc5b400640 1 -- 172.21.15.100:0/2890384540 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5c0a9fd0 con 0x7fbc5c0aa7d0 2024-08-17T02:45:56.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.641+0000 7fbc5b400640 1 --2- 172.21.15.100:0/2890384540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc5c0aa7d0 0x7fbc5c158890 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c068280 tx=0x7fbc480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48ff4f9dbfc8b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:56.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.641+0000 7fbc5aa00640 1 -- 172.21.15.100:0/2890384540 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4802ad40 con 0x7fbc5c0aa7d0 2024-08-17T02:45:56.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.641+0000 7fbc5aa00640 1 -- 172.21.15.100:0/2890384540 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc48032440 con 0x7fbc5c0aa7d0 2024-08-17T02:45:56.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.641+0000 7fbc5aa00640 1 -- 172.21.15.100:0/2890384540 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4802aea0 con 0x7fbc5c0aa7d0 2024-08-17T02:45:56.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.642+0000 7fbc62c00640 1 -- 172.21.15.100:0/2890384540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc5c0aa7d0 msgr2=0x7fbc5c158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.642+0000 7fbc62c00640 1 --2- 172.21.15.100:0/2890384540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc5c0aa7d0 0x7fbc5c158890 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c068280 tx=0x7fbc480091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.642+0000 7fbc62c00640 1 -- 172.21.15.100:0/2890384540 shutdown_connections 2024-08-17T02:45:56.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.642+0000 7fbc62c00640 1 --2- 172.21.15.100:0/2890384540 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc5c158dd0 0x7fbc5c0ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.642+0000 7fbc62c00640 1 --2- 172.21.15.100:0/2890384540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc5c0aa7d0 0x7fbc5c158890 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.642+0000 7fbc62c00640 1 --2- 172.21.15.100:0/2890384540 >> v2:172.21.15.123:3300/0 conn(0x7fbc5c06da20 0x7fbc5c06ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.642+0000 7fbc62c00640 1 -- 172.21.15.100:0/2890384540 >> 172.21.15.100:0/2890384540 conn(0x7fbc5c0cb9b0 msgr2=0x7fbc5c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:56.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.642+0000 7fbc62c00640 1 -- 172.21.15.100:0/2890384540 shutdown_connections 2024-08-17T02:45:56.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.642+0000 7fbc62c00640 1 -- 172.21.15.100:0/2890384540 wait complete. 2024-08-17T02:45:56.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.643+0000 7fbc62c00640 1 Processor -- start 2024-08-17T02:45:56.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.643+0000 7fbc62c00640 1 -- start start 2024-08-17T02:45:56.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.644+0000 7fbc62c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc5c06da20 0x7fbc5c1410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.644+0000 7fbc62c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc5c0aa7d0 0x7fbc5c0ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.644+0000 7fbc62c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc5c158dd0 0x7fbc5c169e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.644+0000 7fbc62c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0ca750 con 0x7fbc5c0aa7d0 2024-08-17T02:45:56.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.644+0000 7fbc62c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0cb570 con 0x7fbc5c158dd0 2024-08-17T02:45:56.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.644+0000 7fbc62c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c16a370 con 0x7fbc5c06da20 2024-08-17T02:45:56.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.645+0000 7fbc5b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc5c0aa7d0 0x7fbc5c0ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.645+0000 7fbc5b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc5c0aa7d0 0x7fbc5c0ca210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33474/0 (socket says 172.21.15.100:33474) 2024-08-17T02:45:56.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.645+0000 7fbc5b400640 1 -- 172.21.15.100:0/1233093516 learned_addr learned my addr 172.21.15.100:0/1233093516 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:56.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.645+0000 7fbc5be00640 1 --2- 172.21.15.100:0/1233093516 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc5c06da20 0x7fbc5c1410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.645+0000 7fbc60c00640 1 --2- 172.21.15.100:0/1233093516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc5c158dd0 0x7fbc5c169e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.645+0000 7fbc5b400640 1 -- 172.21.15.100:0/1233093516 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc5c06da20 msgr2=0x7fbc5c1410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.645+0000 7fbc5b400640 1 --2- 172.21.15.100:0/1233093516 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc5c06da20 0x7fbc5c1410c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.645+0000 7fbc5b400640 1 -- 172.21.15.100:0/1233093516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc5c158dd0 msgr2=0x7fbc5c169e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.645+0000 7fbc5b400640 1 --2- 172.21.15.100:0/1233093516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc5c158dd0 0x7fbc5c169e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.645+0000 7fbc5b400640 1 -- 172.21.15.100:0/1233093516 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc48009450 con 0x7fbc5c0aa7d0 2024-08-17T02:45:56.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.645+0000 7fbc60c00640 1 --2- 172.21.15.100:0/1233093516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc5c158dd0 0x7fbc5c169e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:56.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.645+0000 7fbc5b400640 1 --2- 172.21.15.100:0/1233093516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc5c0aa7d0 0x7fbc5c0ca210 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009210 tx=0x7fbc48032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:56.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.645+0000 7fbc53400640 1 -- 172.21.15.100:0/1233093516 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc48032700 con 0x7fbc5c0aa7d0 2024-08-17T02:45:56.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.645+0000 7fbc53400640 1 -- 172.21.15.100:0/1233093516 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc48031a60 con 0x7fbc5c0aa7d0 2024-08-17T02:45:56.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.645+0000 7fbc53400640 1 -- 172.21.15.100:0/1233093516 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc48031e60 con 0x7fbc5c0aa7d0 2024-08-17T02:45:56.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.646+0000 7fbc62c00640 1 -- 172.21.15.100:0/1233093516 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc5c0ca960 con 0x7fbc5c0aa7d0 2024-08-17T02:45:56.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.646+0000 7fbc62c00640 1 -- 172.21.15.100:0/1233093516 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5c0caf20 con 0x7fbc5c0aa7d0 2024-08-17T02:45:56.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.647+0000 7fbc53400640 1 -- 172.21.15.100:0/1233093516 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbc48039040 con 0x7fbc5c0aa7d0 2024-08-17T02:45:56.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.648+0000 7fbc53400640 1 --2- 172.21.15.100:0/1233093516 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbc3c065150 0x7fbc3c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.648+0000 7fbc53400640 1 -- 172.21.15.100:0/1233093516 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbc480a1fd0 con 0x7fbc5c0aa7d0 2024-08-17T02:45:56.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.648+0000 7fbc5be00640 1 --2- 172.21.15.100:0/1233093516 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbc3c065150 0x7fbc3c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.649+0000 7fbc5be00640 1 --2- 172.21.15.100:0/1233093516 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbc3c065150 0x7fbc3c067600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c007ba0 tx=0x7fbc4c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:56.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.649+0000 7fbc651ac740 1 Processor -- start 2024-08-17T02:45:56.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.649+0000 7fbc651ac740 1 -- start start 2024-08-17T02:45:56.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.650+0000 7fbc651ac740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab4500c70 0x557ab4501040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.650+0000 7fbc651ac740 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x557ab44dc2e0 0x557ab451e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.650+0000 7fbc651ac740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557ab451ed50 0x557ab44d5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.650+0000 7fbc651ac740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ab4496240 con 0x557ab4500c70 2024-08-17T02:45:56.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.650+0000 7fbc651ac740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ab443f9e0 con 0x557ab451ed50 2024-08-17T02:45:56.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.650+0000 7fbc651ac740 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ab443d170 con 0x557ab44dc2e0 2024-08-17T02:45:56.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.650+0000 7fbc5be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab4500c70 0x557ab4501040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.650+0000 7fbc5be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab4500c70 0x557ab4501040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33484/0 (socket says 172.21.15.100:33484) 2024-08-17T02:45:56.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.650+0000 7fbc5be00640 1 -- 172.21.15.100:0/601044300 learned_addr learned my addr 172.21.15.100:0/601044300 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:56.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.650+0000 7fbc5be00640 1 -- 172.21.15.100:0/601044300 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x557ab44dc2e0 msgr2=0x557ab451e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:56.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.650+0000 7fbc5be00640 1 --2- 172.21.15.100:0/601044300 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x557ab44dc2e0 0x557ab451e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.650+0000 7fbc5be00640 1 -- 172.21.15.100:0/601044300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557ab451ed50 msgr2=0x557ab44d5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:56.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.650+0000 7fbc5be00640 1 --2- 172.21.15.100:0/601044300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557ab451ed50 0x557ab44d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.650+0000 7fbc5be00640 1 -- 172.21.15.100:0/601044300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ab43ec820 con 0x557ab4500c70 2024-08-17T02:45:56.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.651+0000 7fbc5be00640 1 --2- 172.21.15.100:0/601044300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab4500c70 0x557ab4501040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c007cc0 tx=0x7fbc4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62894d023e19f5e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:56.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.651+0000 7fbc47e00640 1 -- 172.21.15.100:0/601044300 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c016e90 con 0x557ab4500c70 2024-08-17T02:45:56.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.651+0000 7fbc47e00640 1 -- 172.21.15.100:0/601044300 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c01a070 con 0x557ab4500c70 2024-08-17T02:45:56.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.651+0000 7fbc47e00640 1 -- 172.21.15.100:0/601044300 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c021690 con 0x557ab4500c70 2024-08-17T02:45:56.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.651+0000 7fbc651ac740 1 -- 172.21.15.100:0/601044300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab4500c70 msgr2=0x557ab4501040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.651+0000 7fbc651ac740 1 --2- 172.21.15.100:0/601044300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab4500c70 0x557ab4501040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c007cc0 tx=0x7fbc4c017000 comp rx=0 tx=0).stop 2024-08-17T02:45:56.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.652+0000 7fbc651ac740 1 -- 172.21.15.100:0/601044300 shutdown_connections 2024-08-17T02:45:56.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.652+0000 7fbc651ac740 1 --2- 172.21.15.100:0/601044300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557ab451ed50 0x557ab44d5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.652+0000 7fbc651ac740 1 --2- 172.21.15.100:0/601044300 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x557ab44dc2e0 0x557ab451e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.652+0000 7fbc651ac740 1 --2- 172.21.15.100:0/601044300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab4500c70 0x557ab4501040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.652+0000 7fbc651ac740 1 -- 172.21.15.100:0/601044300 >> 172.21.15.100:0/601044300 conn(0x557ab4473a80 msgr2=0x557ab4522eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:56.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.652+0000 7fbc651ac740 1 -- 172.21.15.100:0/601044300 shutdown_connections 2024-08-17T02:45:56.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.652+0000 7fbc651ac740 1 -- 172.21.15.100:0/601044300 wait complete. 2024-08-17T02:45:56.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.652+0000 7fbc651ac740 1 -- start start 2024-08-17T02:45:56.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.652+0000 7fbc651ac740 1 Processor -- start 2024-08-17T02:45:56.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.653+0000 7fbc651ac740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 0x557ab44fc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.653+0000 7fbc651ac740 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x557ab4500c70 0x557ab44ff480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.653+0000 7fbc651ac740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557ab451ed50 0x557ab4521f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.653+0000 7fbc651ac740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ab4438f60 con 0x557ab44dc2e0 2024-08-17T02:45:56.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.653+0000 7fbc651ac740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ab43e1690 con 0x557ab451ed50 2024-08-17T02:45:56.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.653+0000 7fbc651ac740 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ab43e1330 con 0x557ab4500c70 2024-08-17T02:45:56.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.653+0000 7fbc651ac740 10 client.0 _ll_register_callbacks cb 0x557ab43eacc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:45:56.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.654+0000 7fbc5be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 0x557ab44fc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.654+0000 7fbc5be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 0x557ab44fc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33494/0 (socket says 172.21.15.100:33494) 2024-08-17T02:45:56.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.654+0000 7fbc5be00640 1 -- 172.21.15.100:0/380022145 learned_addr learned my addr 172.21.15.100:0/380022145 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:56.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.654+0000 7fbc60c00640 1 --2- 172.21.15.100:0/380022145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557ab451ed50 0x557ab4521f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.654+0000 7fbc5b400640 1 --2- 172.21.15.100:0/380022145 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x557ab4500c70 0x557ab44ff480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.654+0000 7fbc5be00640 1 -- 172.21.15.100:0/380022145 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x557ab4500c70 msgr2=0x557ab44ff480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:56.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.654+0000 7fbc5be00640 1 --2- 172.21.15.100:0/380022145 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x557ab4500c70 0x557ab44ff480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.654+0000 7fbc5be00640 1 -- 172.21.15.100:0/380022145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557ab451ed50 msgr2=0x557ab4521f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:56.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.654+0000 7fbc5be00640 1 --2- 172.21.15.100:0/380022145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557ab451ed50 0x557ab4521f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.654+0000 7fbc5be00640 1 -- 172.21.15.100:0/380022145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4c00e040 con 0x557ab44dc2e0 2024-08-17T02:45:56.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.654+0000 7fbc60c00640 1 --2- 172.21.15.100:0/380022145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557ab451ed50 0x557ab4521f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:56.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.654+0000 7fbc5be00640 1 --2- 172.21.15.100:0/380022145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 0x557ab44fc410 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c006e40 tx=0x7fbc4c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488850363874229b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:56.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.654+0000 7fbc44c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-08-17T02:45:56.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.655+0000 7fbc44c00640 1 -- 172.21.15.100:0/380022145 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c0145d0 con 0x557ab44dc2e0 2024-08-17T02:45:56.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.655+0000 7fbc44c00640 1 -- 172.21.15.100:0/380022145 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbc4c035af0 con 0x557ab44dc2e0 2024-08-17T02:45:56.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.655+0000 7fbc651ac740 1 -- 172.21.15.100:0/380022145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557ab446c770 con 0x557ab44dc2e0 2024-08-17T02:45:56.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.655+0000 7fbc44c00640 1 -- 172.21.15.100:0/380022145 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc4c014730 con 0x557ab44dc2e0 2024-08-17T02:45:56.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.655+0000 7fbc651ac740 10 client.4638 fetch_fsmap learned FSMap version 7 2024-08-17T02:45:56.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.655+0000 7fbc651ac740 1 -- 172.21.15.100:0/380022145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x557ab4402ab0 con 0x557ab44dc2e0 2024-08-17T02:45:56.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.655+0000 7fbc44c00640 1 -- 172.21.15.100:0/380022145 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557ab446c770 con 0x557ab44dc2e0 2024-08-17T02:45:56.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.655+0000 7fbc44c00640 1 -- 172.21.15.100:0/380022145 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbc4c014890 con 0x557ab44dc2e0 2024-08-17T02:45:56.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.655+0000 7fbc651ac740 10 client.4638 fetch_fsmap finished waiting for FSMap version 7 2024-08-17T02:45:56.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.655+0000 7fbc651ac740 10 client.4638 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-17T02:45:56.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.655+0000 7fbc651ac740 20 client.4638 populate_metadata read hostname 'smithi100' 2024-08-17T02:45:56.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.655+0000 7fbc651ac740 1 --2- 172.21.15.100:0/380022145 >> [v2:172.21.15.123:6833/2872394530,v1:172.21.15.123:6835/2872394530] conn(0x557ab44fd840 0x557ab44fdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.655+0000 7fbc651ac740 4 client.4638 mds_command: new command op to 4275 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:45:56.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.655+0000 7fbc651ac740 1 -- 172.21.15.100:0/380022145 --> [v2:172.21.15.123:6833/2872394530,v1:172.21.15.123:6835/2872394530] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557ab41403c0 con 0x557ab44fd840 2024-08-17T02:45:56.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.656+0000 7fbc5b400640 1 --2- 172.21.15.100:0/380022145 >> [v2:172.21.15.123:6833/2872394530,v1:172.21.15.123:6835/2872394530] conn(0x557ab44fd840 0x557ab44fdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.656+0000 7fbc5b400640 1 --2- 172.21.15.100:0/380022145 >> [v2:172.21.15.123:6833/2872394530,v1:172.21.15.123:6835/2872394530] conn(0x557ab44fd840 0x557ab44fdc10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b94fe363728c3cb server_cookie=c95e3117685c9656 in_seq=0 out_seq=0 2024-08-17T02:45:56.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.656+0000 7fbc44c00640 10 client.4638 ms_handle_connect on v2:172.21.15.123:6833/2872394530 2024-08-17T02:45:56.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.657+0000 7fbc44c00640 1 -- 172.21.15.100:0/380022145 <== mds.0 v2:172.21.15.123:6833/2872394530 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x557ab41403c0 con 0x557ab44fd840 2024-08-17T02:45:56.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.657+0000 7fbc44c00640 10 client.4638 handle_command_reply: tid=0 2024-08-17T02:45:56.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.657+0000 7fbc651ac740 1 client.4638 shutdown 2024-08-17T02:45:56.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.657+0000 7fbc651ac740 1 -- 172.21.15.100:0/380022145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 msgr2=0x557ab44fc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.657+0000 7fbc651ac740 1 --2- 172.21.15.100:0/380022145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 0x557ab44fc410 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c006e40 tx=0x7fbc4c021000 comp rx=0 tx=0).stop 2024-08-17T02:45:56.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.657+0000 7fbc651ac740 1 -- 172.21.15.100:0/380022145 shutdown_connections 2024-08-17T02:45:56.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.657+0000 7fbc651ac740 1 --2- 172.21.15.100:0/380022145 >> [v2:172.21.15.123:6833/2872394530,v1:172.21.15.123:6835/2872394530] conn(0x557ab44fd840 0x557ab44fdc10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.657+0000 7fbc651ac740 1 --2- 172.21.15.100:0/380022145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557ab451ed50 0x557ab4521f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.657+0000 7fbc44c00640 0 client.4638 ms_handle_reset on v2:172.21.15.123:6833/2872394530 2024-08-17T02:45:56.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.657+0000 7fbc651ac740 1 --2- 172.21.15.100:0/380022145 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x557ab4500c70 0x557ab44ff480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.657+0000 7fbc651ac740 1 --2- 172.21.15.100:0/380022145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 0x557ab44fc410 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.657+0000 7fbc651ac740 1 -- 172.21.15.100:0/380022145 >> 172.21.15.100:0/380022145 conn(0x557ab4473a80 msgr2=0x557ab4522dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:56.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.658+0000 7fbc651ac740 1 -- 172.21.15.100:0/380022145 shutdown_connections 2024-08-17T02:45:56.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.658+0000 7fbc651ac740 1 -- 172.21.15.100:0/380022145 wait complete. 2024-08-17T02:45:56.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.658+0000 7fbc651ac740 20 client.4638 trim_cache size 0 max 16384 2024-08-17T02:45:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.673+0000 7fbc651ac740 1 Processor -- start 2024-08-17T02:45:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.673+0000 7fbc651ac740 1 -- start start 2024-08-17T02:45:56.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.674+0000 7fbc651ac740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 0x557ab44fef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.674+0000 7fbc651ac740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557ab4500c70 0x557ab44ff4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.674+0000 7fbc651ac740 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x557ab451ed50 0x557ab44fa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.674+0000 7fbc651ac740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ab41b3f20 con 0x557ab44dc2e0 2024-08-17T02:45:56.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.674+0000 7fbc651ac740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ab4438100 con 0x557ab4500c70 2024-08-17T02:45:56.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.674+0000 7fbc651ac740 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ab4502360 con 0x557ab451ed50 2024-08-17T02:45:56.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.674+0000 7fbc5be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 0x557ab44fef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.674+0000 7fbc5be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 0x557ab44fef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33498/0 (socket says 172.21.15.100:33498) 2024-08-17T02:45:56.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.674+0000 7fbc5be00640 1 -- 172.21.15.100:0/3823252555 learned_addr learned my addr 172.21.15.100:0/3823252555 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:56.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.674+0000 7fbc5be00640 1 -- 172.21.15.100:0/3823252555 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x557ab451ed50 msgr2=0x557ab44fa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:56.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.674+0000 7fbc5be00640 1 --2- 172.21.15.100:0/3823252555 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x557ab451ed50 0x557ab44fa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.674+0000 7fbc5be00640 1 -- 172.21.15.100:0/3823252555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557ab4500c70 msgr2=0x557ab44ff4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:56.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.674+0000 7fbc5be00640 1 --2- 172.21.15.100:0/3823252555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557ab4500c70 0x557ab44ff4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.675+0000 7fbc5be00640 1 -- 172.21.15.100:0/3823252555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ab44751c0 con 0x557ab44dc2e0 2024-08-17T02:45:56.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.675+0000 7fbc5be00640 1 --2- 172.21.15.100:0/3823252555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 0x557ab44fef70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0217b0 tx=0x7fbc4c02d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0000fa3280853f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:56.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.675+0000 7fbc50c00640 1 -- 172.21.15.100:0/3823252555 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c035340 con 0x557ab44dc2e0 2024-08-17T02:45:56.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.675+0000 7fbc50c00640 1 -- 172.21.15.100:0/3823252555 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c041070 con 0x557ab44dc2e0 2024-08-17T02:45:56.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.675+0000 7fbc50c00640 1 -- 172.21.15.100:0/3823252555 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c007ec0 con 0x557ab44dc2e0 2024-08-17T02:45:56.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.675+0000 7fbc651ac740 1 -- 172.21.15.100:0/3823252555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 msgr2=0x557ab44fef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.675+0000 7fbc651ac740 1 --2- 172.21.15.100:0/3823252555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 0x557ab44fef70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0217b0 tx=0x7fbc4c02d070 comp rx=0 tx=0).stop 2024-08-17T02:45:56.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.676+0000 7fbc651ac740 1 -- 172.21.15.100:0/3823252555 shutdown_connections 2024-08-17T02:45:56.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.676+0000 7fbc651ac740 1 --2- 172.21.15.100:0/3823252555 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x557ab451ed50 0x557ab44fa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.676+0000 7fbc651ac740 1 --2- 172.21.15.100:0/3823252555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557ab4500c70 0x557ab44ff4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.676+0000 7fbc651ac740 1 --2- 172.21.15.100:0/3823252555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 0x557ab44fef70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.676+0000 7fbc651ac740 1 -- 172.21.15.100:0/3823252555 >> 172.21.15.100:0/3823252555 conn(0x557ab4473a80 msgr2=0x557ab4539190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:56.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.676+0000 7fbc651ac740 1 -- 172.21.15.100:0/3823252555 shutdown_connections 2024-08-17T02:45:56.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.676+0000 7fbc651ac740 1 -- 172.21.15.100:0/3823252555 wait complete. 2024-08-17T02:45:56.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.676+0000 7fbc651ac740 1 -- start start 2024-08-17T02:45:56.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.677+0000 7fbc651ac740 1 Processor -- start 2024-08-17T02:45:56.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.677+0000 7fbc651ac740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 0x557ab4508550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.677+0000 7fbc651ac740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557ab4500c70 0x557ab4586b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.677+0000 7fbc651ac740 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x557ab451ed50 0x557ab44fef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.677+0000 7fbc651ac740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ab4587760 con 0x557ab44dc2e0 2024-08-17T02:45:56.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.677+0000 7fbc651ac740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ab45080c0 con 0x557ab4500c70 2024-08-17T02:45:56.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.677+0000 7fbc651ac740 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ab4508a90 con 0x557ab451ed50 2024-08-17T02:45:56.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.677+0000 7fbc651ac740 10 client.0 _ll_register_callbacks cb 0x7fbc4c0078b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:45:56.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.678+0000 7fbc5be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 0x557ab4508550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.678+0000 7fbc5be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 0x557ab4508550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33512/0 (socket says 172.21.15.100:33512) 2024-08-17T02:45:56.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.678+0000 7fbc5be00640 1 -- 172.21.15.100:0/1709242261 learned_addr learned my addr 172.21.15.100:0/1709242261 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.678+0000 7fbc60c00640 1 --2- 172.21.15.100:0/1709242261 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x557ab451ed50 0x557ab44fef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.678+0000 7fbc5b400640 1 --2- 172.21.15.100:0/1709242261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557ab4500c70 0x557ab4586b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.678+0000 7fbc5be00640 1 -- 172.21.15.100:0/1709242261 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x557ab451ed50 msgr2=0x557ab44fef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.678+0000 7fbc5be00640 1 --2- 172.21.15.100:0/1709242261 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x557ab451ed50 0x557ab44fef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.678+0000 7fbc5be00640 1 -- 172.21.15.100:0/1709242261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557ab4500c70 msgr2=0x557ab4586b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.678+0000 7fbc5be00640 1 --2- 172.21.15.100:0/1709242261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557ab4500c70 0x557ab4586b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.678+0000 7fbc5be00640 1 -- 172.21.15.100:0/1709242261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ab4402ab0 con 0x557ab44dc2e0 2024-08-17T02:45:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.678+0000 7fbc60c00640 1 --2- 172.21.15.100:0/1709242261 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x557ab451ed50 0x557ab44fef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.678+0000 7fbc5b400640 1 --2- 172.21.15.100:0/1709242261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557ab4500c70 0x557ab4586b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.678+0000 7fbc5be00640 1 --2- 172.21.15.100:0/1709242261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 0x557ab4508550 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c018010 tx=0x7fbc4c03f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f18ab8b9ceba29d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.678+0000 7fbc44c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-08-17T02:45:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.678+0000 7fbc44c00640 1 -- 172.21.15.100:0/1709242261 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c014710 con 0x557ab44dc2e0 2024-08-17T02:45:56.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.678+0000 7fbc44c00640 1 -- 172.21.15.100:0/1709242261 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbc4c014870 con 0x557ab44dc2e0 2024-08-17T02:45:56.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.678+0000 7fbc651ac740 1 -- 172.21.15.100:0/1709242261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbc4c01a070 con 0x557ab44dc2e0 2024-08-17T02:45:56.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.679+0000 7fbc44c00640 1 -- 172.21.15.100:0/1709242261 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc4c050cc0 con 0x557ab44dc2e0 2024-08-17T02:45:56.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.679+0000 7fbc651ac740 10 client.4644 fetch_fsmap learned FSMap version 7 2024-08-17T02:45:56.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.679+0000 7fbc651ac740 1 -- 172.21.15.100:0/1709242261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x557ab4406490 con 0x557ab44dc2e0 2024-08-17T02:45:56.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.679+0000 7fbc44c00640 1 -- 172.21.15.100:0/1709242261 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c01a070 con 0x557ab44dc2e0 2024-08-17T02:45:56.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.679+0000 7fbc44c00640 1 -- 172.21.15.100:0/1709242261 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbc4c045070 con 0x557ab44dc2e0 2024-08-17T02:45:56.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.679+0000 7fbc651ac740 10 client.4644 fetch_fsmap finished waiting for FSMap version 7 2024-08-17T02:45:56.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.679+0000 7fbc651ac740 10 client.4644 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-17T02:45:56.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.679+0000 7fbc651ac740 20 client.4644 populate_metadata read hostname 'smithi100' 2024-08-17T02:45:56.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.679+0000 7fbc651ac740 1 --2- 172.21.15.100:0/1709242261 >> [v2:172.21.15.123:6833/2872394530,v1:172.21.15.123:6835/2872394530] conn(0x557ab4587090 0x557ab44ff4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.679+0000 7fbc651ac740 4 client.4644 mds_command: new command op to 4275 tid=0[{"prefix": "status"}] 2024-08-17T02:45:56.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.679+0000 7fbc651ac740 1 -- 172.21.15.100:0/1709242261 --> [v2:172.21.15.123:6833/2872394530,v1:172.21.15.123:6835/2872394530] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557ab41516c0 con 0x557ab4587090 2024-08-17T02:45:56.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.679+0000 7fbc5b400640 1 --2- 172.21.15.100:0/1709242261 >> [v2:172.21.15.123:6833/2872394530,v1:172.21.15.123:6835/2872394530] conn(0x557ab4587090 0x557ab44ff4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.680+0000 7fbc5b400640 1 --2- 172.21.15.100:0/1709242261 >> [v2:172.21.15.123:6833/2872394530,v1:172.21.15.123:6835/2872394530] conn(0x557ab4587090 0x557ab44ff4b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bb01d3b3fdf5ac2 server_cookie=5d5de092870f4837 in_seq=0 out_seq=0 2024-08-17T02:45:56.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.680+0000 7fbc44c00640 10 client.4644 ms_handle_connect on v2:172.21.15.123:6833/2872394530 2024-08-17T02:45:56.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.680+0000 7fbc44c00640 1 -- 172.21.15.100:0/1709242261 <== mds.0 v2:172.21.15.123:6833/2872394530 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x557ab41516c0 con 0x557ab4587090 2024-08-17T02:45:56.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.680+0000 7fbc44c00640 10 client.4644 handle_command_reply: tid=0 2024-08-17T02:45:56.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.680+0000 7fbc651ac740 1 client.4644 shutdown 2024-08-17T02:45:56.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.680+0000 7fbc651ac740 1 -- 172.21.15.100:0/1709242261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 msgr2=0x557ab4508550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.680+0000 7fbc651ac740 1 --2- 172.21.15.100:0/1709242261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 0x557ab4508550 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c018010 tx=0x7fbc4c03f070 comp rx=0 tx=0).stop 2024-08-17T02:45:56.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.680+0000 7fbc651ac740 1 -- 172.21.15.100:0/1709242261 shutdown_connections 2024-08-17T02:45:56.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.680+0000 7fbc651ac740 1 --2- 172.21.15.100:0/1709242261 >> [v2:172.21.15.123:6833/2872394530,v1:172.21.15.123:6835/2872394530] conn(0x557ab4587090 0x557ab44ff4b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.680+0000 7fbc651ac740 1 --2- 172.21.15.100:0/1709242261 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x557ab451ed50 0x557ab44fef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.680+0000 7fbc651ac740 1 --2- 172.21.15.100:0/1709242261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557ab4500c70 0x557ab4586b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.680+0000 7fbc44c00640 0 client.4644 ms_handle_reset on v2:172.21.15.123:6833/2872394530 2024-08-17T02:45:56.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.680+0000 7fbc651ac740 1 --2- 172.21.15.100:0/1709242261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ab44dc2e0 0x557ab4508550 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.680+0000 7fbc651ac740 1 -- 172.21.15.100:0/1709242261 >> 172.21.15.100:0/1709242261 conn(0x557ab4473a80 msgr2=0x557ab4523100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:56.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.681+0000 7fbc651ac740 1 -- 172.21.15.100:0/1709242261 shutdown_connections 2024-08-17T02:45:56.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.681+0000 7fbc651ac740 1 -- 172.21.15.100:0/1709242261 wait complete. 2024-08-17T02:45:56.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.681+0000 7fbc651ac740 20 client.4644 trim_cache size 0 max 16384 2024-08-17T02:45:56.690 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-08-17T02:45:56.690 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "9fea90ef-12b1-4f23-8013-27074825f754", 2024-08-17T02:45:56.690 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-08-17T02:45:56.690 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4275, 2024-08-17T02:45:56.690 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-08-17T02:45:56.690 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-08-17T02:45:56.690 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-08-17T02:45:56.690 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 14.834925524000001, 2024-08-17T02:45:56.690 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 7, 2024-08-17T02:45:56.690 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 22, 2024-08-17T02:45:56.690 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 22, 2024-08-17T02:45:56.690 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 22.336380639000001 2024-08-17T02:45:56.691 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-08-17T02:45:56.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.681+0000 7fbc62c00640 1 -- 172.21.15.100:0/1233093516 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbc3c065150 msgr2=0x7fbc3c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.681+0000 7fbc62c00640 1 --2- 172.21.15.100:0/1233093516 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbc3c065150 0x7fbc3c067600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c007ba0 tx=0x7fbc4c008040 comp rx=0 tx=0).stop 2024-08-17T02:45:56.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.681+0000 7fbc62c00640 1 -- 172.21.15.100:0/1233093516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc5c0aa7d0 msgr2=0x7fbc5c0ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.681+0000 7fbc62c00640 1 --2- 172.21.15.100:0/1233093516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc5c0aa7d0 0x7fbc5c0ca210 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009210 tx=0x7fbc48032000 comp rx=0 tx=0).stop 2024-08-17T02:45:56.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.681+0000 7fbc62c00640 1 -- 172.21.15.100:0/1233093516 shutdown_connections 2024-08-17T02:45:56.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.681+0000 7fbc62c00640 1 --2- 172.21.15.100:0/1233093516 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbc3c065150 0x7fbc3c067600 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.681+0000 7fbc62c00640 1 --2- 172.21.15.100:0/1233093516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc5c158dd0 0x7fbc5c169e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.681+0000 7fbc62c00640 1 --2- 172.21.15.100:0/1233093516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc5c0aa7d0 0x7fbc5c0ca210 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.681+0000 7fbc62c00640 1 --2- 172.21.15.100:0/1233093516 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc5c06da20 0x7fbc5c1410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.681+0000 7fbc62c00640 1 -- 172.21.15.100:0/1233093516 >> 172.21.15.100:0/1233093516 conn(0x7fbc5c0cb9b0 msgr2=0x7fbc5c157ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:56.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.681+0000 7fbc62c00640 1 -- 172.21.15.100:0/1233093516 shutdown_connections 2024-08-17T02:45:56.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:56.682+0000 7fbc62c00640 1 -- 172.21.15.100:0/1233093516 wait complete. 2024-08-17T02:45:56.697 INFO:teuthology.run_tasks:Running task kclient... 2024-08-17T02:45:56.721 INFO:tasks.kclient:Mounting kernel clients... 2024-08-17T02:45:56.721 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-17T02:45:56.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:45:56.722 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-08-17T02:45:56.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:45:56.758 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-08-17T02:45:56.858 INFO:teuthology.orchestra.run.smithi100.stderr:Cannot find device "ceph-brx" 2024-08-17T02:45:56.860 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:45:56.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:45:56.861 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-08-17T02:45:56.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:45:56.897 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-08-17T02:45:56.995 INFO:teuthology.orchestra.run.smithi100.stderr:Cannot find device "ceph-brx" 2024-08-17T02:45:56.998 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:45:56.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:45:56.998 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-08-17T02:45:57.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:45:57.039 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-08-17T02:45:57.144 INFO:teuthology.orchestra.run.smithi123.stderr:Cannot find device "ceph-brx" 2024-08-17T02:45:57.146 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:45:57.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:45:57.147 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-08-17T02:45:57.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:45:57.183 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-08-17T02:45:57.281 INFO:teuthology.orchestra.run.smithi123.stderr:Cannot find device "ceph-brx" 2024-08-17T02:45:57.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:45:57.284 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-08-17T02:45:57.284 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:45:57.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.430+0000 7f053b800640 1 Processor -- start 2024-08-17T02:45:57.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.430+0000 7f053b800640 1 -- start start 2024-08-17T02:45:57.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.432+0000 7f053b800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05340b1440 0x7f05340caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:57.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.432+0000 7f053b800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0534140580 0x7f05340c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:57.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.432+0000 7f053b800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05340caa80 con 0x7f05341401b0 2024-08-17T02:45:57.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.432+0000 7f053b800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05340cb450 con 0x7f0534140580 2024-08-17T02:45:57.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.432+0000 7f053b800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05340c9e70 con 0x7f05340b1440 2024-08-17T02:45:57.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.432+0000 7f0539800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0534140580 0x7f05340c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:57.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.432+0000 7f0539800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0534140580 0x7f05340c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39806/0 (socket says 172.21.15.100:39806) 2024-08-17T02:45:57.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.432+0000 7f0539800640 1 -- 172.21.15.100:0/4155097974 learned_addr learned my addr 172.21.15.100:0/4155097974 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:57.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.432+0000 7f0538e00640 1 --1- 172.21.15.100:0/4155097974 >> v1:172.21.15.123:6789/0 conn(0x7f05341401b0 0x7f05340b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.100:43756/0 (socket says 172.21.15.100:43756) 2024-08-17T02:45:57.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.432+0000 7f0533e00640 1 --2- 172.21.15.100:0/4155097974 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05340b1440 0x7f05340caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:57.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.432+0000 7f0539800640 1 -- 172.21.15.100:0/4155097974 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05340b1440 msgr2=0x7f05340caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:57.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.432+0000 7f0539800640 1 --2- 172.21.15.100:0/4155097974 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05340b1440 0x7f05340caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.432+0000 7f0539800640 1 -- 172.21.15.100:0/4155097974 >> v1:172.21.15.123:6789/0 conn(0x7f05341401b0 legacy=0x7f05340b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.432+0000 7f0539800640 1 -- 172.21.15.100:0/4155097974 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05340ca150 con 0x7f0534140580 2024-08-17T02:45:57.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.433+0000 7f0539800640 1 --2- 172.21.15.100:0/4155097974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0534140580 0x7f05340c9040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f052c009f20 tx=0x7f052c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8e971f2c8ff053 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:57.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.433+0000 7f0533400640 1 -- 172.21.15.100:0/4155097974 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c031400 con 0x7f0534140580 2024-08-17T02:45:57.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.433+0000 7f0533400640 1 -- 172.21.15.100:0/4155097974 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c02d050 con 0x7f0534140580 2024-08-17T02:45:57.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.433+0000 7f0533400640 1 -- 172.21.15.100:0/4155097974 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c0317d0 con 0x7f0534140580 2024-08-17T02:45:57.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.434+0000 7f053b800640 1 -- 172.21.15.100:0/4155097974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0534140580 msgr2=0x7f05340c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.434+0000 7f053b800640 1 --2- 172.21.15.100:0/4155097974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0534140580 0x7f05340c9040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f052c009f20 tx=0x7f052c009840 comp rx=0 tx=0).stop 2024-08-17T02:45:57.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.434+0000 7f053b800640 1 -- 172.21.15.100:0/4155097974 shutdown_connections 2024-08-17T02:45:57.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.434+0000 7f053b800640 1 --2- 172.21.15.100:0/4155097974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0534140580 0x7f05340c9040 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.434+0000 7f053b800640 1 --2- 172.21.15.100:0/4155097974 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05340b1440 0x7f05340caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.434+0000 7f053b800640 1 -- 172.21.15.100:0/4155097974 >> 172.21.15.100:0/4155097974 conn(0x7f05340cb9b0 msgr2=0x7f05340cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:57.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.434+0000 7f053b800640 1 -- 172.21.15.100:0/4155097974 shutdown_connections 2024-08-17T02:45:57.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.434+0000 7f053b800640 1 -- 172.21.15.100:0/4155097974 wait complete. 2024-08-17T02:45:57.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.435+0000 7f053b800640 1 Processor -- start 2024-08-17T02:45:57.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.436+0000 7f053b800640 1 -- start start 2024-08-17T02:45:57.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.436+0000 7f053b800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05340b1440 0x7f05340c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:57.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.436+0000 7f053b800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05341401b0 0x7f053415a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:57.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.436+0000 7f053b800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0534140580 0x7f053406d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:57.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.436+0000 7f053b800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053416c8c0 con 0x7f05341401b0 2024-08-17T02:45:57.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.436+0000 7f053b800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05340c80d0 con 0x7f0534140580 2024-08-17T02:45:57.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.436+0000 7f053b800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053416cb60 con 0x7f05340b1440 2024-08-17T02:45:57.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.437+0000 7f0533e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05341401b0 0x7f053415a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:57.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.437+0000 7f0533e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05341401b0 0x7f053415a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39816/0 (socket says 172.21.15.100:39816) 2024-08-17T02:45:57.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.437+0000 7f0533e00640 1 -- 172.21.15.100:0/3551535053 learned_addr learned my addr 172.21.15.100:0/3551535053 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:45:57.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.437+0000 7f0538e00640 1 --2- 172.21.15.100:0/3551535053 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05340b1440 0x7f05340c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:57.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.437+0000 7f0539800640 1 --2- 172.21.15.100:0/3551535053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0534140580 0x7f053406d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:57.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.437+0000 7f0533e00640 1 -- 172.21.15.100:0/3551535053 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05340b1440 msgr2=0x7f05340c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.437+0000 7f0533e00640 1 --2- 172.21.15.100:0/3551535053 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05340b1440 0x7f05340c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.437+0000 7f0533e00640 1 -- 172.21.15.100:0/3551535053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0534140580 msgr2=0x7f053406d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.437+0000 7f0533e00640 1 --2- 172.21.15.100:0/3551535053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0534140580 0x7f053406d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.437+0000 7f0533e00640 1 -- 172.21.15.100:0/3551535053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c009ae0 con 0x7f05341401b0 2024-08-17T02:45:57.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.437+0000 7f0533e00640 1 --2- 172.21.15.100:0/3551535053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05341401b0 0x7f053415a4e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f052000e900 tx=0x7f05200090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:57.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.437+0000 7f0527e00640 1 -- 172.21.15.100:0/3551535053 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052000c8e0 con 0x7f05341401b0 2024-08-17T02:45:57.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.438+0000 7f0527e00640 1 -- 172.21.15.100:0/3551535053 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052000ca40 con 0x7f05341401b0 2024-08-17T02:45:57.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.438+0000 7f053b800640 1 -- 172.21.15.100:0/3551535053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053416ce40 con 0x7f05341401b0 2024-08-17T02:45:57.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.438+0000 7f0527e00640 1 -- 172.21.15.100:0/3551535053 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052000cde0 con 0x7f05341401b0 2024-08-17T02:45:57.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.438+0000 7f053b800640 1 -- 172.21.15.100:0/3551535053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053416d400 con 0x7f05341401b0 2024-08-17T02:45:57.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.439+0000 7f053b800640 1 -- 172.21.15.100:0/3551535053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0534064db0 con 0x7f05341401b0 2024-08-17T02:45:57.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.440+0000 7f0527e00640 1 -- 172.21.15.100:0/3551535053 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0520013680 con 0x7f05341401b0 2024-08-17T02:45:57.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.440+0000 7f0527e00640 1 --2- 172.21.15.100:0/3551535053 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0514065150 0x7f0514067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:57.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.440+0000 7f0527e00640 1 -- 172.21.15.100:0/3551535053 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f05200825f0 con 0x7f05341401b0 2024-08-17T02:45:57.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.441+0000 7f0538e00640 1 --2- 172.21.15.100:0/3551535053 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0514065150 0x7f0514067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:57.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.441+0000 7f0538e00640 1 --2- 172.21.15.100:0/3551535053 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0514065150 0x7f0514067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0528007800 tx=0x7f0528007e20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:57.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.444+0000 7f0527e00640 1 -- 172.21.15.100:0/3551535053 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0520050780 con 0x7f05341401b0 2024-08-17T02:45:57.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.654+0000 7f053b800640 1 -- 172.21.15.100:0/3551535053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f05340c8350 con 0x7f05341401b0 2024-08-17T02:45:57.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.654+0000 7f0527e00640 1 -- 172.21.15.100:0/3551535053 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0520053da0 con 0x7f05341401b0 2024-08-17T02:45:57.655 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:45:57.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.656+0000 7f053b800640 1 -- 172.21.15.100:0/3551535053 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0514065150 msgr2=0x7f0514067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.656+0000 7f053b800640 1 --2- 172.21.15.100:0/3551535053 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0514065150 0x7f0514067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0528007800 tx=0x7f0528007e20 comp rx=0 tx=0).stop 2024-08-17T02:45:57.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.656+0000 7f053b800640 1 -- 172.21.15.100:0/3551535053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05341401b0 msgr2=0x7f053415a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.656+0000 7f053b800640 1 --2- 172.21.15.100:0/3551535053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05341401b0 0x7f053415a4e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f052000e900 tx=0x7f05200090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.656+0000 7f053b800640 1 -- 172.21.15.100:0/3551535053 shutdown_connections 2024-08-17T02:45:57.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.656+0000 7f053b800640 1 --2- 172.21.15.100:0/3551535053 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0514065150 0x7f0514067600 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.656+0000 7f053b800640 1 --2- 172.21.15.100:0/3551535053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0534140580 0x7f053406d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.656+0000 7f053b800640 1 --2- 172.21.15.100:0/3551535053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05341401b0 0x7f053415a4e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.656+0000 7f053b800640 1 --2- 172.21.15.100:0/3551535053 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05340b1440 0x7f05340c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.656+0000 7f053b800640 1 -- 172.21.15.100:0/3551535053 >> 172.21.15.100:0/3551535053 conn(0x7f05340cb9b0 msgr2=0x7f05340cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:57.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.657+0000 7f053b800640 1 -- 172.21.15.100:0/3551535053 shutdown_connections 2024-08-17T02:45:57.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:45:57.657+0000 7f053b800640 1 -- 172.21.15.100:0/3551535053 wait complete. 2024-08-17T02:45:57.672 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:45:57.672 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:45:57.672 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-08-17T02:45:57.672 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:45:57.672 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:45:57.672 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:45:57.672 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:45:57.672 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:45:57.672 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:45:57.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:45:57.673 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-08-17T02:45:57.708 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:45:57.708 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:45:57.709 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:45:57.709 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:45:57.709 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-08-17T02:45:57.709 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:45:57.709 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:45:57.709 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:45:57.709 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-08-17T02:45:57.709 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:45:57.709 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:45:57.709 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-08-17T02:45:57.709 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:45:57.709 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:45:57.709 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:45:57.710 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:45:57.710 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:45:57.710 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42652sec preferred_lft 42652sec 2024-08-17T02:45:57.710 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-08-17T02:45:57.710 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:45:57.711 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:45:57.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:45:57.711 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-08-17T02:45:57.711 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-08-17T02:45:57.711 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:45:57.711 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr flush dev ceph-brx 2024-08-17T02:45:57.711 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set ceph-brx up 2024-08-17T02:45:57.711 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:45:57.711 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-08-17T02:45:58.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:45:58.069 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:45:58.125 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-08-17T02:45:58.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:45:58.129 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-08-17T02:45:58.184 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-08-17T02:45:58.185 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:45:58.185 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:45:58.185 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:45:58.185 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:45:58.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:45:58.186 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-08-17T02:45:58.186 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-08-17T02:45:58.186 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:45:58.186 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:45:58.186 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:45:58.186 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-08-17T02:45:58.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:45:58.749 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-08-17T02:45:58.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:45:58.785 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-08-17T02:45:58.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:45:58.862 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-08-17T02:45:58.862 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-08-17T02:45:58.862 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:45:58.862 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-17T02:45:58.862 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-08-17T02:45:58.991 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-17T02:45:58.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:45:58.991 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-08-17T02:45:58.991 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-08-17T02:45:58.991 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-17T02:45:58.991 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:45:58.992 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-17T02:45:58.992 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-17T02:45:58.992 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-17T02:45:58.992 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-08-17T02:45:59.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:45:59.187 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-08-17T02:45:59.187 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-08-17T02:45:59.187 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-08-17T02:45:59.187 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:45:59.187 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-08-17T02:45:59.303 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:45:59.303 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:45:59.338 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:45:59.338 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:45:59.339 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:45:59.413 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:45:59.451 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:45:59.452 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:45:59.544 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:45:59.544 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:46:00.125 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:00.125 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:46:00.125 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.123:3300,172.21.15.123:3301" 2024-08-17T02:46:00.125 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with new device syntax: 0@9fea90ef-12b1-4f23-8013-27074825f754.cephfs=/ 2024-08-17T02:46:00.125 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.100:3300/172.21.15.123:3300/172.21.15.123:3301" will pass to kernel 2024-08-17T02:46:00.126 INFO:teuthology.orchestra.run.smithi100.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:46:00.126 INFO:teuthology.orchestra.run.smithi100.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:46:00.126 INFO:teuthology.orchestra.run.smithi100.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:46:00.126 INFO:teuthology.orchestra.run.smithi100.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:46:00.127 INFO:teuthology.orchestra.run.smithi100.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:46:00.129 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:46:00.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:00.130 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:46:00.187 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-08-17T02:46:00.188 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:46:00.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.334+0000 7fd6d6c00640 1 Processor -- start 2024-08-17T02:46:00.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.334+0000 7fd6d6c00640 1 -- start start 2024-08-17T02:46:00.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.336+0000 7fd6d6c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6d006da20 0x7fd6d006ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:00.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.336+0000 7fd6d6c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6d00aa7d0 0x7fd6d0158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:00.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.336+0000 7fd6d6c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d00a9a10 con 0x7fd6d0158dd0 2024-08-17T02:46:00.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.336+0000 7fd6d6c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d00ac400 con 0x7fd6d006da20 2024-08-17T02:46:00.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.336+0000 7fd6d6c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d00a9cf0 con 0x7fd6d00aa7d0 2024-08-17T02:46:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.336+0000 7fd6cfe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6d006da20 0x7fd6d006ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.336+0000 7fd6cfe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6d006da20 0x7fd6d006ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39818/0 (socket says 172.21.15.100:39818) 2024-08-17T02:46:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.336+0000 7fd6cfe00640 1 -- 172.21.15.100:0/1822321539 learned_addr learned my addr 172.21.15.100:0/1822321539 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:00.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.336+0000 7fd6c7400640 1 --2- 172.21.15.100:0/1822321539 >> v2:172.21.15.123:3300/0 conn(0x7fd6d00aa7d0 0x7fd6d0158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:00.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.337+0000 7fd6cfe00640 1 -- 172.21.15.100:0/1822321539 >> v2:172.21.15.123:3300/0 conn(0x7fd6d00aa7d0 msgr2=0x7fd6d0158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:00.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.337+0000 7fd6cfe00640 1 --2- 172.21.15.100:0/1822321539 >> v2:172.21.15.123:3300/0 conn(0x7fd6d00aa7d0 0x7fd6d0158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:00.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.337+0000 7fd6cfe00640 1 -- 172.21.15.100:0/1822321539 >> v1:172.21.15.123:6789/0 conn(0x7fd6d0158dd0 legacy=0x7fd6d00ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:00.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.337+0000 7fd6cfe00640 1 -- 172.21.15.100:0/1822321539 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d00a9fd0 con 0x7fd6d006da20 2024-08-17T02:46:00.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.337+0000 7fd6c7400640 1 --2- 172.21.15.100:0/1822321539 >> v2:172.21.15.123:3300/0 conn(0x7fd6d00aa7d0 0x7fd6d0158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:00.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.338+0000 7fd6cfe00640 1 --2- 172.21.15.100:0/1822321539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d006da20 0x7fd6d006ddf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00ccaa0 tx=0x7fd6c00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd4d987bedbc4d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:00.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.338+0000 7fd6cf400640 1 -- 172.21.15.100:0/1822321539 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c002add0 con 0x7fd6d006da20 2024-08-17T02:46:00.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.338+0000 7fd6cf400640 1 -- 172.21.15.100:0/1822321539 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c0032440 con 0x7fd6d006da20 2024-08-17T02:46:00.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.338+0000 7fd6cf400640 1 -- 172.21.15.100:0/1822321539 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0032820 con 0x7fd6d006da20 2024-08-17T02:46:00.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.338+0000 7fd6d6c00640 1 -- 172.21.15.100:0/1822321539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d006da20 msgr2=0x7fd6d006ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:00.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.338+0000 7fd6d6c00640 1 --2- 172.21.15.100:0/1822321539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d006da20 0x7fd6d006ddf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00ccaa0 tx=0x7fd6c00091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:00.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.338+0000 7fd6d6c00640 1 -- 172.21.15.100:0/1822321539 shutdown_connections 2024-08-17T02:46:00.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.339+0000 7fd6d6c00640 1 --2- 172.21.15.100:0/1822321539 >> v2:172.21.15.123:3300/0 conn(0x7fd6d00aa7d0 0x7fd6d0158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:00.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.339+0000 7fd6d6c00640 1 --2- 172.21.15.100:0/1822321539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d006da20 0x7fd6d006ddf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:00.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.339+0000 7fd6d6c00640 1 -- 172.21.15.100:0/1822321539 >> 172.21.15.100:0/1822321539 conn(0x7fd6d00cb9b0 msgr2=0x7fd6d00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:00.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.339+0000 7fd6d6c00640 1 -- 172.21.15.100:0/1822321539 shutdown_connections 2024-08-17T02:46:00.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.339+0000 7fd6d6c00640 1 -- 172.21.15.100:0/1822321539 wait complete. 2024-08-17T02:46:00.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.340+0000 7fd6d6c00640 1 Processor -- start 2024-08-17T02:46:00.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.340+0000 7fd6d6c00640 1 -- start start 2024-08-17T02:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.341+0000 7fd6d6c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6d006da20 0x7fd6d0152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.341+0000 7fd6d6c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00aa7d0 0x7fd6d00b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.341+0000 7fd6d6c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d0158dd0 0x7fd6d00b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.341+0000 7fd6d6c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d0155050 con 0x7fd6d0158dd0 2024-08-17T02:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.341+0000 7fd6d6c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d0155320 con 0x7fd6d00aa7d0 2024-08-17T02:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.341+0000 7fd6d6c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d015bd00 con 0x7fd6d006da20 2024-08-17T02:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.341+0000 7fd6d4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d0158dd0 0x7fd6d00b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:00.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.341+0000 7fd6d4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d0158dd0 0x7fd6d00b0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39820/0 (socket says 172.21.15.100:39820) 2024-08-17T02:46:00.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.341+0000 7fd6d4c00640 1 -- 172.21.15.100:0/2855737843 learned_addr learned my addr 172.21.15.100:0/2855737843 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:00.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.341+0000 7fd6c7400640 1 --2- 172.21.15.100:0/2855737843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00aa7d0 0x7fd6d00b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:00.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.341+0000 7fd6cfe00640 1 --2- 172.21.15.100:0/2855737843 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6d006da20 0x7fd6d0152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:00.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.342+0000 7fd6d4c00640 1 -- 172.21.15.100:0/2855737843 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6d006da20 msgr2=0x7fd6d0152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:00.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.342+0000 7fd6d4c00640 1 --2- 172.21.15.100:0/2855737843 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6d006da20 0x7fd6d0152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:00.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.342+0000 7fd6d4c00640 1 -- 172.21.15.100:0/2855737843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00aa7d0 msgr2=0x7fd6d00b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:00.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.342+0000 7fd6d4c00640 1 --2- 172.21.15.100:0/2855737843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00aa7d0 0x7fd6d00b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:00.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.342+0000 7fd6d4c00640 1 -- 172.21.15.100:0/2855737843 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c0009450 con 0x7fd6d0158dd0 2024-08-17T02:46:00.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.342+0000 7fd6d4c00640 1 --2- 172.21.15.100:0/2855737843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d0158dd0 0x7fd6d00b0e00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800c860 tx=0x7fd6c8001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:00.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.342+0000 7fd6c7e00640 1 -- 172.21.15.100:0/2855737843 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c800ce50 con 0x7fd6d0158dd0 2024-08-17T02:46:00.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.342+0000 7fd6c7e00640 1 -- 172.21.15.100:0/2855737843 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c800a850 con 0x7fd6d0158dd0 2024-08-17T02:46:00.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.342+0000 7fd6c7e00640 1 -- 172.21.15.100:0/2855737843 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c800ac10 con 0x7fd6d0158dd0 2024-08-17T02:46:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.342+0000 7fd6d6c00640 1 -- 172.21.15.100:0/2855737843 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d015bfe0 con 0x7fd6d0158dd0 2024-08-17T02:46:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.343+0000 7fd6d6c00640 1 -- 172.21.15.100:0/2855737843 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d0169760 con 0x7fd6d0158dd0 2024-08-17T02:46:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.343+0000 7fd6d6c00640 1 -- 172.21.15.100:0/2855737843 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d0064db0 con 0x7fd6d0158dd0 2024-08-17T02:46:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.344+0000 7fd6c7e00640 1 -- 172.21.15.100:0/2855737843 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd6c8012630 con 0x7fd6d0158dd0 2024-08-17T02:46:00.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.345+0000 7fd6c7e00640 1 --2- 172.21.15.100:0/2855737843 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd6ac065180 0x7fd6ac067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:00.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.345+0000 7fd6c7e00640 1 -- 172.21.15.100:0/2855737843 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6c8082620 con 0x7fd6d0158dd0 2024-08-17T02:46:00.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.345+0000 7fd6cfe00640 1 --2- 172.21.15.100:0/2855737843 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd6ac065180 0x7fd6ac067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:00.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.346+0000 7fd6cfe00640 1 --2- 172.21.15.100:0/2855737843 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd6ac065180 0x7fd6ac067630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0034000 tx=0x7fd6c0032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:00.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.350+0000 7fd6c7e00640 1 -- 172.21.15.100:0/2855737843 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd6c80506f0 con 0x7fd6d0158dd0 2024-08-17T02:46:00.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.559+0000 7fd6d6c00640 1 -- 172.21.15.100:0/2855737843 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd6d0070080 con 0x7fd6d0158dd0 2024-08-17T02:46:00.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.559+0000 7fd6c7e00640 1 -- 172.21.15.100:0/2855737843 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd6c8053d10 con 0x7fd6d0158dd0 2024-08-17T02:46:00.560 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:46:00.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.561+0000 7fd6d6c00640 1 -- 172.21.15.100:0/2855737843 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd6ac065180 msgr2=0x7fd6ac067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:00.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.561+0000 7fd6d6c00640 1 --2- 172.21.15.100:0/2855737843 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd6ac065180 0x7fd6ac067630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0034000 tx=0x7fd6c0032000 comp rx=0 tx=0).stop 2024-08-17T02:46:00.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.561+0000 7fd6d6c00640 1 -- 172.21.15.100:0/2855737843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d0158dd0 msgr2=0x7fd6d00b0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:00.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.561+0000 7fd6d6c00640 1 --2- 172.21.15.100:0/2855737843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d0158dd0 0x7fd6d00b0e00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800c860 tx=0x7fd6c8001690 comp rx=0 tx=0).stop 2024-08-17T02:46:00.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.561+0000 7fd6d6c00640 1 -- 172.21.15.100:0/2855737843 shutdown_connections 2024-08-17T02:46:00.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.561+0000 7fd6d6c00640 1 --2- 172.21.15.100:0/2855737843 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd6ac065180 0x7fd6ac067630 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:00.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.561+0000 7fd6d6c00640 1 --2- 172.21.15.100:0/2855737843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6d0158dd0 0x7fd6d00b0e00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:00.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.561+0000 7fd6d6c00640 1 --2- 172.21.15.100:0/2855737843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00aa7d0 0x7fd6d00b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:00.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.561+0000 7fd6d6c00640 1 --2- 172.21.15.100:0/2855737843 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6d006da20 0x7fd6d0152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:00.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.561+0000 7fd6d6c00640 1 -- 172.21.15.100:0/2855737843 >> 172.21.15.100:0/2855737843 conn(0x7fd6d00cb9b0 msgr2=0x7fd6d01544f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:00.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.561+0000 7fd6d6c00640 1 -- 172.21.15.100:0/2855737843 shutdown_connections 2024-08-17T02:46:00.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:00.561+0000 7fd6d6c00640 1 -- 172.21.15.100:0/2855737843 wait complete. 2024-08-17T02:46:00.576 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:46:00.576 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:46:00.576 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-08-17T02:46:00.576 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-17T02:46:00.576 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-17T02:46:00.577 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:46:00.577 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:46:00.577 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:46:00.577 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:46:00.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:00.577 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-08-17T02:46:00.613 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:46:00.613 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:46:00.613 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:46:00.613 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:00.613 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-08-17T02:46:00.613 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:00.613 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:00.613 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:00.613 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-08-17T02:46:00.613 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:00.614 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:00.614 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-08-17T02:46:00.614 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:00.614 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:00.614 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:46:00.614 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:00.614 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:46:00.614 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42649sec preferred_lft 42649sec 2024-08-17T02:46:00.614 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-08-17T02:46:00.614 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:00.614 INFO:teuthology.orchestra.run.smithi100.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:46:00.614 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether aa:7d:f7:28:a9:60 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:00.614 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:46:00.615 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:00.615 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::d0b6:78ff:fedc:6b3e/64 scope link 2024-08-17T02:46:00.615 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:00.615 INFO:teuthology.orchestra.run.smithi100.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:46:00.615 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether aa:7d:f7:28:a9:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:46:00.615 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::a87d:f7ff:fe28:a960/64 scope link 2024-08-17T02:46:00.615 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:00.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:00.615 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:46:00.706 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-08-17T02:46:00.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:00.710 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-08-17T02:46:00.746 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-08-17T02:46:00.746 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:46:00.746 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:46:00.746 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:46:00.746 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:46:00.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:00.747 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-08-17T02:46:00.747 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-08-17T02:46:00.747 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:46:00.747 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:46:00.747 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:46:00.747 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-08-17T02:46:00.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:00.892 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-08-17T02:46:00.926 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:46:00.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:00.927 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-08-17T02:46:01.003 INFO:teuthology.orchestra.run.smithi100.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-17T02:46:01.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:01.003 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-08-17T02:46:01.003 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-08-17T02:46:01.003 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:46:01.003 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-17T02:46:01.004 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-08-17T02:46:01.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:01.129 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:46:01.185 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:46:01.185 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:46:01.185 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:46:01.185 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:01.186 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-08-17T02:46:01.186 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:01.186 INFO:teuthology.orchestra.run.smithi100.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:46:01.186 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 9e:57:27:70:71:f6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:46:01.186 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:46:01.186 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:01.186 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::9c57:27ff:fe70:71f6/64 scope link 2024-08-17T02:46:01.186 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:01.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:01.188 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:46:01.243 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:46:01.243 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:46:01.243 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:46:01.243 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:01.243 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-08-17T02:46:01.243 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:01.244 INFO:teuthology.orchestra.run.smithi100.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:46:01.244 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 9e:57:27:70:71:f6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:46:01.244 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:46:01.244 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:01.244 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::9c57:27ff:fe70:71f6/64 scope link 2024-08-17T02:46:01.244 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:01.246 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-17T02:46:01.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:01.246 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-08-17T02:46:01.246 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-08-17T02:46:01.246 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-17T02:46:01.246 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:46:01.247 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-17T02:46:01.247 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-17T02:46:01.247 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-17T02:46:01.247 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-08-17T02:46:01.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:01.411 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-08-17T02:46:01.411 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-08-17T02:46:01.411 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.1 up 2024-08-17T02:46:01.411 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:46:01.411 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-08-17T02:46:01.525 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:46:01.525 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-17T02:46:01.560 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:46:01.560 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:46:01.561 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:46:01.635 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-08-17T02:46:01.635 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:46:01.636 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:01.757 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:01.757 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:46:01.784 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:01.785 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:46:01.785 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.123:3300,172.21.15.123:3301" 2024-08-17T02:46:01.785 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with new device syntax: 2@9fea90ef-12b1-4f23-8013-27074825f754.cephfs=/ 2024-08-17T02:46:01.785 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.100:3300/172.21.15.123:3300/172.21.15.123:3301" will pass to kernel 2024-08-17T02:46:01.785 INFO:teuthology.orchestra.run.smithi100.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-08-17T02:46:01.786 INFO:teuthology.orchestra.run.smithi100.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:46:01.786 INFO:teuthology.orchestra.run.smithi100.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:46:01.786 INFO:teuthology.orchestra.run.smithi100.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:46:01.786 INFO:teuthology.orchestra.run.smithi100.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:46:01.789 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:46:01.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:01.789 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:46:01.845 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-08-17T02:46:01.845 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:46:01.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.993+0000 7f3de4c00640 1 Processor -- start 2024-08-17T02:46:01.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.993+0000 7f3de4c00640 1 -- start start 2024-08-17T02:46:01.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.994+0000 7f3de4c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3de0159c40 0x7f3de00c8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:01.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.994+0000 7f3de4c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3de00addf0 0x7f3de0154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:01.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.994+0000 7f3de4c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de00ae6b0 con 0x7f3de00ada20 2024-08-17T02:46:01.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.994+0000 7f3de4c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de00af230 con 0x7f3de0159c40 2024-08-17T02:46:01.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.994+0000 7f3de4c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00ae900 con 0x7f3de00addf0 2024-08-17T02:46:01.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.994+0000 7f3dd6a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3de0159c40 0x7f3de00c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:01.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.994+0000 7f3dd6a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3de0159c40 0x7f3de00c8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39828/0 (socket says 172.21.15.100:39828) 2024-08-17T02:46:01.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.994+0000 7f3dd6a00640 1 -- 172.21.15.100:0/990268038 learned_addr learned my addr 172.21.15.100:0/990268038 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:01.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.994+0000 7f3ddfe00640 1 --2- 172.21.15.100:0/990268038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3de00addf0 0x7f3de0154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:01.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.995+0000 7f3dd6a00640 1 -- 172.21.15.100:0/990268038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3de00addf0 msgr2=0x7f3de0154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:01.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.995+0000 7f3dd6a00640 1 --2- 172.21.15.100:0/990268038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3de00addf0 0x7f3de0154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:01.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.995+0000 7f3dd6a00640 1 -- 172.21.15.100:0/990268038 >> v1:172.21.15.123:6789/0 conn(0x7f3de00ada20 legacy=0x7f3de00cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:01.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.995+0000 7f3dd6a00640 1 -- 172.21.15.100:0/990268038 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de00aebe0 con 0x7f3de0159c40 2024-08-17T02:46:01.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.996+0000 7f3dd6a00640 1 --2- 172.21.15.100:0/990268038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3de0159c40 0x7f3de00c8060 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009f20 tx=0x7f3dc8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d8742c7406af4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:01.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.996+0000 7f3ddea00640 1 -- 172.21.15.100:0/990268038 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8031400 con 0x7f3de0159c40 2024-08-17T02:46:01.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.996+0000 7f3ddea00640 1 -- 172.21.15.100:0/990268038 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc802d050 con 0x7f3de0159c40 2024-08-17T02:46:01.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.996+0000 7f3ddea00640 1 -- 172.21.15.100:0/990268038 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc80317d0 con 0x7f3de0159c40 2024-08-17T02:46:01.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.997+0000 7f3de4c00640 1 -- 172.21.15.100:0/990268038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3de0159c40 msgr2=0x7f3de00c8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:01.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.997+0000 7f3de4c00640 1 --2- 172.21.15.100:0/990268038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3de0159c40 0x7f3de00c8060 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009f20 tx=0x7f3dc8009840 comp rx=0 tx=0).stop 2024-08-17T02:46:01.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.997+0000 7f3de4c00640 1 -- 172.21.15.100:0/990268038 shutdown_connections 2024-08-17T02:46:01.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.997+0000 7f3de4c00640 1 --2- 172.21.15.100:0/990268038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3de00addf0 0x7f3de0154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:01.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.997+0000 7f3de4c00640 1 --2- 172.21.15.100:0/990268038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3de0159c40 0x7f3de00c8060 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:01.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.997+0000 7f3de4c00640 1 -- 172.21.15.100:0/990268038 >> 172.21.15.100:0/990268038 conn(0x7f3de0067750 msgr2=0x7f3de00cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:01.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.997+0000 7f3de4c00640 1 -- 172.21.15.100:0/990268038 shutdown_connections 2024-08-17T02:46:01.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.997+0000 7f3de4c00640 1 -- 172.21.15.100:0/990268038 wait complete. 2024-08-17T02:46:01.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.998+0000 7f3de4c00640 1 Processor -- start 2024-08-17T02:46:01.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.998+0000 7f3de4c00640 1 -- start start 2024-08-17T02:46:02.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.999+0000 7f3de4c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3de00ada20 0x7f3de0139750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.999+0000 7f3de4c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3de00addf0 0x7f3de0068540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.999+0000 7f3de4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3de0159c40 0x7f3de0068a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.999+0000 7f3de4c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00a93a0 con 0x7f3de0159c40 2024-08-17T02:46:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.999+0000 7f3de4c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00a8790 con 0x7f3de00ada20 2024-08-17T02:46:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.999+0000 7f3de4c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00a8a70 con 0x7f3de00addf0 2024-08-17T02:46:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.999+0000 7f3ddfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3de0159c40 0x7f3de0068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.999+0000 7f3ddfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3de0159c40 0x7f3de0068a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39844/0 (socket says 172.21.15.100:39844) 2024-08-17T02:46:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.999+0000 7f3ddfe00640 1 -- 172.21.15.100:0/2864654932 learned_addr learned my addr 172.21.15.100:0/2864654932 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.999+0000 7f3dd6a00640 1 --2- 172.21.15.100:0/2864654932 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3de00addf0 0x7f3de0068540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:01.999+0000 7f3ddf400640 1 --2- 172.21.15.100:0/2864654932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3de00ada20 0x7f3de0139750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.000+0000 7f3ddfe00640 1 -- 172.21.15.100:0/2864654932 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3de00addf0 msgr2=0x7f3de0068540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.000+0000 7f3ddfe00640 1 --2- 172.21.15.100:0/2864654932 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3de00addf0 0x7f3de0068540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.000+0000 7f3ddfe00640 1 -- 172.21.15.100:0/2864654932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3de00ada20 msgr2=0x7f3de0139750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.000+0000 7f3ddfe00640 1 --2- 172.21.15.100:0/2864654932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3de00ada20 0x7f3de0139750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.000+0000 7f3ddfe00640 1 -- 172.21.15.100:0/2864654932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc8009ae0 con 0x7f3de0159c40 2024-08-17T02:46:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.000+0000 7f3ddfe00640 1 --2- 172.21.15.100:0/2864654932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3de0159c40 0x7f3de0068a80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800e9a0 tx=0x7f3dd800a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.000+0000 7f3dd7400640 1 -- 172.21.15.100:0/2864654932 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd800a720 con 0x7f3de0159c40 2024-08-17T02:46:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.000+0000 7f3dd7400640 1 -- 172.21.15.100:0/2864654932 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd800ca40 con 0x7f3de0159c40 2024-08-17T02:46:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.000+0000 7f3dd7400640 1 -- 172.21.15.100:0/2864654932 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd800ce20 con 0x7f3de0159c40 2024-08-17T02:46:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.000+0000 7f3de4c00640 1 -- 172.21.15.100:0/2864654932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de00a8d50 con 0x7f3de0159c40 2024-08-17T02:46:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.001+0000 7f3de4c00640 1 -- 172.21.15.100:0/2864654932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de0139c90 con 0x7f3de0159c40 2024-08-17T02:46:02.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.002+0000 7f3de4c00640 1 -- 172.21.15.100:0/2864654932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de00a9510 con 0x7f3de0159c40 2024-08-17T02:46:02.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.003+0000 7f3dd7400640 1 -- 172.21.15.100:0/2864654932 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3dd80113f0 con 0x7f3de0159c40 2024-08-17T02:46:02.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.003+0000 7f3dd7400640 1 --2- 172.21.15.100:0/2864654932 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3dbc065150 0x7f3dbc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:02.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.003+0000 7f3dd7400640 1 -- 172.21.15.100:0/2864654932 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3dd8015030 con 0x7f3de0159c40 2024-08-17T02:46:02.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.004+0000 7f3ddf400640 1 --2- 172.21.15.100:0/2864654932 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3dbc065150 0x7f3dbc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:02.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.004+0000 7f3ddf400640 1 --2- 172.21.15.100:0/2864654932 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3dbc065150 0x7f3dbc067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0007fd0 tx=0x7f3dd0007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:02.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.007+0000 7f3dd7400640 1 -- 172.21.15.100:0/2864654932 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3dd80502a0 con 0x7f3de0159c40 2024-08-17T02:46:02.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.219+0000 7f3de4c00640 1 -- 172.21.15.100:0/2864654932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3de0071050 con 0x7f3de0159c40 2024-08-17T02:46:02.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.219+0000 7f3dd7400640 1 -- 172.21.15.100:0/2864654932 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3dd80538c0 con 0x7f3de0159c40 2024-08-17T02:46:02.220 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:46:02.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.221+0000 7f3de4c00640 1 -- 172.21.15.100:0/2864654932 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3dbc065150 msgr2=0x7f3dbc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:02.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.221+0000 7f3de4c00640 1 --2- 172.21.15.100:0/2864654932 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3dbc065150 0x7f3dbc067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0007fd0 tx=0x7f3dd0007e30 comp rx=0 tx=0).stop 2024-08-17T02:46:02.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.221+0000 7f3de4c00640 1 -- 172.21.15.100:0/2864654932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3de0159c40 msgr2=0x7f3de0068a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:02.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.221+0000 7f3de4c00640 1 --2- 172.21.15.100:0/2864654932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3de0159c40 0x7f3de0068a80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800e9a0 tx=0x7f3dd800a2b0 comp rx=0 tx=0).stop 2024-08-17T02:46:02.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.221+0000 7f3de4c00640 1 -- 172.21.15.100:0/2864654932 shutdown_connections 2024-08-17T02:46:02.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.221+0000 7f3de4c00640 1 --2- 172.21.15.100:0/2864654932 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3dbc065150 0x7f3dbc067600 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:02.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.221+0000 7f3de4c00640 1 --2- 172.21.15.100:0/2864654932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3de0159c40 0x7f3de0068a80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:02.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.221+0000 7f3de4c00640 1 --2- 172.21.15.100:0/2864654932 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3de00addf0 0x7f3de0068540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:02.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.221+0000 7f3de4c00640 1 --2- 172.21.15.100:0/2864654932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3de00ada20 0x7f3de0139750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:02.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.221+0000 7f3de4c00640 1 -- 172.21.15.100:0/2864654932 >> 172.21.15.100:0/2864654932 conn(0x7f3de0067750 msgr2=0x7f3de00ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:02.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.222+0000 7f3de4c00640 1 -- 172.21.15.100:0/2864654932 shutdown_connections 2024-08-17T02:46:02.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:02.222+0000 7f3de4c00640 1 -- 172.21.15.100:0/2864654932 wait complete. 2024-08-17T02:46:02.237 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:46:02.237 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:46:02.237 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-08-17T02:46:02.237 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:46:02.237 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:46:02.237 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:46:02.237 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:46:02.238 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:46:02.238 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:46:02.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:02.238 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-08-17T02:46:02.279 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:46:02.279 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:46:02.279 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:46:02.279 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:02.280 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-08-17T02:46:02.280 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:02.280 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:02.280 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:02.280 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-08-17T02:46:02.280 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:02.280 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:02.281 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-08-17T02:46:02.281 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:02.281 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:02.281 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:46:02.281 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:02.281 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:46:02.281 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42674sec preferred_lft 42674sec 2024-08-17T02:46:02.281 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2024-08-17T02:46:02.281 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:02.281 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:46:02.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:02.282 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-08-17T02:46:02.282 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-08-17T02:46:02.282 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:46:02.282 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr flush dev ceph-brx 2024-08-17T02:46:02.282 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set ceph-brx up 2024-08-17T02:46:02.282 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:46:02.282 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-08-17T02:46:02.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:02.659 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:46:02.714 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-08-17T02:46:02.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:02.717 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-08-17T02:46:02.770 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-08-17T02:46:02.771 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:46:02.771 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:46:02.771 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:46:02.771 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:46:02.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:02.771 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-08-17T02:46:02.771 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-08-17T02:46:02.772 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:46:02.772 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:46:02.772 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:46:02.772 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-08-17T02:46:03.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:03.303 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-08-17T02:46:03.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:03.339 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2024-08-17T02:46:03.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:03.416 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-08-17T02:46:03.416 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-08-17T02:46:03.416 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:46:03.416 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-17T02:46:03.416 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-08-17T02:46:03.542 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-17T02:46:03.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:03.543 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-08-17T02:46:03.543 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-08-17T02:46:03.543 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-17T02:46:03.543 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:46:03.543 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-17T02:46:03.543 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-17T02:46:03.543 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-17T02:46:03.543 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-08-17T02:46:03.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:03.729 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-08-17T02:46:03.729 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-08-17T02:46:03.729 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-08-17T02:46:03.729 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:46:03.729 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-08-17T02:46:03.844 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:46:03.844 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:46:03.880 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:46:03.880 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:46:03.880 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:46:03.954 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:46:03.955 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:46:03.955 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:04.096 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:04.096 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:46:04.838 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:04.842 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:46:04.842 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.123:3300,172.21.15.123:3301" 2024-08-17T02:46:04.842 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with new device syntax: 1@9fea90ef-12b1-4f23-8013-27074825f754.cephfs=/ 2024-08-17T02:46:04.842 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.100:3300/172.21.15.123:3300/172.21.15.123:3301" will pass to kernel 2024-08-17T02:46:04.843 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:46:04.843 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:46:04.843 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:46:04.843 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:46:04.843 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:46:04.844 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:46:04.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:04.844 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:46:04.905 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-08-17T02:46:04.905 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:46:05.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.064+0000 7f40c8200640 1 Processor -- start 2024-08-17T02:46:05.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.064+0000 7f40c8200640 1 -- start start 2024-08-17T02:46:05.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.065+0000 7f40c8200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f40c0158f80 0x7f40c00ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:05.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.065+0000 7f40c8200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c00cb560 con 0x7f40c00cf280 2024-08-17T02:46:05.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.065+0000 7f40c8200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c00ce6e0 con 0x7f40c0159350 2024-08-17T02:46:05.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.065+0000 7f40c8200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c00cf7e0 con 0x7f40c0158f80 2024-08-17T02:46:05.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.066+0000 7f40c5800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f40c0158f80 0x7f40c00ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:05.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.065+0000 7f40c6200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f40c00cf280 0x7f40c00cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39644/0 (socket says 172.21.15.100:39644) 2024-08-17T02:46:05.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.066+0000 7f40c6200640 1 -- 172.21.15.100:0/2787950508 learned_addr learned my addr 172.21.15.100:0/2787950508 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:05.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.066+0000 7f40c5800640 1 -- 172.21.15.100:0/2787950508 >> v1:172.21.15.123:6789/0 conn(0x7f40c0159350 legacy=0x7f40c00cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:05.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.066+0000 7f40c5800640 1 -- 172.21.15.100:0/2787950508 >> v1:172.21.15.100:6789/0 conn(0x7f40c00cf280 legacy=0x7f40c00cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:05.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.066+0000 7f40c5800640 1 -- 172.21.15.100:0/2787950508 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c00cfac0 con 0x7f40c0158f80 2024-08-17T02:46:05.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.067+0000 7f40c5800640 1 --2- 172.21.15.100:0/2787950508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40c0158f80 0x7f40c00ca330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009e60 tx=0x7f40b4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9dd47f9d5ce360c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:05.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.067+0000 7f40bfe00640 1 -- 172.21.15.100:0/2787950508 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4007550 con 0x7f40c0158f80 2024-08-17T02:46:05.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.067+0000 7f40bfe00640 1 -- 172.21.15.100:0/2787950508 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b402d050 con 0x7f40c0158f80 2024-08-17T02:46:05.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.067+0000 7f40bfe00640 1 -- 172.21.15.100:0/2787950508 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4007900 con 0x7f40c0158f80 2024-08-17T02:46:05.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.068+0000 7f40c8200640 1 -- 172.21.15.100:0/2787950508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40c0158f80 msgr2=0x7f40c00ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:05.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.068+0000 7f40c8200640 1 --2- 172.21.15.100:0/2787950508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40c0158f80 0x7f40c00ca330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009e60 tx=0x7f40b4009780 comp rx=0 tx=0).stop 2024-08-17T02:46:05.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.068+0000 7f40c8200640 1 -- 172.21.15.100:0/2787950508 shutdown_connections 2024-08-17T02:46:05.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.068+0000 7f40c8200640 1 --2- 172.21.15.100:0/2787950508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40c0158f80 0x7f40c00ca330 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:05.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.068+0000 7f40c8200640 1 -- 172.21.15.100:0/2787950508 >> 172.21.15.100:0/2787950508 conn(0x7f40c00cfd90 msgr2=0x7f40c00d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:05.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.068+0000 7f40c8200640 1 -- 172.21.15.100:0/2787950508 shutdown_connections 2024-08-17T02:46:05.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.068+0000 7f40c8200640 1 -- 172.21.15.100:0/2787950508 wait complete. 2024-08-17T02:46:05.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.069+0000 7f40c8200640 1 Processor -- start 2024-08-17T02:46:05.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.069+0000 7f40c8200640 1 -- start start 2024-08-17T02:46:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.070+0000 7f40c8200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f40c00cf280 0x7f40c016c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.070+0000 7f40c8200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c0158f80 0x7f40c0067770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.070+0000 7f40c8200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40c0159350 0x7f40c00ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.070+0000 7f40c8200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c0169220 con 0x7f40c0158f80 2024-08-17T02:46:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.070+0000 7f40c8200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c00c7ff0 con 0x7f40c0159350 2024-08-17T02:46:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.070+0000 7f40c8200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c016d2b0 con 0x7f40c00cf280 2024-08-17T02:46:05.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.070+0000 7f40c4e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c0158f80 0x7f40c0067770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:05.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.071+0000 7f40c5800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f40c00cf280 0x7f40c016c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:05.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.071+0000 7f40c4e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c0158f80 0x7f40c0067770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39852/0 (socket says 172.21.15.100:39852) 2024-08-17T02:46:05.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.071+0000 7f40c6200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40c0159350 0x7f40c00ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:05.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.071+0000 7f40c4e00640 1 -- 172.21.15.100:0/1276315238 learned_addr learned my addr 172.21.15.100:0/1276315238 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.071+0000 7f40c4e00640 1 -- 172.21.15.100:0/1276315238 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f40c00cf280 msgr2=0x7f40c016c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.071+0000 7f40c4e00640 1 --2- 172.21.15.100:0/1276315238 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f40c00cf280 0x7f40c016c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.071+0000 7f40c4e00640 1 -- 172.21.15.100:0/1276315238 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40c0159350 msgr2=0x7f40c00ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.071+0000 7f40c4e00640 1 --2- 172.21.15.100:0/1276315238 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40c0159350 0x7f40c00ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.071+0000 7f40c4e00640 1 -- 172.21.15.100:0/1276315238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b4009a20 con 0x7f40c0158f80 2024-08-17T02:46:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.071+0000 7f40c4e00640 1 --2- 172.21.15.100:0/1276315238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c0158f80 0x7f40c0067770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00c510 tx=0x7f40ac007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.071+0000 7f40bcc00640 1 -- 172.21.15.100:0/1276315238 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac011590 con 0x7f40c0158f80 2024-08-17T02:46:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.071+0000 7f40bcc00640 1 -- 172.21.15.100:0/1276315238 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac011710 con 0x7f40c0158f80 2024-08-17T02:46:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.072+0000 7f40c8200640 1 -- 172.21.15.100:0/1276315238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c016d590 con 0x7f40c0158f80 2024-08-17T02:46:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.072+0000 7f40bcc00640 1 -- 172.21.15.100:0/1276315238 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac011ad0 con 0x7f40c0158f80 2024-08-17T02:46:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.072+0000 7f40c8200640 1 -- 172.21.15.100:0/1276315238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c016d8f0 con 0x7f40c0158f80 2024-08-17T02:46:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.073+0000 7f40c8200640 1 -- 172.21.15.100:0/1276315238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c00c8480 con 0x7f40c0158f80 2024-08-17T02:46:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.073+0000 7f40bcc00640 1 -- 172.21.15.100:0/1276315238 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f40ac01b3b0 con 0x7f40c0158f80 2024-08-17T02:46:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.074+0000 7f40bcc00640 1 --2- 172.21.15.100:0/1276315238 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f40a0065150 0x7f40a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.074+0000 7f40bcc00640 1 -- 172.21.15.100:0/1276315238 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40ac0818e0 con 0x7f40c0158f80 2024-08-17T02:46:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.075+0000 7f40c5800640 1 --2- 172.21.15.100:0/1276315238 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f40a0065150 0x7f40a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.075+0000 7f40c5800640 1 --2- 172.21.15.100:0/1276315238 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f40a0065150 0x7f40a0067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f40b4034000 tx=0x7f40b4037000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:05.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.078+0000 7f40bcc00640 1 -- 172.21.15.100:0/1276315238 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f40ac04fa50 con 0x7f40c0158f80 2024-08-17T02:46:05.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.289+0000 7f40c8200640 1 -- 172.21.15.100:0/1276315238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f40c0064db0 con 0x7f40c0158f80 2024-08-17T02:46:05.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.290+0000 7f40bcc00640 1 -- 172.21.15.100:0/1276315238 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f40ac017070 con 0x7f40c0158f80 2024-08-17T02:46:05.290 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:46:05.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.292+0000 7f40c8200640 1 -- 172.21.15.100:0/1276315238 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f40a0065150 msgr2=0x7f40a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:05.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.292+0000 7f40c8200640 1 --2- 172.21.15.100:0/1276315238 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f40a0065150 0x7f40a0067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f40b4034000 tx=0x7f40b4037000 comp rx=0 tx=0).stop 2024-08-17T02:46:05.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.292+0000 7f40c8200640 1 -- 172.21.15.100:0/1276315238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c0158f80 msgr2=0x7f40c0067770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:05.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.292+0000 7f40c8200640 1 --2- 172.21.15.100:0/1276315238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c0158f80 0x7f40c0067770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00c510 tx=0x7f40ac007ef0 comp rx=0 tx=0).stop 2024-08-17T02:46:05.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.292+0000 7f40c8200640 1 -- 172.21.15.100:0/1276315238 shutdown_connections 2024-08-17T02:46:05.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.292+0000 7f40c8200640 1 --2- 172.21.15.100:0/1276315238 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f40a0065150 0x7f40a0067600 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:05.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.292+0000 7f40c8200640 1 --2- 172.21.15.100:0/1276315238 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40c0159350 0x7f40c00ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:05.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.292+0000 7f40c8200640 1 --2- 172.21.15.100:0/1276315238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c0158f80 0x7f40c0067770 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:05.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.292+0000 7f40c8200640 1 --2- 172.21.15.100:0/1276315238 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f40c00cf280 0x7f40c016c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:05.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.292+0000 7f40c8200640 1 -- 172.21.15.100:0/1276315238 >> 172.21.15.100:0/1276315238 conn(0x7f40c00cfd90 msgr2=0x7f40c0159720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:05.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.292+0000 7f40c8200640 1 -- 172.21.15.100:0/1276315238 shutdown_connections 2024-08-17T02:46:05.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:05.292+0000 7f40c8200640 1 -- 172.21.15.100:0/1276315238 wait complete. 2024-08-17T02:46:05.307 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:46:05.307 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:46:05.307 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-08-17T02:46:05.308 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-17T02:46:05.308 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-17T02:46:05.308 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:46:05.308 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:46:05.308 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:46:05.308 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:46:05.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:05.308 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-08-17T02:46:05.347 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:46:05.347 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:46:05.347 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:46:05.347 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:05.347 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-08-17T02:46:05.347 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:05.347 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:05.348 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:05.348 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-08-17T02:46:05.348 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:05.348 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:05.348 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-08-17T02:46:05.348 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:05.348 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:05.348 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:46:05.348 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:05.349 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:46:05.349 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42671sec preferred_lft 42671sec 2024-08-17T02:46:05.349 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2024-08-17T02:46:05.349 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:05.349 INFO:teuthology.orchestra.run.smithi123.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:46:05.349 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether ca:2c:48:85:0d:49 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:05.349 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:46:05.349 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:05.349 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::dc40:19ff:fe17:cacc/64 scope link 2024-08-17T02:46:05.349 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:05.349 INFO:teuthology.orchestra.run.smithi123.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:46:05.349 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether ca:2c:48:85:0d:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:46:05.349 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::c82c:48ff:fe85:d49/64 scope link tentative 2024-08-17T02:46:05.349 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:05.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:05.350 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:46:05.441 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-08-17T02:46:05.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:05.445 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-08-17T02:46:05.483 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-08-17T02:46:05.483 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:46:05.484 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:46:05.484 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:46:05.484 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:46:05.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:05.484 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-08-17T02:46:05.484 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-08-17T02:46:05.484 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:46:05.484 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:46:05.484 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:46:05.484 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-08-17T02:46:05.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:05.629 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-08-17T02:46:05.666 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:46:05.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:05.666 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2024-08-17T02:46:05.743 INFO:teuthology.orchestra.run.smithi123.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-17T02:46:05.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:05.744 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-08-17T02:46:05.744 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-08-17T02:46:05.744 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:46:05.744 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-17T02:46:05.744 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-08-17T02:46:05.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:05.871 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:46:05.925 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:46:05.926 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:46:05.926 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:46:05.926 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:05.926 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-08-17T02:46:05.926 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:05.926 INFO:teuthology.orchestra.run.smithi123.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:46:05.926 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 5a:10:1c:a4:2a:6e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:46:05.926 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:46:05.926 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:05.926 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::5810:1cff:fea4:2a6e/64 scope link 2024-08-17T02:46:05.927 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:05.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:05.929 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:46:05.984 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:46:05.984 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:46:05.984 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:46:05.984 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:05.984 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-08-17T02:46:05.984 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:05.984 INFO:teuthology.orchestra.run.smithi123.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:46:05.984 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 5a:10:1c:a4:2a:6e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:46:05.984 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:46:05.985 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:05.985 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::5810:1cff:fea4:2a6e/64 scope link 2024-08-17T02:46:05.985 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:05.987 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-17T02:46:05.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:05.987 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-08-17T02:46:05.988 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-08-17T02:46:05.988 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-17T02:46:05.988 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:46:05.988 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-17T02:46:05.988 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-17T02:46:05.988 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-17T02:46:05.988 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-08-17T02:46:06.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:06.153 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-08-17T02:46:06.154 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-08-17T02:46:06.154 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.1 up 2024-08-17T02:46:06.154 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:46:06.154 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-08-17T02:46:06.267 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:46:06.268 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-17T02:46:06.302 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:46:06.302 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:46:06.303 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:46:06.378 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-08-17T02:46:06.378 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:46:06.378 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:06.501 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:06.501 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:46:06.527 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:06.527 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:46:06.528 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.123:3300,172.21.15.123:3301" 2024-08-17T02:46:06.528 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with new device syntax: 3@9fea90ef-12b1-4f23-8013-27074825f754.cephfs=/ 2024-08-17T02:46:06.528 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.100:3300/172.21.15.123:3300/172.21.15.123:3301" will pass to kernel 2024-08-17T02:46:06.529 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-08-17T02:46:06.529 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:46:06.529 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:46:06.529 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:46:06.530 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:46:06.532 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:46:06.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:06.533 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:46:06.587 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-17T02:46:06.604 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:06.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.752+0000 7f9372e00640 1 Processor -- start 2024-08-17T02:46:06.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.752+0000 7f9372e00640 1 -- start start 2024-08-17T02:46:06.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.754+0000 7f9372e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f936c154cb0 0x7f936c158a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:06.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.754+0000 7f9372e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936c0c7fd0 con 0x7f936c158fa0 2024-08-17T02:46:06.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.754+0000 7f9372e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936c159440 con 0x7f936c0cb570 2024-08-17T02:46:06.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.754+0000 7f9372e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936c159a00 con 0x7f936c154cb0 2024-08-17T02:46:06.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.754+0000 7f9363400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f936c158fa0 0x7f936c0cae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39650/0 (socket says 172.21.15.100:39650) 2024-08-17T02:46:06.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.754+0000 7f9363400640 1 -- 172.21.15.100:0/659017119 learned_addr learned my addr 172.21.15.100:0/659017119 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:06.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.754+0000 7f936be00640 1 --2- 172.21.15.100:0/659017119 >> v2:172.21.15.123:3300/0 conn(0x7f936c154cb0 0x7f936c158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:06.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.754+0000 7f936b400640 1 -- 172.21.15.100:0/659017119 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766665629 0 0) 0x7f936c0c7fd0 con 0x7f936c158fa0 2024-08-17T02:46:06.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.755+0000 7f936b400640 1 -- 172.21.15.100:0/659017119 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93500034e0 con 0x7f936c158fa0 2024-08-17T02:46:06.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.755+0000 7f936b400640 1 -- 172.21.15.100:0/659017119 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3319461186 0 0) 0x7f936c159440 con 0x7f936c0cb570 2024-08-17T02:46:06.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.755+0000 7f936b400640 1 -- 172.21.15.100:0/659017119 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f936c0c7fd0 con 0x7f936c0cb570 2024-08-17T02:46:06.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.755+0000 7f936be00640 1 -- 172.21.15.100:0/659017119 >> v1:172.21.15.123:6789/0 conn(0x7f936c0cb570 legacy=0x7f936c0c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.755+0000 7f936be00640 1 -- 172.21.15.100:0/659017119 >> v1:172.21.15.100:6789/0 conn(0x7f936c158fa0 legacy=0x7f936c0cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.755+0000 7f936be00640 1 -- 172.21.15.100:0/659017119 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c159720 con 0x7f936c154cb0 2024-08-17T02:46:06.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.756+0000 7f936be00640 1 --2- 172.21.15.100:0/659017119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936c154cb0 0x7f936c158a60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f935c009850 tx=0x7f935c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=598e1d9c1c3d0733 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:06.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.756+0000 7f936b400640 1 -- 172.21.15.100:0/659017119 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c02ad90 con 0x7f936c154cb0 2024-08-17T02:46:06.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.756+0000 7f936b400640 1 -- 172.21.15.100:0/659017119 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c032440 con 0x7f936c154cb0 2024-08-17T02:46:06.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.756+0000 7f936b400640 1 -- 172.21.15.100:0/659017119 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c0327e0 con 0x7f936c154cb0 2024-08-17T02:46:06.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.756+0000 7f9372e00640 1 -- 172.21.15.100:0/659017119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936c154cb0 msgr2=0x7f936c158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.756+0000 7f9372e00640 1 --2- 172.21.15.100:0/659017119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936c154cb0 0x7f936c158a60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f935c009850 tx=0x7f935c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.757+0000 7f9372e00640 1 -- 172.21.15.100:0/659017119 shutdown_connections 2024-08-17T02:46:06.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.757+0000 7f9372e00640 1 --2- 172.21.15.100:0/659017119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936c154cb0 0x7f936c158a60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.757+0000 7f9372e00640 1 -- 172.21.15.100:0/659017119 >> 172.21.15.100:0/659017119 conn(0x7f936c0cb9b0 msgr2=0x7f936c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:06.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.757+0000 7f9372e00640 1 -- 172.21.15.100:0/659017119 shutdown_connections 2024-08-17T02:46:06.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.757+0000 7f9372e00640 1 -- 172.21.15.100:0/659017119 wait complete. 2024-08-17T02:46:06.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.758+0000 7f9372e00640 1 Processor -- start 2024-08-17T02:46:06.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.758+0000 7f9372e00640 1 -- start start 2024-08-17T02:46:06.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.759+0000 7f9372e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f936c0cb570 0x7f936c169270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:06.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.759+0000 7f9372e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936c154cb0 0x7f936c150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:06.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.759+0000 7f9372e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936c158fa0 0x7f936c153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:06.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.759+0000 7f9372e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c1697b0 con 0x7f936c154cb0 2024-08-17T02:46:06.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.759+0000 7f9372e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c151dc0 con 0x7f936c158fa0 2024-08-17T02:46:06.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.759+0000 7f9372e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c1511b0 con 0x7f936c0cb570 2024-08-17T02:46:06.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.759+0000 7f9363400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936c154cb0 0x7f936c150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:06.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.759+0000 7f9363400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936c154cb0 0x7f936c150020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39864/0 (socket says 172.21.15.100:39864) 2024-08-17T02:46:06.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.759+0000 7f9363400640 1 -- 172.21.15.100:0/2100205365 learned_addr learned my addr 172.21.15.100:0/2100205365 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:06.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.760+0000 7f936be00640 1 --2- 172.21.15.100:0/2100205365 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f936c0cb570 0x7f936c169270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:06.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.760+0000 7f9363400640 1 -- 172.21.15.100:0/2100205365 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f936c0cb570 msgr2=0x7f936c169270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.760+0000 7f9370e00640 1 --2- 172.21.15.100:0/2100205365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936c158fa0 0x7f936c153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:06.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.760+0000 7f9363400640 1 --2- 172.21.15.100:0/2100205365 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f936c0cb570 0x7f936c169270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.760+0000 7f9363400640 1 -- 172.21.15.100:0/2100205365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936c158fa0 msgr2=0x7f936c153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.760+0000 7f9363400640 1 --2- 172.21.15.100:0/2100205365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936c158fa0 0x7f936c153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.760+0000 7f9363400640 1 -- 172.21.15.100:0/2100205365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935c009390 con 0x7f936c154cb0 2024-08-17T02:46:06.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.760+0000 7f936be00640 1 --2- 172.21.15.100:0/2100205365 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f936c0cb570 0x7f936c169270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:06.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.760+0000 7f9370e00640 1 --2- 172.21.15.100:0/2100205365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936c158fa0 0x7f936c153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:06.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.760+0000 7f9363400640 1 --2- 172.21.15.100:0/2100205365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936c154cb0 0x7f936c150020 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9354005840 tx=0x7f9354007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:06.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.760+0000 7f9363e00640 1 -- 172.21.15.100:0/2100205365 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9354005aa0 con 0x7f936c154cb0 2024-08-17T02:46:06.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.760+0000 7f9363e00640 1 -- 172.21.15.100:0/2100205365 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9354005c00 con 0x7f936c154cb0 2024-08-17T02:46:06.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.760+0000 7f9372e00640 1 -- 172.21.15.100:0/2100205365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936c151490 con 0x7f936c154cb0 2024-08-17T02:46:06.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.760+0000 7f9363e00640 1 -- 172.21.15.100:0/2100205365 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93540070f0 con 0x7f936c154cb0 2024-08-17T02:46:06.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.760+0000 7f9372e00640 1 -- 172.21.15.100:0/2100205365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936c151a50 con 0x7f936c154cb0 2024-08-17T02:46:06.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.761+0000 7f9372e00640 1 -- 172.21.15.100:0/2100205365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936c151f50 con 0x7f936c154cb0 2024-08-17T02:46:06.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.762+0000 7f9363e00640 1 -- 172.21.15.100:0/2100205365 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9354007520 con 0x7f936c154cb0 2024-08-17T02:46:06.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.763+0000 7f9363e00640 1 --2- 172.21.15.100:0/2100205365 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f93480651d0 0x7f9348067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:06.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.763+0000 7f9363e00640 1 -- 172.21.15.100:0/2100205365 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9354081f20 con 0x7f936c154cb0 2024-08-17T02:46:06.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.764+0000 7f936be00640 1 --2- 172.21.15.100:0/2100205365 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f93480651d0 0x7f9348067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:06.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.764+0000 7f936be00640 1 --2- 172.21.15.100:0/2100205365 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f93480651d0 0x7f9348067680 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f935c034000 tx=0x7f935c032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.767+0000 7f9363e00640 1 -- 172.21.15.100:0/2100205365 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f935404ffc0 con 0x7f936c154cb0 2024-08-17T02:46:06.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.940+0000 7f9372e00640 1 -- 172.21.15.100:0/2100205365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f936c064db0 con 0x7f936c154cb0 2024-08-17T02:46:06.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.941+0000 7f9363e00640 1 -- 172.21.15.100:0/2100205365 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f93540535e0 con 0x7f936c154cb0 2024-08-17T02:46:06.942 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:06.942 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:42.845503+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:45:39.036964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:45:40.232954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:06.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.943+0000 7f9372e00640 1 -- 172.21.15.100:0/2100205365 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f93480651d0 msgr2=0x7f9348067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.943+0000 7f9372e00640 1 --2- 172.21.15.100:0/2100205365 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f93480651d0 0x7f9348067680 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f935c034000 tx=0x7f935c032000 comp rx=0 tx=0).stop 2024-08-17T02:46:06.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.943+0000 7f9372e00640 1 -- 172.21.15.100:0/2100205365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936c154cb0 msgr2=0x7f936c150020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.943+0000 7f9372e00640 1 --2- 172.21.15.100:0/2100205365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936c154cb0 0x7f936c150020 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9354005840 tx=0x7f9354007e10 comp rx=0 tx=0).stop 2024-08-17T02:46:06.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.943+0000 7f9372e00640 1 -- 172.21.15.100:0/2100205365 shutdown_connections 2024-08-17T02:46:06.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.943+0000 7f9372e00640 1 --2- 172.21.15.100:0/2100205365 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f93480651d0 0x7f9348067680 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.943+0000 7f9372e00640 1 --2- 172.21.15.100:0/2100205365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936c158fa0 0x7f936c153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.943+0000 7f9372e00640 1 --2- 172.21.15.100:0/2100205365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f936c154cb0 0x7f936c150020 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.943+0000 7f9372e00640 1 --2- 172.21.15.100:0/2100205365 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f936c0cb570 0x7f936c169270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.943+0000 7f9372e00640 1 -- 172.21.15.100:0/2100205365 >> 172.21.15.100:0/2100205365 conn(0x7f936c0cb9b0 msgr2=0x7f936c0af630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:06.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.943+0000 7f9372e00640 1 -- 172.21.15.100:0/2100205365 shutdown_connections 2024-08-17T02:46:06.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:06.943+0000 7f9372e00640 1 -- 172.21.15.100:0/2100205365 wait complete. 2024-08-17T02:46:06.959 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:45:35.140990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:45:39.036964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:45:40.232954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:46:06.960 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:07.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.110+0000 7f1418800640 1 Processor -- start 2024-08-17T02:46:07.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.111+0000 7f1418800640 1 -- start start 2024-08-17T02:46:07.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.112+0000 7f1418800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f14100accf0 0x7f14100b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:07.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.112+0000 7f1418800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f14100afd90 0x7f1410157690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:07.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.112+0000 7f1418800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14100ae540 con 0x7f1410159610 2024-08-17T02:46:07.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.112+0000 7f1418800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14100ad930 con 0x7f14100afd90 2024-08-17T02:46:07.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.112+0000 7f1418800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14100adc10 con 0x7f14100accf0 2024-08-17T02:46:07.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.112+0000 7f1416800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f14100afd90 0x7f1410157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:07.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.112+0000 7f1415400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1410159610 0x7f14100af680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.100:58662/0 (socket says 172.21.15.100:58662) 2024-08-17T02:46:07.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.112+0000 7f1415400640 1 -- 172.21.15.100:0/1796346714 learned_addr learned my addr 172.21.15.100:0/1796346714 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:07.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.112+0000 7f1415e00640 1 --2- 172.21.15.100:0/1796346714 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f14100accf0 0x7f14100b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:07.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.113+0000 7f1416800640 1 -- 172.21.15.100:0/1796346714 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f14100accf0 msgr2=0x7f14100b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:07.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.113+0000 7f1416800640 1 --2- 172.21.15.100:0/1796346714 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f14100accf0 0x7f14100b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.113+0000 7f1416800640 1 -- 172.21.15.100:0/1796346714 >> v1:172.21.15.123:6789/0 conn(0x7f1410159610 legacy=0x7f14100af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:07.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.113+0000 7f1416800640 1 -- 172.21.15.100:0/1796346714 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14100adef0 con 0x7f14100afd90 2024-08-17T02:46:07.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.113+0000 7f1414a00640 1 -- 172.21.15.100:0/1796346714 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79347414 0 0) 0x7f14100ae540 con 0x7f1410159610 2024-08-17T02:46:07.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.114+0000 7f1416800640 1 --2- 172.21.15.100:0/1796346714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14100afd90 0x7f1410157690 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f140c009e90 tx=0x7f140c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31ddc70ee73051e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:07.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.114+0000 7f1414a00640 1 -- 172.21.15.100:0/1796346714 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c02aea0 con 0x7f14100afd90 2024-08-17T02:46:07.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.114+0000 7f1414a00640 1 -- 172.21.15.100:0/1796346714 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c02d050 con 0x7f14100afd90 2024-08-17T02:46:07.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.114+0000 7f1414a00640 1 -- 172.21.15.100:0/1796346714 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c007780 con 0x7f14100afd90 2024-08-17T02:46:07.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.114+0000 7f1418800640 1 -- 172.21.15.100:0/1796346714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14100afd90 msgr2=0x7f1410157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:07.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.114+0000 7f1418800640 1 --2- 172.21.15.100:0/1796346714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14100afd90 0x7f1410157690 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f140c009e90 tx=0x7f140c009780 comp rx=0 tx=0).stop 2024-08-17T02:46:07.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.114+0000 7f1418800640 1 -- 172.21.15.100:0/1796346714 shutdown_connections 2024-08-17T02:46:07.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.114+0000 7f1418800640 1 --2- 172.21.15.100:0/1796346714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14100afd90 0x7f1410157690 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.114+0000 7f1418800640 1 --2- 172.21.15.100:0/1796346714 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f14100accf0 0x7f14100b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.115+0000 7f1418800640 1 -- 172.21.15.100:0/1796346714 >> 172.21.15.100:0/1796346714 conn(0x7f1410067750 msgr2=0x7f14100cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:07.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.115+0000 7f1418800640 1 -- 172.21.15.100:0/1796346714 shutdown_connections 2024-08-17T02:46:07.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.115+0000 7f1418800640 1 -- 172.21.15.100:0/1796346714 wait complete. 2024-08-17T02:46:07.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.116+0000 7f1418800640 1 Processor -- start 2024-08-17T02:46:07.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.116+0000 7f1418800640 1 -- start start 2024-08-17T02:46:07.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.117+0000 7f1418800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14100accf0 0x7f14100a6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:07.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.117+0000 7f1418800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14100afd90 0x7f1410154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:07.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.117+0000 7f1418800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1410159610 0x7f1410155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:07.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.117+0000 7f1418800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1410155b60 con 0x7f14100accf0 2024-08-17T02:46:07.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.117+0000 7f1418800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1410153960 con 0x7f14100afd90 2024-08-17T02:46:07.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.117+0000 7f1418800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1410153c40 con 0x7f1410159610 2024-08-17T02:46:07.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.117+0000 7f1415e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14100accf0 0x7f14100a6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:07.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.117+0000 7f1415e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14100accf0 0x7f14100a6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45002/0 (socket says 172.21.15.100:45002) 2024-08-17T02:46:07.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.117+0000 7f1415e00640 1 -- 172.21.15.100:0/2779489517 learned_addr learned my addr 172.21.15.100:0/2779489517 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:07.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.117+0000 7f1416800640 1 --2- 172.21.15.100:0/2779489517 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1410159610 0x7f1410155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:07.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.118+0000 7f1415400640 1 --2- 172.21.15.100:0/2779489517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14100afd90 0x7f1410154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:07.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.118+0000 7f1415e00640 1 -- 172.21.15.100:0/2779489517 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1410159610 msgr2=0x7f1410155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:07.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.118+0000 7f1415e00640 1 --2- 172.21.15.100:0/2779489517 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1410159610 0x7f1410155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.118+0000 7f1415e00640 1 -- 172.21.15.100:0/2779489517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14100afd90 msgr2=0x7f1410154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:07.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.118+0000 7f1415e00640 1 --2- 172.21.15.100:0/2779489517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14100afd90 0x7f1410154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.118+0000 7f1415e00640 1 -- 172.21.15.100:0/2779489517 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c009a20 con 0x7f14100accf0 2024-08-17T02:46:07.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.118+0000 7f1415400640 1 --2- 172.21.15.100:0/2779489517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14100afd90 0x7f1410154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:07.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.118+0000 7f1415e00640 1 --2- 172.21.15.100:0/2779489517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14100accf0 0x7f14100a6ff0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f140400ea20 tx=0x7f14040090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:07.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.118+0000 7f1409600640 1 -- 172.21.15.100:0/2779489517 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140400ca10 con 0x7f14100accf0 2024-08-17T02:46:07.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.118+0000 7f1409600640 1 -- 172.21.15.100:0/2779489517 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140400cb70 con 0x7f14100accf0 2024-08-17T02:46:07.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.118+0000 7f1409600640 1 -- 172.21.15.100:0/2779489517 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404013470 con 0x7f14100accf0 2024-08-17T02:46:07.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.118+0000 7f1418800640 1 -- 172.21.15.100:0/2779489517 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1410153f20 con 0x7f14100accf0 2024-08-17T02:46:07.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.118+0000 7f1418800640 1 -- 172.21.15.100:0/2779489517 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1410149310 con 0x7f14100accf0 2024-08-17T02:46:07.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.119+0000 7f1418800640 1 -- 172.21.15.100:0/2779489517 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14101543a0 con 0x7f14100accf0 2024-08-17T02:46:07.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.120+0000 7f1409600640 1 -- 172.21.15.100:0/2779489517 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1404013860 con 0x7f14100accf0 2024-08-17T02:46:07.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.121+0000 7f1409600640 1 --2- 172.21.15.100:0/2779489517 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f13f4065150 0x7f13f4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:07.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.121+0000 7f1409600640 1 -- 172.21.15.100:0/2779489517 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f14040828a0 con 0x7f14100accf0 2024-08-17T02:46:07.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.121+0000 7f1415400640 1 --2- 172.21.15.100:0/2779489517 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f13f4065150 0x7f13f4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:07.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.122+0000 7f1415400640 1 --2- 172.21.15.100:0/2779489517 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f13f4065150 0x7f13f4067600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f14100cc450 tx=0x7f1400009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:07.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.125+0000 7f1409600640 1 -- 172.21.15.100:0/2779489517 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1404050a20 con 0x7f14100accf0 2024-08-17T02:46:07.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.296+0000 7f1418800640 1 -- 172.21.15.100:0/2779489517 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1410064db0 con 0x7f14100accf0 2024-08-17T02:46:07.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.297+0000 7f1409600640 1 -- 172.21.15.100:0/2779489517 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1404054040 con 0x7f14100accf0 2024-08-17T02:46:07.299 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-08-17T02:46:07.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.299+0000 7f1418800640 1 -- 172.21.15.100:0/2779489517 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f13f4065150 msgr2=0x7f13f4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:07.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.299+0000 7f1418800640 1 --2- 172.21.15.100:0/2779489517 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f13f4065150 0x7f13f4067600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f14100cc450 tx=0x7f1400009040 comp rx=0 tx=0).stop 2024-08-17T02:46:07.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.299+0000 7f1418800640 1 -- 172.21.15.100:0/2779489517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14100accf0 msgr2=0x7f14100a6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:07.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.299+0000 7f1418800640 1 --2- 172.21.15.100:0/2779489517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14100accf0 0x7f14100a6ff0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f140400ea20 tx=0x7f14040090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.299+0000 7f1418800640 1 -- 172.21.15.100:0/2779489517 shutdown_connections 2024-08-17T02:46:07.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.299+0000 7f1418800640 1 --2- 172.21.15.100:0/2779489517 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f13f4065150 0x7f13f4067600 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.299+0000 7f1418800640 1 --2- 172.21.15.100:0/2779489517 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1410159610 0x7f1410155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.299+0000 7f1418800640 1 --2- 172.21.15.100:0/2779489517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14100afd90 0x7f1410154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.299+0000 7f1418800640 1 --2- 172.21.15.100:0/2779489517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14100accf0 0x7f14100a6ff0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.299+0000 7f1418800640 1 -- 172.21.15.100:0/2779489517 >> 172.21.15.100:0/2779489517 conn(0x7f1410067750 msgr2=0x7f1410068e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:07.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.299+0000 7f1418800640 1 -- 172.21.15.100:0/2779489517 shutdown_connections 2024-08-17T02:46:07.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.299+0000 7f1418800640 1 -- 172.21.15.100:0/2779489517 wait complete. 2024-08-17T02:46:07.315 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:46:07.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.464+0000 7fdf4c600640 1 Processor -- start 2024-08-17T02:46:07.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.464+0000 7fdf4c600640 1 -- start start 2024-08-17T02:46:07.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.465+0000 7fdf4c600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf44158da0 0x7fdf440ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:07.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.465+0000 7fdf4c600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdf440aaf20 0x7fdf440ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:07.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.465+0000 7fdf4c600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf440681f0 con 0x7fdf44159170 2024-08-17T02:46:07.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.465+0000 7fdf4c600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf440b08c0 con 0x7fdf440aaf20 2024-08-17T02:46:07.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.465+0000 7fdf4c600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf440aca00 con 0x7fdf44158da0 2024-08-17T02:46:07.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.466+0000 7fdf4a600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdf440aaf20 0x7fdf440ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:07.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.466+0000 7fdf49200640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fdf44159170 0x7fdf440aa810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.100:58672/0 (socket says 172.21.15.100:58672) 2024-08-17T02:46:07.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.466+0000 7fdf49c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf44158da0 0x7fdf440ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:07.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.466+0000 7fdf49200640 1 -- 172.21.15.100:0/3150764583 learned_addr learned my addr 172.21.15.100:0/3150764583 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:07.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.466+0000 7fdf4a600640 1 -- 172.21.15.100:0/3150764583 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf44158da0 msgr2=0x7fdf440ac3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:07.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.466+0000 7fdf4a600640 1 --2- 172.21.15.100:0/3150764583 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf44158da0 0x7fdf440ac3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.466+0000 7fdf4a600640 1 -- 172.21.15.100:0/3150764583 >> v1:172.21.15.123:6789/0 conn(0x7fdf44159170 legacy=0x7fdf440aa810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:07.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.466+0000 7fdf4a600640 1 -- 172.21.15.100:0/3150764583 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf440acce0 con 0x7fdf440aaf20 2024-08-17T02:46:07.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.466+0000 7fdf43e00640 1 -- 172.21.15.100:0/3150764583 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739839757 0 0) 0x7fdf440681f0 con 0x7fdf44159170 2024-08-17T02:46:07.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.467+0000 7fdf4a600640 1 --2- 172.21.15.100:0/3150764583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf440aaf20 0x7fdf440ae7b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c009e60 tx=0x7fdf3c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=235b3a81e74fd57f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:07.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.468+0000 7fdf43e00640 1 -- 172.21.15.100:0/3150764583 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c007550 con 0x7fdf440aaf20 2024-08-17T02:46:07.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.468+0000 7fdf43e00640 1 -- 172.21.15.100:0/3150764583 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3c02d050 con 0x7fdf440aaf20 2024-08-17T02:46:07.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.468+0000 7fdf43e00640 1 -- 172.21.15.100:0/3150764583 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c0078e0 con 0x7fdf440aaf20 2024-08-17T02:46:07.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.468+0000 7fdf4c600640 1 -- 172.21.15.100:0/3150764583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf440aaf20 msgr2=0x7fdf440ae7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:07.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.468+0000 7fdf4c600640 1 --2- 172.21.15.100:0/3150764583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf440aaf20 0x7fdf440ae7b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c009e60 tx=0x7fdf3c009780 comp rx=0 tx=0).stop 2024-08-17T02:46:07.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.468+0000 7fdf4c600640 1 -- 172.21.15.100:0/3150764583 shutdown_connections 2024-08-17T02:46:07.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.468+0000 7fdf4c600640 1 --2- 172.21.15.100:0/3150764583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf440aaf20 0x7fdf440ae7b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.468+0000 7fdf4c600640 1 --2- 172.21.15.100:0/3150764583 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf44158da0 0x7fdf440ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.468+0000 7fdf4c600640 1 -- 172.21.15.100:0/3150764583 >> 172.21.15.100:0/3150764583 conn(0x7fdf44096a70 msgr2=0x7fdf44096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:07.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.468+0000 7fdf4c600640 1 -- 172.21.15.100:0/3150764583 shutdown_connections 2024-08-17T02:46:07.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.468+0000 7fdf4c600640 1 -- 172.21.15.100:0/3150764583 wait complete. 2024-08-17T02:46:07.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.470+0000 7fdf4c600640 1 Processor -- start 2024-08-17T02:46:07.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.470+0000 7fdf4c600640 1 -- start start 2024-08-17T02:46:07.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.471+0000 7fdf4c600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf440aaf20 0x7fdf440c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:07.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.471+0000 7fdf4c600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf44158da0 0x7fdf44147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:07.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.471+0000 7fdf4c600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf44159f10 0x7fdf4415b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:07.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.471+0000 7fdf4c600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4415a740 con 0x7fdf44159f10 2024-08-17T02:46:07.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.471+0000 7fdf4c600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf440c6e50 con 0x7fdf440aaf20 2024-08-17T02:46:07.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.471+0000 7fdf4c600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf440c7130 con 0x7fdf44158da0 2024-08-17T02:46:07.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.471+0000 7fdf4a600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf44159f10 0x7fdf4415b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:07.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.471+0000 7fdf4a600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf44159f10 0x7fdf4415b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45012/0 (socket says 172.21.15.100:45012) 2024-08-17T02:46:07.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.471+0000 7fdf4a600640 1 -- 172.21.15.100:0/3884216720 learned_addr learned my addr 172.21.15.100:0/3884216720 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:07.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.471+0000 7fdf49c00640 1 --2- 172.21.15.100:0/3884216720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf440aaf20 0x7fdf440c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:07.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.471+0000 7fdf49200640 1 --2- 172.21.15.100:0/3884216720 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf44158da0 0x7fdf44147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:07.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.471+0000 7fdf4a600640 1 -- 172.21.15.100:0/3884216720 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf44158da0 msgr2=0x7fdf44147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:07.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.471+0000 7fdf4a600640 1 --2- 172.21.15.100:0/3884216720 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf44158da0 0x7fdf44147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.471+0000 7fdf4a600640 1 -- 172.21.15.100:0/3884216720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf440aaf20 msgr2=0x7fdf440c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:07.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.471+0000 7fdf4a600640 1 --2- 172.21.15.100:0/3884216720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf440aaf20 0x7fdf440c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.471+0000 7fdf4a600640 1 -- 172.21.15.100:0/3884216720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c009a20 con 0x7fdf44159f10 2024-08-17T02:46:07.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.472+0000 7fdf4a600640 1 --2- 172.21.15.100:0/3884216720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf44159f10 0x7fdf4415b310 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0099f0 tx=0x7fdf3c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:07.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.472+0000 7fdf40c00640 1 -- 172.21.15.100:0/3884216720 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c0318b0 con 0x7fdf44159f10 2024-08-17T02:46:07.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.472+0000 7fdf40c00640 1 -- 172.21.15.100:0/3884216720 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3c040070 con 0x7fdf44159f10 2024-08-17T02:46:07.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.472+0000 7fdf40c00640 1 -- 172.21.15.100:0/3884216720 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c031c40 con 0x7fdf44159f10 2024-08-17T02:46:07.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.472+0000 7fdf4c600640 1 -- 172.21.15.100:0/3884216720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf440c7410 con 0x7fdf44159f10 2024-08-17T02:46:07.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.472+0000 7fdf4c600640 1 -- 172.21.15.100:0/3884216720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4415b850 con 0x7fdf44159f10 2024-08-17T02:46:07.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.473+0000 7fdf4c600640 1 -- 172.21.15.100:0/3884216720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf440c6cb0 con 0x7fdf44159f10 2024-08-17T02:46:07.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.474+0000 7fdf40c00640 1 -- 172.21.15.100:0/3884216720 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdf3c042030 con 0x7fdf44159f10 2024-08-17T02:46:07.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.475+0000 7fdf40c00640 1 --2- 172.21.15.100:0/3884216720 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fdf24065150 0x7fdf24067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:07.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.475+0000 7fdf40c00640 1 -- 172.21.15.100:0/3884216720 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf3c0a3de0 con 0x7fdf44159f10 2024-08-17T02:46:07.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.475+0000 7fdf49c00640 1 --2- 172.21.15.100:0/3884216720 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fdf24065150 0x7fdf24067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:07.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.475+0000 7fdf49c00640 1 --2- 172.21.15.100:0/3884216720 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fdf24065150 0x7fdf24067600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009d20 tx=0x7fdf380090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:07.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.479+0000 7fdf40c00640 1 -- 172.21.15.100:0/3884216720 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdf440c6cb0 con 0x7fdf44159f10 2024-08-17T02:46:07.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.651+0000 7fdf4c600640 1 -- 172.21.15.100:0/3884216720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf440c6cb0 con 0x7fdf44159f10 2024-08-17T02:46:07.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.652+0000 7fdf40c00640 1 -- 172.21.15.100:0/3884216720 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdf440c6cb0 con 0x7fdf44159f10 2024-08-17T02:46:07.653 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-08-17T02:46:07.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.654+0000 7fdf4c600640 1 -- 172.21.15.100:0/3884216720 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fdf24065150 msgr2=0x7fdf24067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:07.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.654+0000 7fdf4c600640 1 --2- 172.21.15.100:0/3884216720 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fdf24065150 0x7fdf24067600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009d20 tx=0x7fdf380090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.654+0000 7fdf4c600640 1 -- 172.21.15.100:0/3884216720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf44159f10 msgr2=0x7fdf4415b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:07.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.654+0000 7fdf4c600640 1 --2- 172.21.15.100:0/3884216720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf44159f10 0x7fdf4415b310 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0099f0 tx=0x7fdf3c037000 comp rx=0 tx=0).stop 2024-08-17T02:46:07.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.654+0000 7fdf4c600640 1 -- 172.21.15.100:0/3884216720 shutdown_connections 2024-08-17T02:46:07.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.654+0000 7fdf4c600640 1 --2- 172.21.15.100:0/3884216720 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fdf24065150 0x7fdf24067600 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.654+0000 7fdf4c600640 1 --2- 172.21.15.100:0/3884216720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf44159f10 0x7fdf4415b310 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.654+0000 7fdf4c600640 1 --2- 172.21.15.100:0/3884216720 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf44158da0 0x7fdf44147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.654+0000 7fdf4c600640 1 --2- 172.21.15.100:0/3884216720 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf440aaf20 0x7fdf440c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.654+0000 7fdf4c600640 1 -- 172.21.15.100:0/3884216720 >> 172.21.15.100:0/3884216720 conn(0x7fdf44096a70 msgr2=0x7fdf440abb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:07.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.654+0000 7fdf4c600640 1 -- 172.21.15.100:0/3884216720 shutdown_connections 2024-08-17T02:46:07.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.654+0000 7fdf4c600640 1 -- 172.21.15.100:0/3884216720 wait complete. 2024-08-17T02:46:07.670 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:46:07.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.820+0000 7fa00fe00640 1 Processor -- start 2024-08-17T02:46:07.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.820+0000 7fa00fe00640 1 -- start start 2024-08-17T02:46:07.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.821+0000 7fa00fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa0080adcf0 0x7fa0080ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:07.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.821+0000 7fa00fe00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0080ab130 con 0x7fa0080abb00 2024-08-17T02:46:07.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.822+0000 7fa00fe00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0080ae5a0 con 0x7fa008156c50 2024-08-17T02:46:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.822+0000 7fa00fe00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0080ae2c0 con 0x7fa0080adcf0 2024-08-17T02:46:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.822+0000 7fa00ca00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa0080adcf0 0x7fa0080ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.822+0000 7fa00de00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa0080abb00 0x7fa0080c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45466/0 (socket says 172.21.15.100:45466) 2024-08-17T02:46:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.822+0000 7fa00ca00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa0080adcf0 0x7fa0080ab5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45022/0 (socket says 172.21.15.100:45022) 2024-08-17T02:46:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.822+0000 7fa00de00640 1 -- 172.21.15.100:0/1712582002 learned_addr learned my addr 172.21.15.100:0/1712582002 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.822+0000 7fa00d400640 1 --1- 172.21.15.100:0/1712582002 >> v1:172.21.15.123:6789/0 conn(0x7fa008156c50 0x7fa0080c7cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.100:58688/0 (socket says 172.21.15.100:58688) 2024-08-17T02:46:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.822+0000 7fa00ca00640 1 -- 172.21.15.100:0/1712582002 >> v1:172.21.15.123:6789/0 conn(0x7fa008156c50 legacy=0x7fa0080c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.822+0000 7fa007e00640 1 -- 172.21.15.100:0/1712582002 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549030806 0 0) 0x7fa0080ae5a0 con 0x7fa008156c50 2024-08-17T02:46:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.822+0000 7fa00ca00640 1 -- 172.21.15.100:0/1712582002 >> v1:172.21.15.100:6789/0 conn(0x7fa0080abb00 legacy=0x7fa0080c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.822+0000 7fa00ca00640 1 -- 172.21.15.100:0/1712582002 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0080aaae0 con 0x7fa0080adcf0 2024-08-17T02:46:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.823+0000 7fa00ca00640 1 --2- 172.21.15.100:0/1712582002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0080adcf0 0x7fa0080ab5c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009850 tx=0x7f9ff40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ebdda5fc9a4dc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:07.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.824+0000 7fa007e00640 1 -- 172.21.15.100:0/1712582002 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff402ab40 con 0x7fa0080adcf0 2024-08-17T02:46:07.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.824+0000 7fa007e00640 1 -- 172.21.15.100:0/1712582002 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff402aca0 con 0x7fa0080adcf0 2024-08-17T02:46:07.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.824+0000 7fa007e00640 1 -- 172.21.15.100:0/1712582002 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4032670 con 0x7fa0080adcf0 2024-08-17T02:46:07.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.824+0000 7fa00fe00640 1 -- 172.21.15.100:0/1712582002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0080adcf0 msgr2=0x7fa0080ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:07.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.824+0000 7fa00fe00640 1 --2- 172.21.15.100:0/1712582002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0080adcf0 0x7fa0080ab5c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009850 tx=0x7f9ff40090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.824+0000 7fa00fe00640 1 -- 172.21.15.100:0/1712582002 shutdown_connections 2024-08-17T02:46:07.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.824+0000 7fa00fe00640 1 --2- 172.21.15.100:0/1712582002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0080adcf0 0x7fa0080ab5c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.824+0000 7fa00fe00640 1 -- 172.21.15.100:0/1712582002 >> 172.21.15.100:0/1712582002 conn(0x7fa008067750 msgr2=0x7fa0080c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:07.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.824+0000 7fa00fe00640 1 -- 172.21.15.100:0/1712582002 shutdown_connections 2024-08-17T02:46:07.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.824+0000 7fa00fe00640 1 -- 172.21.15.100:0/1712582002 wait complete. 2024-08-17T02:46:07.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.826+0000 7fa00fe00640 1 Processor -- start 2024-08-17T02:46:07.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.826+0000 7fa00fe00640 1 -- start start 2024-08-17T02:46:07.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.827+0000 7fa00fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0080abb00 0x7fa008159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.827+0000 7fa00fe00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa0080adcf0 0x7fa00806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.827+0000 7fa00fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa008156c50 0x7fa0080c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.827+0000 7fa00fe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00806dab0 con 0x7fa0080abb00 2024-08-17T02:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.827+0000 7fa00fe00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0080c7770 con 0x7fa008156c50 2024-08-17T02:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.827+0000 7fa00fe00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00806cea0 con 0x7fa0080adcf0 2024-08-17T02:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.827+0000 7fa00d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0080abb00 0x7fa008159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.827+0000 7fa00d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0080abb00 0x7fa008159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45038/0 (socket says 172.21.15.100:45038) 2024-08-17T02:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.827+0000 7fa00d400640 1 -- 172.21.15.100:0/2351422656 learned_addr learned my addr 172.21.15.100:0/2351422656 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.827+0000 7fa00de00640 1 --2- 172.21.15.100:0/2351422656 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa008156c50 0x7fa0080c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.827+0000 7fa00ca00640 1 --2- 172.21.15.100:0/2351422656 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa0080adcf0 0x7fa00806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.827+0000 7fa00d400640 1 -- 172.21.15.100:0/2351422656 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa0080adcf0 msgr2=0x7fa00806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.827+0000 7fa00d400640 1 --2- 172.21.15.100:0/2351422656 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa0080adcf0 0x7fa00806c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.827+0000 7fa00d400640 1 -- 172.21.15.100:0/2351422656 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa008156c50 msgr2=0x7fa0080c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:07.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.827+0000 7fa00d400640 1 --2- 172.21.15.100:0/2351422656 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa008156c50 0x7fa0080c7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:07.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.827+0000 7fa00d400640 1 -- 172.21.15.100:0/2351422656 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff4009390 con 0x7fa0080abb00 2024-08-17T02:46:07.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.827+0000 7fa00d400640 1 --2- 172.21.15.100:0/2351422656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0080abb00 0x7fa008159a40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc00c5b0 tx=0x7f9ffc007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:07.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.828+0000 7fa004c00640 1 -- 172.21.15.100:0/2351422656 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc007300 con 0x7fa0080abb00 2024-08-17T02:46:07.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.828+0000 7fa004c00640 1 -- 172.21.15.100:0/2351422656 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ffc0074a0 con 0x7fa0080abb00 2024-08-17T02:46:07.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.828+0000 7fa004c00640 1 -- 172.21.15.100:0/2351422656 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc0049f0 con 0x7fa0080abb00 2024-08-17T02:46:07.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.828+0000 7fa00fe00640 1 -- 172.21.15.100:0/2351422656 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00806d180 con 0x7fa0080abb00 2024-08-17T02:46:07.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.828+0000 7fa00fe00640 1 -- 172.21.15.100:0/2351422656 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00806d740 con 0x7fa0080abb00 2024-08-17T02:46:07.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.829+0000 7fa00fe00640 1 -- 172.21.15.100:0/2351422656 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa008071050 con 0x7fa0080abb00 2024-08-17T02:46:07.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.830+0000 7fa004c00640 1 -- 172.21.15.100:0/2351422656 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9ffc01c3b0 con 0x7fa0080abb00 2024-08-17T02:46:07.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.830+0000 7fa004c00640 1 --2- 172.21.15.100:0/2351422656 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9fe8065150 0x7f9fe8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:07.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.830+0000 7fa004c00640 1 -- 172.21.15.100:0/2351422656 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9ffc081780 con 0x7fa0080abb00 2024-08-17T02:46:07.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.831+0000 7fa00ca00640 1 --2- 172.21.15.100:0/2351422656 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9fe8065150 0x7f9fe8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:07.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.831+0000 7fa00ca00640 1 --2- 172.21.15.100:0/2351422656 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9fe8065150 0x7f9fe8067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4034000 tx=0x7f9ff4032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:07.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:07.835+0000 7fa004c00640 1 -- 172.21.15.100:0/2351422656 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9ffc04ce40 con 0x7fa0080abb00 2024-08-17T02:46:08.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.005+0000 7fa00fe00640 1 -- 172.21.15.100:0/2351422656 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa008153850 con 0x7fa0080abb00 2024-08-17T02:46:08.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.006+0000 7fa004c00640 1 -- 172.21.15.100:0/2351422656 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9ffc04f8f0 con 0x7fa0080abb00 2024-08-17T02:46:08.007 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-08-17T02:46:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.008+0000 7fa00fe00640 1 -- 172.21.15.100:0/2351422656 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9fe8065150 msgr2=0x7f9fe8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.008+0000 7fa00fe00640 1 --2- 172.21.15.100:0/2351422656 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9fe8065150 0x7f9fe8067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4034000 tx=0x7f9ff4032000 comp rx=0 tx=0).stop 2024-08-17T02:46:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.008+0000 7fa00fe00640 1 -- 172.21.15.100:0/2351422656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0080abb00 msgr2=0x7fa008159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.008+0000 7fa00fe00640 1 --2- 172.21.15.100:0/2351422656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0080abb00 0x7fa008159a40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc00c5b0 tx=0x7f9ffc007f20 comp rx=0 tx=0).stop 2024-08-17T02:46:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.008+0000 7fa00fe00640 1 -- 172.21.15.100:0/2351422656 shutdown_connections 2024-08-17T02:46:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.008+0000 7fa00fe00640 1 --2- 172.21.15.100:0/2351422656 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9fe8065150 0x7f9fe8067600 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.008+0000 7fa00fe00640 1 --2- 172.21.15.100:0/2351422656 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa008156c50 0x7fa0080c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.008+0000 7fa00fe00640 1 --2- 172.21.15.100:0/2351422656 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa0080adcf0 0x7fa00806c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.008+0000 7fa00fe00640 1 --2- 172.21.15.100:0/2351422656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0080abb00 0x7fa008159a40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.008+0000 7fa00fe00640 1 -- 172.21.15.100:0/2351422656 >> 172.21.15.100:0/2351422656 conn(0x7fa008067750 msgr2=0x7fa008154790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:08.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.008+0000 7fa00fe00640 1 -- 172.21.15.100:0/2351422656 shutdown_connections 2024-08-17T02:46:08.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.008+0000 7fa00fe00640 1 -- 172.21.15.100:0/2351422656 wait complete. 2024-08-17T02:46:08.024 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:08.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.172+0000 7f145aa00640 1 Processor -- start 2024-08-17T02:46:08.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.173+0000 7f145aa00640 1 -- start start 2024-08-17T02:46:08.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.174+0000 7f145aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1454140580 0x7f14540c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:08.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.174+0000 7f145aa00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14540caa80 con 0x7f14540b1440 2024-08-17T02:46:08.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.174+0000 7f145aa00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14540c9e70 con 0x7f14541401b0 2024-08-17T02:46:08.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.174+0000 7f145aa00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14540c9c90 con 0x7f1454140580 2024-08-17T02:46:08.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.174+0000 7f1453400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f14540b1440 0x7f14540c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45468/0 (socket says 172.21.15.100:45468) 2024-08-17T02:46:08.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.174+0000 7f1453400640 1 -- 172.21.15.100:0/2001597679 learned_addr learned my addr 172.21.15.100:0/2001597679 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:08.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.174+0000 7f1458a00640 1 --2- 172.21.15.100:0/2001597679 >> v2:172.21.15.100:3300/0 conn(0x7f1454140580 0x7f14540c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:08.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.174+0000 7f1452a00640 1 -- 172.21.15.100:0/2001597679 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465666118 0 0) 0x7f14540caa80 con 0x7f14540b1440 2024-08-17T02:46:08.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.175+0000 7f1452a00640 1 -- 172.21.15.100:0/2001597679 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14380034e0 con 0x7f14540b1440 2024-08-17T02:46:08.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.175+0000 7f1458a00640 1 -- 172.21.15.100:0/2001597679 >> v1:172.21.15.123:6789/0 conn(0x7f14541401b0 legacy=0x7f14540b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:08.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.175+0000 7f1458a00640 1 -- 172.21.15.100:0/2001597679 >> v1:172.21.15.100:6789/0 conn(0x7f14540b1440 legacy=0x7f14540c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:08.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.175+0000 7f1458a00640 1 -- 172.21.15.100:0/2001597679 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14540ca150 con 0x7f1454140580 2024-08-17T02:46:08.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.176+0000 7f1458a00640 1 --2- 172.21.15.100:0/2001597679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1454140580 0x7f14540c9750 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f144c009e60 tx=0x7f144c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991e2e26b45c871 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:08.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.179+0000 7f1452a00640 1 -- 172.21.15.100:0/2001597679 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c007550 con 0x7f1454140580 2024-08-17T02:46:08.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.179+0000 7f1452a00640 1 -- 172.21.15.100:0/2001597679 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144c02d050 con 0x7f1454140580 2024-08-17T02:46:08.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.179+0000 7f1452a00640 1 -- 172.21.15.100:0/2001597679 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c0078c0 con 0x7f1454140580 2024-08-17T02:46:08.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.180+0000 7f145aa00640 1 -- 172.21.15.100:0/2001597679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1454140580 msgr2=0x7f14540c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:08.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.180+0000 7f145aa00640 1 --2- 172.21.15.100:0/2001597679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1454140580 0x7f14540c9750 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f144c009e60 tx=0x7f144c009780 comp rx=0 tx=0).stop 2024-08-17T02:46:08.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.180+0000 7f145aa00640 1 -- 172.21.15.100:0/2001597679 shutdown_connections 2024-08-17T02:46:08.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.180+0000 7f145aa00640 1 --2- 172.21.15.100:0/2001597679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1454140580 0x7f14540c9750 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.180+0000 7f145aa00640 1 -- 172.21.15.100:0/2001597679 >> 172.21.15.100:0/2001597679 conn(0x7f14540cb9b0 msgr2=0x7f14540cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:08.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.180+0000 7f145aa00640 1 -- 172.21.15.100:0/2001597679 shutdown_connections 2024-08-17T02:46:08.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.180+0000 7f145aa00640 1 -- 172.21.15.100:0/2001597679 wait complete. 2024-08-17T02:46:08.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.181+0000 7f145aa00640 1 Processor -- start 2024-08-17T02:46:08.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.182+0000 7f145aa00640 1 -- start start 2024-08-17T02:46:08.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.182+0000 7f145aa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14540b1440 0x7f14541570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:08.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.182+0000 7f145aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14541401b0 0x7f145415cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:08.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.182+0000 7f145aa00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1454140580 0x7f14541594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:08.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.182+0000 7f145aa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1454158910 con 0x7f14541401b0 2024-08-17T02:46:08.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.182+0000 7f145aa00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1454158480 con 0x7f14540b1440 2024-08-17T02:46:08.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.182+0000 7f145aa00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1454157610 con 0x7f1454140580 2024-08-17T02:46:08.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.183+0000 7f1453400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14541401b0 0x7f145415cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:08.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.183+0000 7f1453400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14541401b0 0x7f145415cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45050/0 (socket says 172.21.15.100:45050) 2024-08-17T02:46:08.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.183+0000 7f1453400640 1 -- 172.21.15.100:0/1742781473 learned_addr learned my addr 172.21.15.100:0/1742781473 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:08.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.183+0000 7f1453e00640 1 --2- 172.21.15.100:0/1742781473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14540b1440 0x7f14541570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:08.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.183+0000 7f1458a00640 1 --2- 172.21.15.100:0/1742781473 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1454140580 0x7f14541594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:08.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.183+0000 7f1453400640 1 -- 172.21.15.100:0/1742781473 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1454140580 msgr2=0x7f14541594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:08.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.183+0000 7f1453400640 1 --2- 172.21.15.100:0/1742781473 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1454140580 0x7f14541594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.183+0000 7f1453400640 1 -- 172.21.15.100:0/1742781473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14540b1440 msgr2=0x7f14541570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:08.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.183+0000 7f1453400640 1 --2- 172.21.15.100:0/1742781473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14540b1440 0x7f14541570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.183+0000 7f1453400640 1 -- 172.21.15.100:0/1742781473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144c009a20 con 0x7f14541401b0 2024-08-17T02:46:08.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.184+0000 7f1453400640 1 --2- 172.21.15.100:0/1742781473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14541401b0 0x7f145415cb60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f144000c5b0 tx=0x7f1440007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:08.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.184+0000 7f144b400640 1 -- 172.21.15.100:0/1742781473 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1440005b70 con 0x7f14541401b0 2024-08-17T02:46:08.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.184+0000 7f144b400640 1 -- 172.21.15.100:0/1742781473 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1440005cf0 con 0x7f14541401b0 2024-08-17T02:46:08.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.184+0000 7f144b400640 1 -- 172.21.15.100:0/1742781473 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1440007340 con 0x7f14541401b0 2024-08-17T02:46:08.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.184+0000 7f145aa00640 1 -- 172.21.15.100:0/1742781473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1454157870 con 0x7f14541401b0 2024-08-17T02:46:08.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.184+0000 7f145aa00640 1 -- 172.21.15.100:0/1742781473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1454157e30 con 0x7f14541401b0 2024-08-17T02:46:08.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.185+0000 7f145aa00640 1 -- 172.21.15.100:0/1742781473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1454064db0 con 0x7f14541401b0 2024-08-17T02:46:08.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.186+0000 7f144b400640 1 -- 172.21.15.100:0/1742781473 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f144001b400 con 0x7f14541401b0 2024-08-17T02:46:08.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.187+0000 7f144b400640 1 --2- 172.21.15.100:0/1742781473 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1434065150 0x7f1434067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:08.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.187+0000 7f144b400640 1 -- 172.21.15.100:0/1742781473 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1440081ed0 con 0x7f14541401b0 2024-08-17T02:46:08.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.187+0000 7f1453e00640 1 --2- 172.21.15.100:0/1742781473 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1434065150 0x7f1434067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:08.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.188+0000 7f1453e00640 1 --2- 172.21.15.100:0/1742781473 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1434065150 0x7f1434067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1444007fd0 tx=0x7f1444000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:08.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.191+0000 7f144b400640 1 -- 172.21.15.100:0/1742781473 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1440050020 con 0x7f14541401b0 2024-08-17T02:46:08.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.362+0000 7f145aa00640 1 -- 172.21.15.100:0/1742781473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f145406d300 con 0x7f14541401b0 2024-08-17T02:46:08.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.363+0000 7f144b400640 1 -- 172.21.15.100:0/1742781473 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f1440053640 con 0x7f14541401b0 2024-08-17T02:46:08.364 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:08.364 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:42.845503+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:45:39.036964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:45:40.232954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:08.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.365+0000 7f145aa00640 1 -- 172.21.15.100:0/1742781473 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1434065150 msgr2=0x7f1434067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:08.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.365+0000 7f145aa00640 1 --2- 172.21.15.100:0/1742781473 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1434065150 0x7f1434067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1444007fd0 tx=0x7f1444000bc0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.365+0000 7f145aa00640 1 -- 172.21.15.100:0/1742781473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14541401b0 msgr2=0x7f145415cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:08.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.365+0000 7f145aa00640 1 --2- 172.21.15.100:0/1742781473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14541401b0 0x7f145415cb60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f144000c5b0 tx=0x7f1440007d70 comp rx=0 tx=0).stop 2024-08-17T02:46:08.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.365+0000 7f145aa00640 1 -- 172.21.15.100:0/1742781473 shutdown_connections 2024-08-17T02:46:08.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.365+0000 7f145aa00640 1 --2- 172.21.15.100:0/1742781473 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1434065150 0x7f1434067600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.365+0000 7f145aa00640 1 --2- 172.21.15.100:0/1742781473 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1454140580 0x7f14541594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.365+0000 7f145aa00640 1 --2- 172.21.15.100:0/1742781473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14541401b0 0x7f145415cb60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.365+0000 7f145aa00640 1 --2- 172.21.15.100:0/1742781473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14540b1440 0x7f14541570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.365+0000 7f145aa00640 1 -- 172.21.15.100:0/1742781473 >> 172.21.15.100:0/1742781473 conn(0x7f14540cb9b0 msgr2=0x7f14540af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:08.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.365+0000 7f145aa00640 1 -- 172.21.15.100:0/1742781473 shutdown_connections 2024-08-17T02:46:08.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.365+0000 7f145aa00640 1 -- 172.21.15.100:0/1742781473 wait complete. 2024-08-17T02:46:08.381 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:45:35.140990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:45:39.036964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:45:40.232954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:46:08.381 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:08.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.530+0000 7fc22d400640 1 Processor -- start 2024-08-17T02:46:08.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.530+0000 7fc22d400640 1 -- start start 2024-08-17T02:46:08.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.531+0000 7fc22d400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2280afd90 0x7fc2280b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:08.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.531+0000 7fc22d400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc228159610 0x7fc228157690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:08.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.531+0000 7fc22d400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2280ae540 con 0x7fc2280accf0 2024-08-17T02:46:08.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.531+0000 7fc22d400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2280ad930 con 0x7fc228159610 2024-08-17T02:46:08.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.531+0000 7fc22d400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2280adc10 con 0x7fc2280afd90 2024-08-17T02:46:08.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.532+0000 7fc226800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc2280accf0 0x7fc2280af680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45478/0 (socket says 172.21.15.100:45478) 2024-08-17T02:46:08.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.532+0000 7fc226800640 1 -- 172.21.15.100:0/4171270236 learned_addr learned my addr 172.21.15.100:0/4171270236 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:08.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.532+0000 7fc227200640 1 --2- 172.21.15.100:0/4171270236 >> v2:172.21.15.123:3300/0 conn(0x7fc228159610 0x7fc228157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:08.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.532+0000 7fc21de00640 1 --2- 172.21.15.100:0/4171270236 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2280afd90 0x7fc2280b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:08.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.532+0000 7fc225e00640 1 -- 172.21.15.100:0/4171270236 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169067167 0 0) 0x7fc2280ae540 con 0x7fc2280accf0 2024-08-17T02:46:08.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.532+0000 7fc225e00640 1 -- 172.21.15.100:0/4171270236 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc20c0034e0 con 0x7fc2280accf0 2024-08-17T02:46:08.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.532+0000 7fc227200640 1 -- 172.21.15.100:0/4171270236 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2280afd90 msgr2=0x7fc2280b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:08.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.532+0000 7fc227200640 1 --2- 172.21.15.100:0/4171270236 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2280afd90 0x7fc2280b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.532+0000 7fc227200640 1 -- 172.21.15.100:0/4171270236 >> v1:172.21.15.100:6789/0 conn(0x7fc2280accf0 legacy=0x7fc2280af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:08.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.532+0000 7fc227200640 1 -- 172.21.15.100:0/4171270236 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2280adef0 con 0x7fc228159610 2024-08-17T02:46:08.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.534+0000 7fc227200640 1 --2- 172.21.15.100:0/4171270236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc228159610 0x7fc228157690 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc220009e60 tx=0x7fc220009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71881f9e7988fc04 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:08.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.534+0000 7fc225e00640 1 -- 172.21.15.100:0/4171270236 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220007550 con 0x7fc228159610 2024-08-17T02:46:08.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.534+0000 7fc225e00640 1 -- 172.21.15.100:0/4171270236 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22002d050 con 0x7fc228159610 2024-08-17T02:46:08.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.534+0000 7fc225e00640 1 -- 172.21.15.100:0/4171270236 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220007900 con 0x7fc228159610 2024-08-17T02:46:08.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.534+0000 7fc22d400640 1 -- 172.21.15.100:0/4171270236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc228159610 msgr2=0x7fc228157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:08.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.534+0000 7fc22d400640 1 --2- 172.21.15.100:0/4171270236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc228159610 0x7fc228157690 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc220009e60 tx=0x7fc220009780 comp rx=0 tx=0).stop 2024-08-17T02:46:08.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.534+0000 7fc22d400640 1 -- 172.21.15.100:0/4171270236 shutdown_connections 2024-08-17T02:46:08.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.534+0000 7fc22d400640 1 --2- 172.21.15.100:0/4171270236 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2280afd90 0x7fc2280b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.535+0000 7fc22d400640 1 --2- 172.21.15.100:0/4171270236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc228159610 0x7fc228157690 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.535+0000 7fc22d400640 1 -- 172.21.15.100:0/4171270236 >> 172.21.15.100:0/4171270236 conn(0x7fc228067750 msgr2=0x7fc2280cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:08.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.535+0000 7fc22d400640 1 -- 172.21.15.100:0/4171270236 shutdown_connections 2024-08-17T02:46:08.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.535+0000 7fc22d400640 1 -- 172.21.15.100:0/4171270236 wait complete. 2024-08-17T02:46:08.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.536+0000 7fc22d400640 1 Processor -- start 2024-08-17T02:46:08.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.536+0000 7fc22d400640 1 -- start start 2024-08-17T02:46:08.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.537+0000 7fc22d400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2280accf0 0x7fc22816be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:08.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.537+0000 7fc22d400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2280afd90 0x7fc228168f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:08.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.537+0000 7fc22d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc228159610 0x7fc2280ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:08.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.537+0000 7fc22d400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2280abd50 con 0x7fc228159610 2024-08-17T02:46:08.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.537+0000 7fc22d400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc228153f20 con 0x7fc2280accf0 2024-08-17T02:46:08.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.537+0000 7fc22d400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc228154200 con 0x7fc2280afd90 2024-08-17T02:46:08.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.537+0000 7fc227200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc228159610 0x7fc2280ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:08.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.537+0000 7fc227200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc228159610 0x7fc2280ab390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45064/0 (socket says 172.21.15.100:45064) 2024-08-17T02:46:08.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.537+0000 7fc227200640 1 -- 172.21.15.100:0/1171768309 learned_addr learned my addr 172.21.15.100:0/1171768309 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:08.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.537+0000 7fc226800640 1 --2- 172.21.15.100:0/1171768309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2280accf0 0x7fc22816be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:08.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.538+0000 7fc21de00640 1 --2- 172.21.15.100:0/1171768309 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2280afd90 0x7fc228168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:08.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.538+0000 7fc227200640 1 -- 172.21.15.100:0/1171768309 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2280afd90 msgr2=0x7fc228168f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:08.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.538+0000 7fc227200640 1 --2- 172.21.15.100:0/1171768309 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2280afd90 0x7fc228168f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.538+0000 7fc227200640 1 -- 172.21.15.100:0/1171768309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2280accf0 msgr2=0x7fc22816be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:08.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.538+0000 7fc227200640 1 --2- 172.21.15.100:0/1171768309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2280accf0 0x7fc22816be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.538+0000 7fc227200640 1 -- 172.21.15.100:0/1171768309 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc220009a20 con 0x7fc228159610 2024-08-17T02:46:08.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.538+0000 7fc227200640 1 --2- 172.21.15.100:0/1171768309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc228159610 0x7fc2280ab390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc2200097c0 tx=0x7fc220037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:08.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.538+0000 7fc21ea00640 1 -- 172.21.15.100:0/1171768309 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220031ac0 con 0x7fc228159610 2024-08-17T02:46:08.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.538+0000 7fc21ea00640 1 -- 172.21.15.100:0/1171768309 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc220031c40 con 0x7fc228159610 2024-08-17T02:46:08.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.538+0000 7fc22d400640 1 -- 172.21.15.100:0/1171768309 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2281544e0 con 0x7fc228159610 2024-08-17T02:46:08.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.538+0000 7fc21ea00640 1 -- 172.21.15.100:0/1171768309 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22003c420 con 0x7fc228159610 2024-08-17T02:46:08.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.538+0000 7fc22d400640 1 -- 172.21.15.100:0/1171768309 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc228169450 con 0x7fc228159610 2024-08-17T02:46:08.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.539+0000 7fc22d400640 1 -- 172.21.15.100:0/1171768309 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc228064db0 con 0x7fc228159610 2024-08-17T02:46:08.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.540+0000 7fc21ea00640 1 -- 172.21.15.100:0/1171768309 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc220003040 con 0x7fc228159610 2024-08-17T02:46:08.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.541+0000 7fc21ea00640 1 --2- 172.21.15.100:0/1171768309 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc204065150 0x7fc204067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:08.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.541+0000 7fc21ea00640 1 -- 172.21.15.100:0/1171768309 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc2200a3a70 con 0x7fc228159610 2024-08-17T02:46:08.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.541+0000 7fc226800640 1 --2- 172.21.15.100:0/1171768309 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc204065150 0x7fc204067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:08.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.542+0000 7fc226800640 1 --2- 172.21.15.100:0/1171768309 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc204065150 0x7fc204067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc218005840 tx=0x7fc218009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:08.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.545+0000 7fc21ea00640 1 -- 172.21.15.100:0/1171768309 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc220071b40 con 0x7fc228159610 2024-08-17T02:46:08.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.716+0000 7fc22d400640 1 -- 172.21.15.100:0/1171768309 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc2280cc480 con 0x7fc228159610 2024-08-17T02:46:08.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.716+0000 7fc21ea00640 1 -- 172.21.15.100:0/1171768309 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc220075160 con 0x7fc228159610 2024-08-17T02:46:08.717 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-08-17T02:46:08.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.718+0000 7fc22d400640 1 -- 172.21.15.100:0/1171768309 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc204065150 msgr2=0x7fc204067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:08.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.718+0000 7fc22d400640 1 --2- 172.21.15.100:0/1171768309 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc204065150 0x7fc204067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc218005840 tx=0x7fc218009040 comp rx=0 tx=0).stop 2024-08-17T02:46:08.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.718+0000 7fc22d400640 1 -- 172.21.15.100:0/1171768309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc228159610 msgr2=0x7fc2280ab390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:08.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.718+0000 7fc22d400640 1 --2- 172.21.15.100:0/1171768309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc228159610 0x7fc2280ab390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc2200097c0 tx=0x7fc220037000 comp rx=0 tx=0).stop 2024-08-17T02:46:08.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.719+0000 7fc22d400640 1 -- 172.21.15.100:0/1171768309 shutdown_connections 2024-08-17T02:46:08.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.719+0000 7fc22d400640 1 --2- 172.21.15.100:0/1171768309 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc204065150 0x7fc204067600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.719+0000 7fc22d400640 1 --2- 172.21.15.100:0/1171768309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc228159610 0x7fc2280ab390 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.719+0000 7fc22d400640 1 --2- 172.21.15.100:0/1171768309 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc2280afd90 0x7fc228168f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.719+0000 7fc22d400640 1 --2- 172.21.15.100:0/1171768309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2280accf0 0x7fc22816be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.719+0000 7fc22d400640 1 -- 172.21.15.100:0/1171768309 >> 172.21.15.100:0/1171768309 conn(0x7fc228067750 msgr2=0x7fc22806df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:08.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.719+0000 7fc22d400640 1 -- 172.21.15.100:0/1171768309 shutdown_connections 2024-08-17T02:46:08.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.719+0000 7fc22d400640 1 -- 172.21.15.100:0/1171768309 wait complete. 2024-08-17T02:46:08.734 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:46:08.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.886+0000 7f45c3e00640 1 Processor -- start 2024-08-17T02:46:08.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.887+0000 7f45c3e00640 1 -- start start 2024-08-17T02:46:08.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.888+0000 7f45c3e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45c40ae540 0x7f45c40ae910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:08.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.888+0000 7f45c3e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c40ab790 con 0x7f45c40acc30 2024-08-17T02:46:08.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.888+0000 7f45c3e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c4068b50 con 0x7f45c40af0f0 2024-08-17T02:46:08.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.888+0000 7f45c3e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c40aee50 con 0x7f45c40ae540 2024-08-17T02:46:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.888+0000 7f45c3400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f45c40acc30 0x7f45c4068440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45484/0 (socket says 172.21.15.100:45484) 2024-08-17T02:46:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.888+0000 7f45c3400640 1 -- 172.21.15.100:0/4232715016 learned_addr learned my addr 172.21.15.100:0/4232715016 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.888+0000 7f45c2a00640 1 --2- 172.21.15.100:0/4232715016 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45c40ae540 0x7f45c40ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.889+0000 7f45c2000640 1 -- 172.21.15.100:0/4232715016 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478604856 0 0) 0x7f45c40ab790 con 0x7f45c40acc30 2024-08-17T02:46:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.889+0000 7f45c2000640 1 -- 172.21.15.100:0/4232715016 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45a80034e0 con 0x7f45c40acc30 2024-08-17T02:46:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.889+0000 7f45c2000640 1 -- 172.21.15.100:0/4232715016 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378737544 0 0) 0x7f45c4068b50 con 0x7f45c40af0f0 2024-08-17T02:46:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.889+0000 7f45c2000640 1 -- 172.21.15.100:0/4232715016 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45c40ab790 con 0x7f45c40af0f0 2024-08-17T02:46:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.889+0000 7f45c2a00640 1 -- 172.21.15.100:0/4232715016 >> v1:172.21.15.123:6789/0 conn(0x7f45c40af0f0 legacy=0x7f45c4067d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.889+0000 7f45c2a00640 1 -- 172.21.15.100:0/4232715016 >> v1:172.21.15.100:6789/0 conn(0x7f45c40acc30 legacy=0x7f45c4068440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.889+0000 7f45c2a00640 1 -- 172.21.15.100:0/4232715016 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c40aab80 con 0x7f45c40ae540 2024-08-17T02:46:08.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.890+0000 7f45c2a00640 1 --2- 172.21.15.100:0/4232715016 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45c40ae540 0x7f45c40ae910 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009880 tx=0x7f45b40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d8b5c98daab6f2f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:08.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.890+0000 7f45c2000640 1 -- 172.21.15.100:0/4232715016 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b402ae10 con 0x7f45c40ae540 2024-08-17T02:46:08.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.890+0000 7f45c2000640 1 -- 172.21.15.100:0/4232715016 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b4032440 con 0x7f45c40ae540 2024-08-17T02:46:08.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.890+0000 7f45c2000640 1 -- 172.21.15.100:0/4232715016 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b40327c0 con 0x7f45c40ae540 2024-08-17T02:46:08.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.891+0000 7f45c3e00640 1 -- 172.21.15.100:0/4232715016 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45c40ae540 msgr2=0x7f45c40ae910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:08.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.891+0000 7f45c3e00640 1 --2- 172.21.15.100:0/4232715016 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45c40ae540 0x7f45c40ae910 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009880 tx=0x7f45b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.891+0000 7f45c3e00640 1 -- 172.21.15.100:0/4232715016 shutdown_connections 2024-08-17T02:46:08.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.891+0000 7f45c3e00640 1 --2- 172.21.15.100:0/4232715016 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45c40ae540 0x7f45c40ae910 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.891+0000 7f45c3e00640 1 -- 172.21.15.100:0/4232715016 >> 172.21.15.100:0/4232715016 conn(0x7f45c4096a70 msgr2=0x7f45c4096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:08.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.891+0000 7f45c3e00640 1 -- 172.21.15.100:0/4232715016 shutdown_connections 2024-08-17T02:46:08.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.891+0000 7f45c3e00640 1 -- 172.21.15.100:0/4232715016 wait complete. 2024-08-17T02:46:08.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.893+0000 7f45c3e00640 1 Processor -- start 2024-08-17T02:46:08.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.893+0000 7f45c3e00640 1 -- start start 2024-08-17T02:46:08.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.894+0000 7f45c3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40acc30 0x7f45c409ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:08.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.894+0000 7f45c3e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45c40ae540 0x7f45c409b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:08.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.894+0000 7f45c3e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45c40af0f0 0x7f45c416c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:08.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.894+0000 7f45c3e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c40c9400 con 0x7f45c40acc30 2024-08-17T02:46:08.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.894+0000 7f45c3e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c416c780 con 0x7f45c40af0f0 2024-08-17T02:46:08.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.894+0000 7f45c3e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c40c87f0 con 0x7f45c40ae540 2024-08-17T02:46:08.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.894+0000 7f45c2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40acc30 0x7f45c409ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:08.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.894+0000 7f45c2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40acc30 0x7f45c409ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45072/0 (socket says 172.21.15.100:45072) 2024-08-17T02:46:08.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.894+0000 7f45c2a00640 1 -- 172.21.15.100:0/815169004 learned_addr learned my addr 172.21.15.100:0/815169004 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:08.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.894+0000 7f45c3400640 1 --2- 172.21.15.100:0/815169004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45c40af0f0 0x7f45c416c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:08.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.894+0000 7f45ba000640 1 --2- 172.21.15.100:0/815169004 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45c40ae540 0x7f45c409b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:08.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.894+0000 7f45c2a00640 1 -- 172.21.15.100:0/815169004 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45c40ae540 msgr2=0x7f45c409b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:08.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.894+0000 7f45c2a00640 1 --2- 172.21.15.100:0/815169004 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45c40ae540 0x7f45c409b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.894+0000 7f45c2a00640 1 -- 172.21.15.100:0/815169004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45c40af0f0 msgr2=0x7f45c416c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:08.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.894+0000 7f45c2a00640 1 --2- 172.21.15.100:0/815169004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45c40af0f0 0x7f45c416c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:08.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.894+0000 7f45c2a00640 1 -- 172.21.15.100:0/815169004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b4009390 con 0x7f45c40acc30 2024-08-17T02:46:08.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.895+0000 7f45c2a00640 1 --2- 172.21.15.100:0/815169004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40acc30 0x7f45c409ae50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009880 tx=0x7f45b4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:08.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.895+0000 7f45baa00640 1 -- 172.21.15.100:0/815169004 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b4031880 con 0x7f45c40acc30 2024-08-17T02:46:08.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.895+0000 7f45baa00640 1 -- 172.21.15.100:0/815169004 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b4031a00 con 0x7f45c40acc30 2024-08-17T02:46:08.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.895+0000 7f45baa00640 1 -- 172.21.15.100:0/815169004 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b4031dc0 con 0x7f45c40acc30 2024-08-17T02:46:08.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.895+0000 7f45c3e00640 1 -- 172.21.15.100:0/815169004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c40c8ad0 con 0x7f45c40acc30 2024-08-17T02:46:08.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.895+0000 7f45c3e00640 1 -- 172.21.15.100:0/815169004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c40c9090 con 0x7f45c40acc30 2024-08-17T02:46:08.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.897+0000 7f45c3e00640 1 -- 172.21.15.100:0/815169004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c4071050 con 0x7f45c40acc30 2024-08-17T02:46:08.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.897+0000 7f45baa00640 1 -- 172.21.15.100:0/815169004 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f45b403c400 con 0x7f45c40acc30 2024-08-17T02:46:08.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.898+0000 7f45baa00640 1 --2- 172.21.15.100:0/815169004 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f45a0065150 0x7f45a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:08.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.898+0000 7f45baa00640 1 -- 172.21.15.100:0/815169004 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45b40a2560 con 0x7f45c40acc30 2024-08-17T02:46:08.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.898+0000 7f45ba000640 1 --2- 172.21.15.100:0/815169004 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f45a0065150 0x7f45a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:08.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.899+0000 7f45ba000640 1 --2- 172.21.15.100:0/815169004 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f45a0065150 0x7f45a0067600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f45c4155f00 tx=0x7f45ac007ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:08.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:08.902+0000 7f45baa00640 1 -- 172.21.15.100:0/815169004 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f45b4070630 con 0x7f45c40acc30 2024-08-17T02:46:09.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.077+0000 7f45c3e00640 1 -- 172.21.15.100:0/815169004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45c4157f80 con 0x7f45c40acc30 2024-08-17T02:46:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.077+0000 7f45baa00640 1 -- 172.21.15.100:0/815169004 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45b4073c50 con 0x7f45c40acc30 2024-08-17T02:46:09.078 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-08-17T02:46:09.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.079+0000 7f45c3e00640 1 -- 172.21.15.100:0/815169004 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f45a0065150 msgr2=0x7f45a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.079+0000 7f45c3e00640 1 --2- 172.21.15.100:0/815169004 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f45a0065150 0x7f45a0067600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f45c4155f00 tx=0x7f45ac007ca0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.079+0000 7f45c3e00640 1 -- 172.21.15.100:0/815169004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40acc30 msgr2=0x7f45c409ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.079+0000 7f45c3e00640 1 --2- 172.21.15.100:0/815169004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40acc30 0x7f45c409ae50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009880 tx=0x7f45b4032000 comp rx=0 tx=0).stop 2024-08-17T02:46:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.079+0000 7f45c3e00640 1 -- 172.21.15.100:0/815169004 shutdown_connections 2024-08-17T02:46:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.079+0000 7f45c3e00640 1 --2- 172.21.15.100:0/815169004 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f45a0065150 0x7f45a0067600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.079+0000 7f45c3e00640 1 --2- 172.21.15.100:0/815169004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45c40af0f0 0x7f45c416c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.079+0000 7f45c3e00640 1 --2- 172.21.15.100:0/815169004 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45c40ae540 0x7f45c409b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.079+0000 7f45c3e00640 1 --2- 172.21.15.100:0/815169004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40acc30 0x7f45c409ae50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.079+0000 7f45c3e00640 1 -- 172.21.15.100:0/815169004 >> 172.21.15.100:0/815169004 conn(0x7f45c4096a70 msgr2=0x7f45c40b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.080+0000 7f45c3e00640 1 -- 172.21.15.100:0/815169004 shutdown_connections 2024-08-17T02:46:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.080+0000 7f45c3e00640 1 -- 172.21.15.100:0/815169004 wait complete. 2024-08-17T02:46:09.095 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:46:09.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.246+0000 7f652fe00640 1 Processor -- start 2024-08-17T02:46:09.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.246+0000 7f652fe00640 1 -- start start 2024-08-17T02:46:09.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.247+0000 7f652fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f65300c4a20 0x7f65300ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.247+0000 7f652fe00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65300c61d0 con 0x7f6530158a30 2024-08-17T02:46:09.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.247+0000 7f652fe00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65300c64b0 con 0x7f6530158e00 2024-08-17T02:46:09.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.247+0000 7f652fe00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65300c5fe0 con 0x7f65300c4a20 2024-08-17T02:46:09.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.247+0000 7f652e000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f65300c4a20 0x7f65300ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.248+0000 7f652e000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f65300c4a20 0x7f65300ce180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45088/0 (socket says 172.21.15.100:45088) 2024-08-17T02:46:09.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.247+0000 7f652ea00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6530158a30 0x7f65300c58d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45490/0 (socket says 172.21.15.100:45490) 2024-08-17T02:46:09.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.248+0000 7f652e000640 1 -- 172.21.15.100:0/4181382985 learned_addr learned my addr 172.21.15.100:0/4181382985 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:09.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.248+0000 7f652e000640 1 -- 172.21.15.100:0/4181382985 >> v1:172.21.15.123:6789/0 conn(0x7f6530158e00 legacy=0x7f65300cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:09.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.248+0000 7f652e000640 1 -- 172.21.15.100:0/4181382985 >> v1:172.21.15.100:6789/0 conn(0x7f6530158a30 legacy=0x7f65300c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.248+0000 7f652e000640 1 -- 172.21.15.100:0/4181382985 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65300c6790 con 0x7f65300c4a20 2024-08-17T02:46:09.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.249+0000 7f652e000640 1 --2- 172.21.15.100:0/4181382985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65300c4a20 0x7f65300ce180 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f651c009910 tx=0x7f651c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b4792f0c317e3b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:09.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.249+0000 7f652d600640 1 -- 172.21.15.100:0/4181382985 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c02ade0 con 0x7f65300c4a20 2024-08-17T02:46:09.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.249+0000 7f652d600640 1 -- 172.21.15.100:0/4181382985 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651c032440 con 0x7f65300c4a20 2024-08-17T02:46:09.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.249+0000 7f652d600640 1 -- 172.21.15.100:0/4181382985 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c032820 con 0x7f65300c4a20 2024-08-17T02:46:09.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.250+0000 7f652fe00640 1 -- 172.21.15.100:0/4181382985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65300c4a20 msgr2=0x7f65300ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.250+0000 7f652fe00640 1 --2- 172.21.15.100:0/4181382985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65300c4a20 0x7f65300ce180 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f651c009910 tx=0x7f651c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.250+0000 7f652fe00640 1 -- 172.21.15.100:0/4181382985 shutdown_connections 2024-08-17T02:46:09.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.250+0000 7f652fe00640 1 --2- 172.21.15.100:0/4181382985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65300c4a20 0x7f65300ce180 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.250+0000 7f652fe00640 1 -- 172.21.15.100:0/4181382985 >> 172.21.15.100:0/4181382985 conn(0x7f6530098e30 msgr2=0x7f653006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:09.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.250+0000 7f652fe00640 1 -- 172.21.15.100:0/4181382985 shutdown_connections 2024-08-17T02:46:09.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.250+0000 7f652fe00640 1 -- 172.21.15.100:0/4181382985 wait complete. 2024-08-17T02:46:09.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.251+0000 7f652fe00640 1 Processor -- start 2024-08-17T02:46:09.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.251+0000 7f652fe00640 1 -- start start 2024-08-17T02:46:09.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.252+0000 7f652fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65300c4a20 0x7f6530146540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.252+0000 7f652fe00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6530158a30 0x7f653009cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.252+0000 7f652fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6530158e00 0x7f653009aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.252+0000 7f652fe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65300997a0 con 0x7f6530158e00 2024-08-17T02:46:09.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.252+0000 7f652fe00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65300999b0 con 0x7f65300c4a20 2024-08-17T02:46:09.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.252+0000 7f652fe00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6530099c90 con 0x7f6530158a30 2024-08-17T02:46:09.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.252+0000 7f652f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6530158e00 0x7f653009aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.252+0000 7f652f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6530158e00 0x7f653009aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45100/0 (socket says 172.21.15.100:45100) 2024-08-17T02:46:09.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.252+0000 7f652f400640 1 -- 172.21.15.100:0/574827598 learned_addr learned my addr 172.21.15.100:0/574827598 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:09.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.253+0000 7f652ea00640 1 --2- 172.21.15.100:0/574827598 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65300c4a20 0x7f6530146540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.253+0000 7f652e000640 1 --2- 172.21.15.100:0/574827598 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6530158a30 0x7f653009cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.253+0000 7f652f400640 1 -- 172.21.15.100:0/574827598 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6530158a30 msgr2=0x7f653009cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.253+0000 7f652f400640 1 --2- 172.21.15.100:0/574827598 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6530158a30 0x7f653009cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.253+0000 7f652f400640 1 -- 172.21.15.100:0/574827598 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65300c4a20 msgr2=0x7f6530146540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.253+0000 7f652f400640 1 --2- 172.21.15.100:0/574827598 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65300c4a20 0x7f6530146540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.253+0000 7f652f400640 1 -- 172.21.15.100:0/574827598 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651c009450 con 0x7f6530158e00 2024-08-17T02:46:09.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.253+0000 7f652ea00640 1 --2- 172.21.15.100:0/574827598 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65300c4a20 0x7f6530146540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:09.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.253+0000 7f652e000640 1 --2- 172.21.15.100:0/574827598 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6530158a30 0x7f653009cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:09.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.253+0000 7f652f400640 1 --2- 172.21.15.100:0/574827598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6530158e00 0x7f653009aeb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f652800b8e0 tx=0x7f6528009400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:09.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.253+0000 7f6526000640 1 -- 172.21.15.100:0/574827598 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652800c8c0 con 0x7f6530158e00 2024-08-17T02:46:09.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.253+0000 7f6526000640 1 -- 172.21.15.100:0/574827598 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652800c040 con 0x7f6530158e00 2024-08-17T02:46:09.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.253+0000 7f652fe00640 1 -- 172.21.15.100:0/574827598 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6530099f70 con 0x7f6530158e00 2024-08-17T02:46:09.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.253+0000 7f6526000640 1 -- 172.21.15.100:0/574827598 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652800ccb0 con 0x7f6530158e00 2024-08-17T02:46:09.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.253+0000 7f652fe00640 1 -- 172.21.15.100:0/574827598 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653009a300 con 0x7f6530158e00 2024-08-17T02:46:09.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.254+0000 7f652fe00640 1 -- 172.21.15.100:0/574827598 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6530088dc0 con 0x7f6530158e00 2024-08-17T02:46:09.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.255+0000 7f6526000640 1 -- 172.21.15.100:0/574827598 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6528014620 con 0x7f6530158e00 2024-08-17T02:46:09.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.256+0000 7f6526000640 1 --2- 172.21.15.100:0/574827598 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6510065150 0x7f6510067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.256+0000 7f6526000640 1 -- 172.21.15.100:0/574827598 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6528081eb0 con 0x7f6530158e00 2024-08-17T02:46:09.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.257+0000 7f652ea00640 1 --2- 172.21.15.100:0/574827598 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6510065150 0x7f6510067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.257+0000 7f652ea00640 1 --2- 172.21.15.100:0/574827598 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6510065150 0x7f6510067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f65200017a0 tx=0x7f6520009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:09.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.260+0000 7f6526000640 1 -- 172.21.15.100:0/574827598 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f652804ce40 con 0x7f6530158e00 2024-08-17T02:46:09.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.431+0000 7f652fe00640 1 -- 172.21.15.100:0/574827598 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f653009a750 con 0x7f6530158e00 2024-08-17T02:46:09.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.432+0000 7f6526000640 1 -- 172.21.15.100:0/574827598 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6530088dc0 con 0x7f6530158e00 2024-08-17T02:46:09.433 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-08-17T02:46:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.434+0000 7f652fe00640 1 -- 172.21.15.100:0/574827598 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6510065150 msgr2=0x7f6510067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.434+0000 7f652fe00640 1 --2- 172.21.15.100:0/574827598 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6510065150 0x7f6510067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f65200017a0 tx=0x7f6520009040 comp rx=0 tx=0).stop 2024-08-17T02:46:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.434+0000 7f652fe00640 1 -- 172.21.15.100:0/574827598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6530158e00 msgr2=0x7f653009aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.434+0000 7f652fe00640 1 --2- 172.21.15.100:0/574827598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6530158e00 0x7f653009aeb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f652800b8e0 tx=0x7f6528009400 comp rx=0 tx=0).stop 2024-08-17T02:46:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.434+0000 7f652fe00640 1 -- 172.21.15.100:0/574827598 shutdown_connections 2024-08-17T02:46:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.434+0000 7f652fe00640 1 --2- 172.21.15.100:0/574827598 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6510065150 0x7f6510067600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.434+0000 7f652fe00640 1 --2- 172.21.15.100:0/574827598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6530158e00 0x7f653009aeb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.434+0000 7f652fe00640 1 --2- 172.21.15.100:0/574827598 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6530158a30 0x7f653009cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.434+0000 7f652fe00640 1 --2- 172.21.15.100:0/574827598 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65300c4a20 0x7f6530146540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.434+0000 7f652fe00640 1 -- 172.21.15.100:0/574827598 >> 172.21.15.100:0/574827598 conn(0x7f6530098e30 msgr2=0x7f65300684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:09.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.434+0000 7f652fe00640 1 -- 172.21.15.100:0/574827598 shutdown_connections 2024-08-17T02:46:09.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.434+0000 7f652fe00640 1 -- 172.21.15.100:0/574827598 wait complete. 2024-08-17T02:46:09.450 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:09.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.603+0000 7fd206600640 1 Processor -- start 2024-08-17T02:46:09.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.603+0000 7fd206600640 1 -- start start 2024-08-17T02:46:09.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.604+0000 7fd206600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd2001401b0 0x7fd2000caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.604+0000 7fd206600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd2000b1440 0x7fd2000c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.604+0000 7fd206600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2000caa80 con 0x7fd200140580 2024-08-17T02:46:09.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.604+0000 7fd206600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2000cb450 con 0x7fd2001401b0 2024-08-17T02:46:09.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.604+0000 7fd206600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2000c9e70 con 0x7fd2000b1440 2024-08-17T02:46:09.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.605+0000 7fd1ff400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd2001401b0 0x7fd2000caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.605+0000 7fd1ff400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd2001401b0 0x7fd2000caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45110/0 (socket says 172.21.15.100:45110) 2024-08-17T02:46:09.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.605+0000 7fd1ff400640 1 -- 172.21.15.100:0/909546272 learned_addr learned my addr 172.21.15.100:0/909546272 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:09.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.605+0000 7fd1fea00640 1 --1- 172.21.15.100:0/909546272 >> v1:172.21.15.100:6789/0 conn(0x7fd200140580 0x7fd2000b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45504/0 (socket says 172.21.15.100:45504) 2024-08-17T02:46:09.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.605+0000 7fd1ffe00640 1 --2- 172.21.15.100:0/909546272 >> v2:172.21.15.123:3300/0 conn(0x7fd2000b1440 0x7fd2000c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.605+0000 7fd1ff400640 1 -- 172.21.15.100:0/909546272 >> v2:172.21.15.123:3300/0 conn(0x7fd2000b1440 msgr2=0x7fd2000c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:09.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.605+0000 7fd1ff400640 1 --2- 172.21.15.100:0/909546272 >> v2:172.21.15.123:3300/0 conn(0x7fd2000b1440 0x7fd2000c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.605+0000 7fd1ff400640 1 -- 172.21.15.100:0/909546272 >> v1:172.21.15.100:6789/0 conn(0x7fd200140580 legacy=0x7fd2000b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.605+0000 7fd1ff400640 1 -- 172.21.15.100:0/909546272 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2000ca150 con 0x7fd2001401b0 2024-08-17T02:46:09.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.606+0000 7fd1ff400640 1 --2- 172.21.15.100:0/909546272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2001401b0 0x7fd2000caf10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd2000ca9f0 tx=0x7fd1f00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77264ca98a4ea7f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:09.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.606+0000 7fd1fe000640 1 -- 172.21.15.100:0/909546272 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f002adf0 con 0x7fd2001401b0 2024-08-17T02:46:09.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.606+0000 7fd1fe000640 1 -- 172.21.15.100:0/909546272 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f0032440 con 0x7fd2001401b0 2024-08-17T02:46:09.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.606+0000 7fd1fe000640 1 -- 172.21.15.100:0/909546272 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0032820 con 0x7fd2001401b0 2024-08-17T02:46:09.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.607+0000 7fd206600640 1 -- 172.21.15.100:0/909546272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2001401b0 msgr2=0x7fd2000caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.607+0000 7fd206600640 1 --2- 172.21.15.100:0/909546272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2001401b0 0x7fd2000caf10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd2000ca9f0 tx=0x7fd1f00091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.607+0000 7fd206600640 1 -- 172.21.15.100:0/909546272 shutdown_connections 2024-08-17T02:46:09.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.607+0000 7fd206600640 1 --2- 172.21.15.100:0/909546272 >> v2:172.21.15.123:3300/0 conn(0x7fd2000b1440 0x7fd2000c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.607+0000 7fd206600640 1 --2- 172.21.15.100:0/909546272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2001401b0 0x7fd2000caf10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.607+0000 7fd206600640 1 -- 172.21.15.100:0/909546272 >> 172.21.15.100:0/909546272 conn(0x7fd2000cb9b0 msgr2=0x7fd2000cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:09.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.607+0000 7fd206600640 1 -- 172.21.15.100:0/909546272 shutdown_connections 2024-08-17T02:46:09.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.607+0000 7fd206600640 1 -- 172.21.15.100:0/909546272 wait complete. 2024-08-17T02:46:09.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.608+0000 7fd206600640 1 Processor -- start 2024-08-17T02:46:09.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.609+0000 7fd206600640 1 -- start start 2024-08-17T02:46:09.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.609+0000 7fd206600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2000b1440 0x7fd2000ac150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.609+0000 7fd206600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2001401b0 0x7fd20016c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.610+0000 7fd206600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd200140580 0x7fd20013e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.610+0000 7fd206600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000ac690 con 0x7fd2000b1440 2024-08-17T02:46:09.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.610+0000 7fd206600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000c16c0 con 0x7fd2001401b0 2024-08-17T02:46:09.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.610+0000 7fd206600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000c19a0 con 0x7fd200140580 2024-08-17T02:46:09.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.610+0000 7fd1ff400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2000b1440 0x7fd2000ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.610+0000 7fd1ff400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2000b1440 0x7fd2000ac150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45124/0 (socket says 172.21.15.100:45124) 2024-08-17T02:46:09.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.610+0000 7fd1ff400640 1 -- 172.21.15.100:0/2421985148 learned_addr learned my addr 172.21.15.100:0/2421985148 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:09.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.610+0000 7fd1ff400640 1 -- 172.21.15.100:0/2421985148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd200140580 msgr2=0x7fd20013e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.610+0000 7fd1ff400640 1 --2- 172.21.15.100:0/2421985148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd200140580 0x7fd20013e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.610+0000 7fd1ff400640 1 -- 172.21.15.100:0/2421985148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2001401b0 msgr2=0x7fd20016c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.610+0000 7fd1ff400640 1 --2- 172.21.15.100:0/2421985148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2001401b0 0x7fd20016c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.610+0000 7fd1ff400640 1 -- 172.21.15.100:0/2421985148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f0009450 con 0x7fd2000b1440 2024-08-17T02:46:09.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.610+0000 7fd1ff400640 1 --2- 172.21.15.100:0/2421985148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2000b1440 0x7fd2000ac150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0009210 tx=0x7fd1f0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:09.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.611+0000 7fd1f6a00640 1 -- 172.21.15.100:0/2421985148 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0000c90 con 0x7fd2000b1440 2024-08-17T02:46:09.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.611+0000 7fd1f6a00640 1 -- 172.21.15.100:0/2421985148 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f0031a60 con 0x7fd2000b1440 2024-08-17T02:46:09.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.611+0000 7fd1f6a00640 1 -- 172.21.15.100:0/2421985148 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0031e60 con 0x7fd2000b1440 2024-08-17T02:46:09.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.611+0000 7fd206600640 1 -- 172.21.15.100:0/2421985148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2000afe10 con 0x7fd2000b1440 2024-08-17T02:46:09.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.611+0000 7fd206600640 1 -- 172.21.15.100:0/2421985148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2000c1350 con 0x7fd2000b1440 2024-08-17T02:46:09.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.612+0000 7fd206600640 1 -- 172.21.15.100:0/2421985148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2000b0310 con 0x7fd2000b1440 2024-08-17T02:46:09.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.613+0000 7fd1f6a00640 1 -- 172.21.15.100:0/2421985148 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd1f0039040 con 0x7fd2000b1440 2024-08-17T02:46:09.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.613+0000 7fd1f6a00640 1 --2- 172.21.15.100:0/2421985148 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd1e0065180 0x7fd1e0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.613+0000 7fd1f6a00640 1 -- 172.21.15.100:0/2421985148 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1f00a2090 con 0x7fd2000b1440 2024-08-17T02:46:09.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.614+0000 7fd1fea00640 1 --2- 172.21.15.100:0/2421985148 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd1e0065180 0x7fd1e0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.614+0000 7fd1fea00640 1 --2- 172.21.15.100:0/2421985148 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd1e0065180 0x7fd1e0067630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd2000adb20 tx=0x7fd1ec007aa0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:09.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.618+0000 7fd1f6a00640 1 -- 172.21.15.100:0/2421985148 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd1f00700b0 con 0x7fd2000b1440 2024-08-17T02:46:09.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.791+0000 7fd206600640 1 -- 172.21.15.100:0/2421985148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd200064db0 con 0x7fd2000b1440 2024-08-17T02:46:09.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.792+0000 7fd1f6a00640 1 -- 172.21.15.100:0/2421985148 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fd1f00736d0 con 0x7fd2000b1440 2024-08-17T02:46:09.793 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:09.793 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:42.845503+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:45:39.036964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:45:40.232954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:09.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.794+0000 7fd206600640 1 -- 172.21.15.100:0/2421985148 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd1e0065180 msgr2=0x7fd1e0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.794+0000 7fd206600640 1 --2- 172.21.15.100:0/2421985148 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd1e0065180 0x7fd1e0067630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd2000adb20 tx=0x7fd1ec007aa0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.794+0000 7fd206600640 1 -- 172.21.15.100:0/2421985148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2000b1440 msgr2=0x7fd2000ac150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.795+0000 7fd206600640 1 --2- 172.21.15.100:0/2421985148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2000b1440 0x7fd2000ac150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0009210 tx=0x7fd1f0032000 comp rx=0 tx=0).stop 2024-08-17T02:46:09.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.795+0000 7fd206600640 1 -- 172.21.15.100:0/2421985148 shutdown_connections 2024-08-17T02:46:09.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.795+0000 7fd206600640 1 --2- 172.21.15.100:0/2421985148 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd1e0065180 0x7fd1e0067630 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.795+0000 7fd206600640 1 --2- 172.21.15.100:0/2421985148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd200140580 0x7fd20013e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.795+0000 7fd206600640 1 --2- 172.21.15.100:0/2421985148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2001401b0 0x7fd20016c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.795+0000 7fd206600640 1 --2- 172.21.15.100:0/2421985148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2000b1440 0x7fd2000ac150 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.795+0000 7fd206600640 1 -- 172.21.15.100:0/2421985148 >> 172.21.15.100:0/2421985148 conn(0x7fd2000cb9b0 msgr2=0x7fd20013efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:09.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.795+0000 7fd206600640 1 -- 172.21.15.100:0/2421985148 shutdown_connections 2024-08-17T02:46:09.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.795+0000 7fd206600640 1 -- 172.21.15.100:0/2421985148 wait complete. 2024-08-17T02:46:09.811 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:45:35.140990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:45:39.036964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:45:40.232954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:46:09.812 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:09.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.962+0000 7f5ad9400640 1 Processor -- start 2024-08-17T02:46:09.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.963+0000 7f5ad9400640 1 -- start start 2024-08-17T02:46:09.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.964+0000 7f5ad9400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ad4158c20 0x7f5ad40ac040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.964+0000 7f5ad9400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ad40ac580 0x7f5ad4068fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.964+0000 7f5ad9400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad40aeca0 con 0x7f5ad4069510 2024-08-17T02:46:09.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.964+0000 7f5ad9400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad40ac9d0 con 0x7f5ad40ac580 2024-08-17T02:46:09.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.964+0000 7f5ad9400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40ae3e0 con 0x7f5ad4158c20 2024-08-17T02:46:09.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.964+0000 7f5acb400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ad40ac580 0x7f5ad4068fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.964+0000 7f5acb400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ad40ac580 0x7f5ad4068fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45130/0 (socket says 172.21.15.100:45130) 2024-08-17T02:46:09.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.964+0000 7f5acb400640 1 -- 172.21.15.100:0/3822238706 learned_addr learned my addr 172.21.15.100:0/3822238706 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:09.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.964+0000 7f5ad3e00640 1 --2- 172.21.15.100:0/3822238706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ad4158c20 0x7f5ad40ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.965+0000 7f5acb400640 1 -- 172.21.15.100:0/3822238706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ad4158c20 msgr2=0x7f5ad40ac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:09.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.965+0000 7f5acb400640 1 --2- 172.21.15.100:0/3822238706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ad4158c20 0x7f5ad40ac040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.965+0000 7f5acb400640 1 -- 172.21.15.100:0/3822238706 >> v1:172.21.15.123:6789/0 conn(0x7f5ad4069510 legacy=0x7f5ad40aa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.965+0000 7f5acb400640 1 -- 172.21.15.100:0/3822238706 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad40ae650 con 0x7f5ad40ac580 2024-08-17T02:46:09.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.966+0000 7f5acb400640 1 --2- 172.21.15.100:0/3822238706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ad40ac580 0x7f5ad4068fd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5abc009910 tx=0x7f5abc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd9db82904f9a52 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:09.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.966+0000 7f5ad3400640 1 -- 172.21.15.100:0/3822238706 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc02adb0 con 0x7f5ad40ac580 2024-08-17T02:46:09.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.966+0000 7f5ad3400640 1 -- 172.21.15.100:0/3822238706 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5abc032440 con 0x7f5ad40ac580 2024-08-17T02:46:09.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.966+0000 7f5ad3400640 1 -- 172.21.15.100:0/3822238706 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc032820 con 0x7f5ad40ac580 2024-08-17T02:46:09.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.966+0000 7f5ad9400640 1 -- 172.21.15.100:0/3822238706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ad40ac580 msgr2=0x7f5ad4068fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.966+0000 7f5ad9400640 1 --2- 172.21.15.100:0/3822238706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ad40ac580 0x7f5ad4068fd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5abc009910 tx=0x7f5abc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.966+0000 7f5ad9400640 1 -- 172.21.15.100:0/3822238706 shutdown_connections 2024-08-17T02:46:09.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.966+0000 7f5ad9400640 1 --2- 172.21.15.100:0/3822238706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ad40ac580 0x7f5ad4068fd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.966+0000 7f5ad9400640 1 --2- 172.21.15.100:0/3822238706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ad4158c20 0x7f5ad40ac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.966+0000 7f5ad9400640 1 -- 172.21.15.100:0/3822238706 >> 172.21.15.100:0/3822238706 conn(0x7f5ad4096a70 msgr2=0x7f5ad4096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:09.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.967+0000 7f5ad9400640 1 -- 172.21.15.100:0/3822238706 shutdown_connections 2024-08-17T02:46:09.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.967+0000 7f5ad9400640 1 -- 172.21.15.100:0/3822238706 wait complete. 2024-08-17T02:46:09.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.968+0000 7f5ad9400640 1 Processor -- start 2024-08-17T02:46:09.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.968+0000 7f5ad9400640 1 -- start start 2024-08-17T02:46:09.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.969+0000 7f5ad9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ad4069510 0x7f5ad416d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.969+0000 7f5ad9400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ad40ac580 0x7f5ad4168950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.969+0000 7f5ad9400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ad4158c20 0x7f5ad40af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.969+0000 7f5ad9400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad415bf10 con 0x7f5ad4069510 2024-08-17T02:46:09.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.969+0000 7f5ad9400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad415b5e0 con 0x7f5ad4158c20 2024-08-17T02:46:09.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.969+0000 7f5ad9400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad415b8c0 con 0x7f5ad40ac580 2024-08-17T02:46:09.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.969+0000 7f5ad3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ad4069510 0x7f5ad416d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.969+0000 7f5ad3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ad4069510 0x7f5ad416d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45142/0 (socket says 172.21.15.100:45142) 2024-08-17T02:46:09.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.969+0000 7f5ad3e00640 1 -- 172.21.15.100:0/1999383722 learned_addr learned my addr 172.21.15.100:0/1999383722 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:09.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.969+0000 7f5acb400640 1 --2- 172.21.15.100:0/1999383722 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ad40ac580 0x7f5ad4168950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.969+0000 7f5ad8a00640 1 --2- 172.21.15.100:0/1999383722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ad4158c20 0x7f5ad40af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.969+0000 7f5ad3e00640 1 -- 172.21.15.100:0/1999383722 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ad40ac580 msgr2=0x7f5ad4168950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.969+0000 7f5ad3e00640 1 --2- 172.21.15.100:0/1999383722 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ad40ac580 0x7f5ad4168950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.969+0000 7f5ad3e00640 1 -- 172.21.15.100:0/1999383722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ad4158c20 msgr2=0x7f5ad40af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.969+0000 7f5ad3e00640 1 --2- 172.21.15.100:0/1999383722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ad4158c20 0x7f5ad40af8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.969+0000 7f5ad3e00640 1 -- 172.21.15.100:0/1999383722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5abc009450 con 0x7f5ad4069510 2024-08-17T02:46:09.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.969+0000 7f5ad8a00640 1 --2- 172.21.15.100:0/1999383722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ad4158c20 0x7f5ad40af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:09.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.970+0000 7f5ad3e00640 1 --2- 172.21.15.100:0/1999383722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ad4069510 0x7f5ad416d0d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400d890 tx=0x7f5ac4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:09.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.970+0000 7f5acbe00640 1 -- 172.21.15.100:0/1999383722 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac400de20 con 0x7f5ad4069510 2024-08-17T02:46:09.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.970+0000 7f5acbe00640 1 -- 172.21.15.100:0/1999383722 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac40098b0 con 0x7f5ad4069510 2024-08-17T02:46:09.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.970+0000 7f5ad9400640 1 -- 172.21.15.100:0/1999383722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad415bba0 con 0x7f5ad4069510 2024-08-17T02:46:09.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.970+0000 7f5acbe00640 1 -- 172.21.15.100:0/1999383722 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4009c50 con 0x7f5ad4069510 2024-08-17T02:46:09.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.970+0000 7f5ad9400640 1 -- 172.21.15.100:0/1999383722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad4097a40 con 0x7f5ad4069510 2024-08-17T02:46:09.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.971+0000 7f5ad9400640 1 -- 172.21.15.100:0/1999383722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad4071050 con 0x7f5ad4069510 2024-08-17T02:46:09.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.972+0000 7f5acbe00640 1 -- 172.21.15.100:0/1999383722 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5ac4014620 con 0x7f5ad4069510 2024-08-17T02:46:09.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.973+0000 7f5acbe00640 1 --2- 172.21.15.100:0/1999383722 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ab0065150 0x7f5ab0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.973+0000 7f5acbe00640 1 -- 172.21.15.100:0/1999383722 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ac4082c10 con 0x7f5ad4069510 2024-08-17T02:46:09.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.973+0000 7f5acb400640 1 --2- 172.21.15.100:0/1999383722 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ab0065150 0x7f5ab0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.974+0000 7f5acb400640 1 --2- 172.21.15.100:0/1999383722 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ab0065150 0x7f5ab0067600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5abc034000 tx=0x7f5abc032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:09.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:09.977+0000 7f5acbe00640 1 -- 172.21.15.100:0/1999383722 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5ac4050cb0 con 0x7f5ad4069510 2024-08-17T02:46:10.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.150+0000 7f5ad9400640 1 -- 172.21.15.100:0/1999383722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ad41571b0 con 0x7f5ad4069510 2024-08-17T02:46:10.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.151+0000 7f5acbe00640 1 -- 172.21.15.100:0/1999383722 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ac40542d0 con 0x7f5ad4069510 2024-08-17T02:46:10.152 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-08-17T02:46:10.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.153+0000 7f5ad9400640 1 -- 172.21.15.100:0/1999383722 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ab0065150 msgr2=0x7f5ab0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.153+0000 7f5ad9400640 1 --2- 172.21.15.100:0/1999383722 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ab0065150 0x7f5ab0067600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5abc034000 tx=0x7f5abc032000 comp rx=0 tx=0).stop 2024-08-17T02:46:10.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.153+0000 7f5ad9400640 1 -- 172.21.15.100:0/1999383722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ad4069510 msgr2=0x7f5ad416d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.153+0000 7f5ad9400640 1 --2- 172.21.15.100:0/1999383722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ad4069510 0x7f5ad416d0d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400d890 tx=0x7f5ac4008040 comp rx=0 tx=0).stop 2024-08-17T02:46:10.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.153+0000 7f5ad9400640 1 -- 172.21.15.100:0/1999383722 shutdown_connections 2024-08-17T02:46:10.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.153+0000 7f5ad9400640 1 --2- 172.21.15.100:0/1999383722 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ab0065150 0x7f5ab0067600 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.153+0000 7f5ad9400640 1 --2- 172.21.15.100:0/1999383722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ad4158c20 0x7f5ad40af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.153+0000 7f5ad9400640 1 --2- 172.21.15.100:0/1999383722 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ad40ac580 0x7f5ad4168950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.153+0000 7f5ad9400640 1 --2- 172.21.15.100:0/1999383722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ad4069510 0x7f5ad416d0d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.153+0000 7f5ad9400640 1 -- 172.21.15.100:0/1999383722 >> 172.21.15.100:0/1999383722 conn(0x7f5ad4096a70 msgr2=0x7f5ad406bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:10.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.153+0000 7f5ad9400640 1 -- 172.21.15.100:0/1999383722 shutdown_connections 2024-08-17T02:46:10.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.153+0000 7f5ad9400640 1 -- 172.21.15.100:0/1999383722 wait complete. 2024-08-17T02:46:10.168 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:46:10.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.318+0000 7f4bf9a00640 1 Processor -- start 2024-08-17T02:46:10.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.319+0000 7f4bf9a00640 1 -- start start 2024-08-17T02:46:10.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.320+0000 7f4bf9a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4bf40cb9f0 0x7f4bf406d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.320+0000 7f4bf9a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4bf415c760 0x7f4bf415cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.320+0000 7f4bf9a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf415d0e0 con 0x7f4bf4066cd0 2024-08-17T02:46:10.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.320+0000 7f4bf9a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf41536c0 con 0x7f4bf415c760 2024-08-17T02:46:10.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.320+0000 7f4bf9a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf406d720 con 0x7f4bf40cb9f0 2024-08-17T02:46:10.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.320+0000 7f4bf9000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4bf415c760 0x7f4bf415cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.320+0000 7f4bf9000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4bf415c760 0x7f4bf415cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45148/0 (socket says 172.21.15.100:45148) 2024-08-17T02:46:10.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.320+0000 7f4bf9000640 1 -- 172.21.15.100:0/3479584275 learned_addr learned my addr 172.21.15.100:0/3479584275 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.320+0000 7f4bf9000640 1 -- 172.21.15.100:0/3479584275 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4bf40cb9f0 msgr2=0x7f4bf406d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.320+0000 7f4bf9000640 1 --2- 172.21.15.100:0/3479584275 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4bf40cb9f0 0x7f4bf406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.320+0000 7f4bf9000640 1 -- 172.21.15.100:0/3479584275 >> v1:172.21.15.100:6789/0 conn(0x7f4bf4066cd0 legacy=0x7f4bf40abde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.321+0000 7f4bf9000640 1 -- 172.21.15.100:0/3479584275 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf406da00 con 0x7f4bf415c760 2024-08-17T02:46:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.321+0000 7f4bf9000640 1 --2- 172.21.15.100:0/3479584275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bf415c760 0x7f4bf415cba0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009f20 tx=0x7f4bec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edf99ee7869446a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:10.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.322+0000 7f4bf3400640 1 -- 172.21.15.100:0/3479584275 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec031400 con 0x7f4bf415c760 2024-08-17T02:46:10.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.322+0000 7f4bf3400640 1 -- 172.21.15.100:0/3479584275 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec02d050 con 0x7f4bf415c760 2024-08-17T02:46:10.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.322+0000 7f4bf3400640 1 -- 172.21.15.100:0/3479584275 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec031790 con 0x7f4bf415c760 2024-08-17T02:46:10.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.322+0000 7f4bf9a00640 1 -- 172.21.15.100:0/3479584275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bf415c760 msgr2=0x7f4bf415cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.322+0000 7f4bf9a00640 1 --2- 172.21.15.100:0/3479584275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bf415c760 0x7f4bf415cba0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009f20 tx=0x7f4bec009840 comp rx=0 tx=0).stop 2024-08-17T02:46:10.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.322+0000 7f4bf9a00640 1 -- 172.21.15.100:0/3479584275 shutdown_connections 2024-08-17T02:46:10.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.322+0000 7f4bf9a00640 1 --2- 172.21.15.100:0/3479584275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bf415c760 0x7f4bf415cba0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.322+0000 7f4bf9a00640 1 --2- 172.21.15.100:0/3479584275 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4bf40cb9f0 0x7f4bf406d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.322+0000 7f4bf9a00640 1 -- 172.21.15.100:0/3479584275 >> 172.21.15.100:0/3479584275 conn(0x7f4bf40cca90 msgr2=0x7f4bf40a8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:10.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.322+0000 7f4bf9a00640 1 -- 172.21.15.100:0/3479584275 shutdown_connections 2024-08-17T02:46:10.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.322+0000 7f4bf9a00640 1 -- 172.21.15.100:0/3479584275 wait complete. 2024-08-17T02:46:10.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.324+0000 7f4bf9a00640 1 Processor -- start 2024-08-17T02:46:10.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.324+0000 7f4bf9a00640 1 -- start start 2024-08-17T02:46:10.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.325+0000 7f4bf9a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4bf4066cd0 0x7f4bf4153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.325+0000 7f4bf9a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bf40cb9f0 0x7f4bf4156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.325+0000 7f4bf9a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bf415c760 0x7f4bf414f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.325+0000 7f4bf9a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf40977b0 con 0x7f4bf415c760 2024-08-17T02:46:10.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.325+0000 7f4bf9a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf41565a0 con 0x7f4bf40cb9f0 2024-08-17T02:46:10.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.325+0000 7f4bf9a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf4096ba0 con 0x7f4bf4066cd0 2024-08-17T02:46:10.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.325+0000 7f4bf9000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bf415c760 0x7f4bf414f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.325+0000 7f4bf9000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bf415c760 0x7f4bf414f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45162/0 (socket says 172.21.15.100:45162) 2024-08-17T02:46:10.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.325+0000 7f4bf9000640 1 -- 172.21.15.100:0/2563504514 learned_addr learned my addr 172.21.15.100:0/2563504514 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:10.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.325+0000 7f4bf3e00640 1 --2- 172.21.15.100:0/2563504514 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4bf4066cd0 0x7f4bf4153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.325+0000 7f4beb400640 1 --2- 172.21.15.100:0/2563504514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bf40cb9f0 0x7f4bf4156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.326+0000 7f4bf9000640 1 -- 172.21.15.100:0/2563504514 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4bf4066cd0 msgr2=0x7f4bf4153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.326+0000 7f4bf9000640 1 --2- 172.21.15.100:0/2563504514 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4bf4066cd0 0x7f4bf4153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.326+0000 7f4bf9000640 1 -- 172.21.15.100:0/2563504514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bf40cb9f0 msgr2=0x7f4bf4156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.326+0000 7f4bf9000640 1 --2- 172.21.15.100:0/2563504514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bf40cb9f0 0x7f4bf4156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.326+0000 7f4bf9000640 1 -- 172.21.15.100:0/2563504514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec009ae0 con 0x7f4bf415c760 2024-08-17T02:46:10.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.326+0000 7f4bf9000640 1 --2- 172.21.15.100:0/2563504514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bf415c760 0x7f4bf414f660 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009ab0 tx=0x7f4bec036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:10.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.326+0000 7f4bebe00640 1 -- 172.21.15.100:0/2563504514 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec031780 con 0x7f4bf415c760 2024-08-17T02:46:10.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.326+0000 7f4bebe00640 1 -- 172.21.15.100:0/2563504514 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec007ac0 con 0x7f4bf415c760 2024-08-17T02:46:10.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.326+0000 7f4bf9a00640 1 -- 172.21.15.100:0/2563504514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf4096e80 con 0x7f4bf415c760 2024-08-17T02:46:10.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.326+0000 7f4bebe00640 1 -- 172.21.15.100:0/2563504514 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec007e80 con 0x7f4bf415c760 2024-08-17T02:46:10.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.327+0000 7f4bf9a00640 1 -- 172.21.15.100:0/2563504514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf4097440 con 0x7f4bf415c760 2024-08-17T02:46:10.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.328+0000 7f4bf9a00640 1 -- 172.21.15.100:0/2563504514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf4168d10 con 0x7f4bf415c760 2024-08-17T02:46:10.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.328+0000 7f4bebe00640 1 -- 172.21.15.100:0/2563504514 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4bec003030 con 0x7f4bf415c760 2024-08-17T02:46:10.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.329+0000 7f4bebe00640 1 --2- 172.21.15.100:0/2563504514 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4bd0065150 0x7f4bd0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.329+0000 7f4bebe00640 1 -- 172.21.15.100:0/2563504514 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4bec0a2b00 con 0x7f4bf415c760 2024-08-17T02:46:10.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.329+0000 7f4bf3e00640 1 --2- 172.21.15.100:0/2563504514 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4bd0065150 0x7f4bd0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.330+0000 7f4bf3e00640 1 --2- 172.21.15.100:0/2563504514 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4bd0065150 0x7f4bd0067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4098a80 tx=0x7f4be4009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:10.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.333+0000 7f4bebe00640 1 -- 172.21.15.100:0/2563504514 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4bec0a4e60 con 0x7f4bf415c760 2024-08-17T02:46:10.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.503+0000 7f4bf9a00640 1 -- 172.21.15.100:0/2563504514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4bf4071050 con 0x7f4bf415c760 2024-08-17T02:46:10.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.503+0000 7f4bebe00640 1 -- 172.21.15.100:0/2563504514 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4bec070bd0 con 0x7f4bf415c760 2024-08-17T02:46:10.504 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-08-17T02:46:10.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.505+0000 7f4bf9a00640 1 -- 172.21.15.100:0/2563504514 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4bd0065150 msgr2=0x7f4bd0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.505+0000 7f4bf9a00640 1 --2- 172.21.15.100:0/2563504514 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4bd0065150 0x7f4bd0067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4098a80 tx=0x7f4be4009060 comp rx=0 tx=0).stop 2024-08-17T02:46:10.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.505+0000 7f4bf9a00640 1 -- 172.21.15.100:0/2563504514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bf415c760 msgr2=0x7f4bf414f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.505+0000 7f4bf9a00640 1 --2- 172.21.15.100:0/2563504514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bf415c760 0x7f4bf414f660 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009ab0 tx=0x7f4bec036000 comp rx=0 tx=0).stop 2024-08-17T02:46:10.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.505+0000 7f4bf9a00640 1 -- 172.21.15.100:0/2563504514 shutdown_connections 2024-08-17T02:46:10.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.505+0000 7f4bf9a00640 1 --2- 172.21.15.100:0/2563504514 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4bd0065150 0x7f4bd0067600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.505+0000 7f4bf9a00640 1 --2- 172.21.15.100:0/2563504514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bf415c760 0x7f4bf414f660 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.505+0000 7f4bf9a00640 1 --2- 172.21.15.100:0/2563504514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4bf40cb9f0 0x7f4bf4156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.505+0000 7f4bf9a00640 1 --2- 172.21.15.100:0/2563504514 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4bf4066cd0 0x7f4bf4153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.505+0000 7f4bf9a00640 1 -- 172.21.15.100:0/2563504514 >> 172.21.15.100:0/2563504514 conn(0x7f4bf40cca90 msgr2=0x7f4bf415ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:10.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.506+0000 7f4bf9a00640 1 -- 172.21.15.100:0/2563504514 shutdown_connections 2024-08-17T02:46:10.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.506+0000 7f4bf9a00640 1 -- 172.21.15.100:0/2563504514 wait complete. 2024-08-17T02:46:10.522 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:46:10.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.671+0000 7ff180200640 1 Processor -- start 2024-08-17T02:46:10.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.671+0000 7ff180200640 1 -- start start 2024-08-17T02:46:10.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.672+0000 7ff180200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff178156c50 0x7ff1780c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.672+0000 7ff180200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1780ab130 con 0x7ff1780c8bd0 2024-08-17T02:46:10.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.672+0000 7ff180200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1780ae5a0 con 0x7ff1780adcf0 2024-08-17T02:46:10.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.672+0000 7ff180200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1780ae2c0 con 0x7ff178156c50 2024-08-17T02:46:10.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.672+0000 7ff17d800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff178156c50 0x7ff1780c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.672+0000 7ff17e200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff1780c8bd0 0x7ff1780c8ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45534/0 (socket says 172.21.15.100:45534) 2024-08-17T02:46:10.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.672+0000 7ff17e200640 1 -- 172.21.15.100:0/1923082337 learned_addr learned my addr 172.21.15.100:0/1923082337 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:10.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.673+0000 7ff17d800640 1 -- 172.21.15.100:0/1923082337 >> v1:172.21.15.123:6789/0 conn(0x7ff1780adcf0 legacy=0x7ff1780ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:10.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.673+0000 7ff17d800640 1 -- 172.21.15.100:0/1923082337 >> v1:172.21.15.100:6789/0 conn(0x7ff1780c8bd0 legacy=0x7ff1780c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.673+0000 7ff177e00640 1 -- 172.21.15.100:0/1923082337 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826869546 0 0) 0x7ff1780ab130 con 0x7ff1780c8bd0 2024-08-17T02:46:10.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.673+0000 7ff17d800640 1 -- 172.21.15.100:0/1923082337 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1780aaae0 con 0x7ff178156c50 2024-08-17T02:46:10.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.674+0000 7ff17d800640 1 --2- 172.21.15.100:0/1923082337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff178156c50 0x7ff1780c7cf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009850 tx=0x7ff16c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473e3e7271f3f446 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:10.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.674+0000 7ff177e00640 1 -- 172.21.15.100:0/1923082337 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c02ac70 con 0x7ff178156c50 2024-08-17T02:46:10.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.674+0000 7ff177e00640 1 -- 172.21.15.100:0/1923082337 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16c02add0 con 0x7ff178156c50 2024-08-17T02:46:10.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.674+0000 7ff177e00640 1 -- 172.21.15.100:0/1923082337 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c032670 con 0x7ff178156c50 2024-08-17T02:46:10.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.675+0000 7ff180200640 1 -- 172.21.15.100:0/1923082337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff178156c50 msgr2=0x7ff1780c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.675+0000 7ff180200640 1 --2- 172.21.15.100:0/1923082337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff178156c50 0x7ff1780c7cf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009850 tx=0x7ff16c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.675+0000 7ff180200640 1 -- 172.21.15.100:0/1923082337 shutdown_connections 2024-08-17T02:46:10.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.675+0000 7ff180200640 1 --2- 172.21.15.100:0/1923082337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff178156c50 0x7ff1780c7cf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.675+0000 7ff180200640 1 -- 172.21.15.100:0/1923082337 >> 172.21.15.100:0/1923082337 conn(0x7ff178067750 msgr2=0x7ff1780c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:10.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.675+0000 7ff180200640 1 -- 172.21.15.100:0/1923082337 shutdown_connections 2024-08-17T02:46:10.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.675+0000 7ff180200640 1 -- 172.21.15.100:0/1923082337 wait complete. 2024-08-17T02:46:10.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.676+0000 7ff180200640 1 Processor -- start 2024-08-17T02:46:10.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.677+0000 7ff180200640 1 -- start start 2024-08-17T02:46:10.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.677+0000 7ff180200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1780adcf0 0x7ff178159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.677+0000 7ff180200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff1780c8bd0 0x7ff17814bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.677+0000 7ff180200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff178156c50 0x7ff17814c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.677+0000 7ff180200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff178155a80 con 0x7ff178156c50 2024-08-17T02:46:10.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.677+0000 7ff180200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff178157fe0 con 0x7ff1780adcf0 2024-08-17T02:46:10.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.677+0000 7ff180200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1781557a0 con 0x7ff1780c8bd0 2024-08-17T02:46:10.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.678+0000 7ff17e200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff178156c50 0x7ff17814c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.678+0000 7ff17e200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff178156c50 0x7ff17814c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45180/0 (socket says 172.21.15.100:45180) 2024-08-17T02:46:10.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.678+0000 7ff17e200640 1 -- 172.21.15.100:0/2840756949 learned_addr learned my addr 172.21.15.100:0/2840756949 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:10.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.678+0000 7ff17d800640 1 --2- 172.21.15.100:0/2840756949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1780adcf0 0x7ff178159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.678+0000 7ff17ce00640 1 --2- 172.21.15.100:0/2840756949 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff1780c8bd0 0x7ff17814bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.678+0000 7ff17e200640 1 -- 172.21.15.100:0/2840756949 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff1780c8bd0 msgr2=0x7ff17814bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.678+0000 7ff17e200640 1 --2- 172.21.15.100:0/2840756949 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff1780c8bd0 0x7ff17814bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.678+0000 7ff17e200640 1 -- 172.21.15.100:0/2840756949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1780adcf0 msgr2=0x7ff178159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.678+0000 7ff17e200640 1 --2- 172.21.15.100:0/2840756949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1780adcf0 0x7ff178159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.678+0000 7ff17e200640 1 -- 172.21.15.100:0/2840756949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c009390 con 0x7ff178156c50 2024-08-17T02:46:10.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.678+0000 7ff17e200640 1 --2- 172.21.15.100:0/2840756949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff178156c50 0x7ff17814c240 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff17000ccc0 tx=0x7ff170001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:10.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.679+0000 7ff174c00640 1 -- 172.21.15.100:0/2840756949 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17000a850 con 0x7ff178156c50 2024-08-17T02:46:10.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.679+0000 7ff174c00640 1 -- 172.21.15.100:0/2840756949 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17000a9b0 con 0x7ff178156c50 2024-08-17T02:46:10.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.679+0000 7ff174c00640 1 -- 172.21.15.100:0/2840756949 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17000ad70 con 0x7ff178156c50 2024-08-17T02:46:10.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.679+0000 7ff180200640 1 -- 172.21.15.100:0/2840756949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff178157990 con 0x7ff178156c50 2024-08-17T02:46:10.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.679+0000 7ff180200640 1 -- 172.21.15.100:0/2840756949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff17815a0b0 con 0x7ff178156c50 2024-08-17T02:46:10.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.680+0000 7ff180200640 1 -- 172.21.15.100:0/2840756949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff178071050 con 0x7ff178156c50 2024-08-17T02:46:10.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.681+0000 7ff174c00640 1 -- 172.21.15.100:0/2840756949 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff170007300 con 0x7ff178156c50 2024-08-17T02:46:10.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.681+0000 7ff174c00640 1 --2- 172.21.15.100:0/2840756949 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff158065150 0x7ff158067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.681+0000 7ff174c00640 1 -- 172.21.15.100:0/2840756949 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff170082510 con 0x7ff178156c50 2024-08-17T02:46:10.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.682+0000 7ff17d800640 1 --2- 172.21.15.100:0/2840756949 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff158065150 0x7ff158067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.682+0000 7ff17d800640 1 --2- 172.21.15.100:0/2840756949 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff158065150 0x7ff158067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff16c034000 tx=0x7ff16c032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:10.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.685+0000 7ff174c00640 1 -- 172.21.15.100:0/2840756949 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff170050660 con 0x7ff178156c50 2024-08-17T02:46:10.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.856+0000 7ff180200640 1 -- 172.21.15.100:0/2840756949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff178158120 con 0x7ff178156c50 2024-08-17T02:46:10.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.857+0000 7ff174c00640 1 -- 172.21.15.100:0/2840756949 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff170004b20 con 0x7ff178156c50 2024-08-17T02:46:10.857 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-08-17T02:46:10.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.858+0000 7ff180200640 1 -- 172.21.15.100:0/2840756949 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff158065150 msgr2=0x7ff158067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.858+0000 7ff180200640 1 --2- 172.21.15.100:0/2840756949 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff158065150 0x7ff158067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff16c034000 tx=0x7ff16c032000 comp rx=0 tx=0).stop 2024-08-17T02:46:10.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.858+0000 7ff180200640 1 -- 172.21.15.100:0/2840756949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff178156c50 msgr2=0x7ff17814c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.858+0000 7ff180200640 1 --2- 172.21.15.100:0/2840756949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff178156c50 0x7ff17814c240 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff17000ccc0 tx=0x7ff170001a20 comp rx=0 tx=0).stop 2024-08-17T02:46:10.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.859+0000 7ff180200640 1 -- 172.21.15.100:0/2840756949 shutdown_connections 2024-08-17T02:46:10.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.859+0000 7ff180200640 1 --2- 172.21.15.100:0/2840756949 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff158065150 0x7ff158067600 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.859+0000 7ff180200640 1 --2- 172.21.15.100:0/2840756949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff178156c50 0x7ff17814c240 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.859+0000 7ff180200640 1 --2- 172.21.15.100:0/2840756949 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff1780c8bd0 0x7ff17814bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.859+0000 7ff180200640 1 --2- 172.21.15.100:0/2840756949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1780adcf0 0x7ff178159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.859+0000 7ff180200640 1 -- 172.21.15.100:0/2840756949 >> 172.21.15.100:0/2840756949 conn(0x7ff178067750 msgr2=0x7ff178152820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:10.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.859+0000 7ff180200640 1 -- 172.21.15.100:0/2840756949 shutdown_connections 2024-08-17T02:46:10.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:10.859+0000 7ff180200640 1 -- 172.21.15.100:0/2840756949 wait complete. 2024-08-17T02:46:10.875 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:11.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.021+0000 7f5577200640 1 Processor -- start 2024-08-17T02:46:11.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.021+0000 7f5577200640 1 -- start start 2024-08-17T02:46:11.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.022+0000 7f5577200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f55780ceb40 0x7f55780cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.022+0000 7f5577200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55780ccad0 0x7f5578162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.022+0000 7f5577200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55780cadc0 con 0x7f5578159ca0 2024-08-17T02:46:11.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.022+0000 7f5577200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55780cd6e0 con 0x7f55780ceb40 2024-08-17T02:46:11.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.022+0000 7f5577200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55780ccf70 con 0x7f55780ccad0 2024-08-17T02:46:11.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.022+0000 7f556fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f55780ceb40 0x7f55780cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.022+0000 7f556fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f55780ceb40 0x7f55780cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45186/0 (socket says 172.21.15.100:45186) 2024-08-17T02:46:11.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.022+0000 7f556fe00640 1 -- 172.21.15.100:0/2317479222 learned_addr learned my addr 172.21.15.100:0/2317479222 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:11.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.022+0000 7f5575e00640 1 --1- 172.21.15.100:0/2317479222 >> v1:172.21.15.100:6789/0 conn(0x7f5578159ca0 0x7f55780ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45546/0 (socket says 172.21.15.100:45546) 2024-08-17T02:46:11.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.022+0000 7f5576800640 1 --2- 172.21.15.100:0/2317479222 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55780ccad0 0x7f5578162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.023+0000 7f556fe00640 1 -- 172.21.15.100:0/2317479222 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55780ccad0 msgr2=0x7f5578162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:11.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.023+0000 7f556fe00640 1 --2- 172.21.15.100:0/2317479222 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55780ccad0 0x7f5578162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.023+0000 7f556fe00640 1 -- 172.21.15.100:0/2317479222 >> v1:172.21.15.100:6789/0 conn(0x7f5578159ca0 legacy=0x7f55780ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.023+0000 7f556fe00640 1 -- 172.21.15.100:0/2317479222 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55780cb060 con 0x7f55780ceb40 2024-08-17T02:46:11.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.024+0000 7f556fe00640 1 --2- 172.21.15.100:0/2317479222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55780ceb40 0x7f55780cc590 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5560009910 tx=0x7f55600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d4d060a22a0dd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:11.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.024+0000 7f5575400640 1 -- 172.21.15.100:0/2317479222 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556002ae40 con 0x7f55780ceb40 2024-08-17T02:46:11.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.024+0000 7f5575400640 1 -- 172.21.15.100:0/2317479222 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5560032440 con 0x7f55780ceb40 2024-08-17T02:46:11.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.024+0000 7f5575400640 1 -- 172.21.15.100:0/2317479222 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5560032820 con 0x7f55780ceb40 2024-08-17T02:46:11.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.024+0000 7f5577200640 1 -- 172.21.15.100:0/2317479222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55780ceb40 msgr2=0x7f55780cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.024+0000 7f5577200640 1 --2- 172.21.15.100:0/2317479222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55780ceb40 0x7f55780cc590 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5560009910 tx=0x7f55600091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.025+0000 7f5577200640 1 -- 172.21.15.100:0/2317479222 shutdown_connections 2024-08-17T02:46:11.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.025+0000 7f5577200640 1 --2- 172.21.15.100:0/2317479222 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55780ccad0 0x7f5578162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.025+0000 7f5577200640 1 --2- 172.21.15.100:0/2317479222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55780ceb40 0x7f55780cc590 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.025+0000 7f5577200640 1 -- 172.21.15.100:0/2317479222 >> 172.21.15.100:0/2317479222 conn(0x7f5578098e00 msgr2=0x7f557806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:11.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.025+0000 7f5577200640 1 -- 172.21.15.100:0/2317479222 shutdown_connections 2024-08-17T02:46:11.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.025+0000 7f5577200640 1 -- 172.21.15.100:0/2317479222 wait complete. 2024-08-17T02:46:11.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.026+0000 7f5577200640 1 Processor -- start 2024-08-17T02:46:11.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.026+0000 7f5577200640 1 -- start start 2024-08-17T02:46:11.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.027+0000 7f5577200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55780ccad0 0x7f5578168750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.027+0000 7f5577200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55780ceb40 0x7f55780c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.027+0000 7f5577200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5578159ca0 0x7f55780c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.027+0000 7f5577200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557809b1a0 con 0x7f5578159ca0 2024-08-17T02:46:11.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.027+0000 7f5577200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55780c6120 con 0x7f55780ccad0 2024-08-17T02:46:11.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.027+0000 7f5577200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55780c63d0 con 0x7f55780ceb40 2024-08-17T02:46:11.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.027+0000 7f5576800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5578159ca0 0x7f55780c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.027+0000 7f5576800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5578159ca0 0x7f55780c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45198/0 (socket says 172.21.15.100:45198) 2024-08-17T02:46:11.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.027+0000 7f5576800640 1 -- 172.21.15.100:0/4145433029 learned_addr learned my addr 172.21.15.100:0/4145433029 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:11.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.027+0000 7f5575e00640 1 --2- 172.21.15.100:0/4145433029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55780ccad0 0x7f5578168750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.027+0000 7f556fe00640 1 --2- 172.21.15.100:0/4145433029 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55780ceb40 0x7f55780c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.028+0000 7f5576800640 1 -- 172.21.15.100:0/4145433029 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55780ceb40 msgr2=0x7f55780c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.028+0000 7f5576800640 1 --2- 172.21.15.100:0/4145433029 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55780ceb40 0x7f55780c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.028+0000 7f5576800640 1 -- 172.21.15.100:0/4145433029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55780ccad0 msgr2=0x7f5578168750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.028+0000 7f5576800640 1 --2- 172.21.15.100:0/4145433029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55780ccad0 0x7f5578168750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.028+0000 7f5576800640 1 -- 172.21.15.100:0/4145433029 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5560009450 con 0x7f5578159ca0 2024-08-17T02:46:11.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.028+0000 7f5576800640 1 --2- 172.21.15.100:0/4145433029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5578159ca0 0x7f55780c5be0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5570009fa0 tx=0x7f5570009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:11.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.028+0000 7f556d600640 1 -- 172.21.15.100:0/4145433029 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557000ee60 con 0x7f5578159ca0 2024-08-17T02:46:11.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.028+0000 7f556d600640 1 -- 172.21.15.100:0/4145433029 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5570014420 con 0x7f5578159ca0 2024-08-17T02:46:11.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.028+0000 7f556d600640 1 -- 172.21.15.100:0/4145433029 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700147e0 con 0x7f5578159ca0 2024-08-17T02:46:11.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.028+0000 7f5577200640 1 -- 172.21.15.100:0/4145433029 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557809a870 con 0x7f5578159ca0 2024-08-17T02:46:11.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.028+0000 7f5577200640 1 -- 172.21.15.100:0/4145433029 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557809ae30 con 0x7f5578159ca0 2024-08-17T02:46:11.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.029+0000 7f5577200640 1 -- 172.21.15.100:0/4145433029 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557809b310 con 0x7f5578159ca0 2024-08-17T02:46:11.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.030+0000 7f556d600640 1 -- 172.21.15.100:0/4145433029 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5570014b50 con 0x7f5578159ca0 2024-08-17T02:46:11.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.031+0000 7f556d600640 1 --2- 172.21.15.100:0/4145433029 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5554065150 0x7f5554067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.031+0000 7f556d600640 1 -- 172.21.15.100:0/4145433029 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5570082be0 con 0x7f5578159ca0 2024-08-17T02:46:11.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.031+0000 7f5575e00640 1 --2- 172.21.15.100:0/4145433029 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5554065150 0x7f5554067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.032+0000 7f5575e00640 1 --2- 172.21.15.100:0/4145433029 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5554065150 0x7f5554067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5568007800 tx=0x7f5568007e20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:11.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.035+0000 7f556d600640 1 -- 172.21.15.100:0/4145433029 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5570050cb0 con 0x7f5578159ca0 2024-08-17T02:46:11.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.214+0000 7f5577200640 1 -- 172.21.15.100:0/4145433029 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5578071050 con 0x7f5578159ca0 2024-08-17T02:46:11.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.215+0000 7f556d600640 1 -- 172.21.15.100:0/4145433029 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f55700542d0 con 0x7f5578159ca0 2024-08-17T02:46:11.215 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:11.215 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:42.845503+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:45:39.036964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:45:40.232954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:11.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.217+0000 7f5577200640 1 -- 172.21.15.100:0/4145433029 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5554065150 msgr2=0x7f5554067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.217+0000 7f5577200640 1 --2- 172.21.15.100:0/4145433029 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5554065150 0x7f5554067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5568007800 tx=0x7f5568007e20 comp rx=0 tx=0).stop 2024-08-17T02:46:11.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.217+0000 7f5577200640 1 -- 172.21.15.100:0/4145433029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5578159ca0 msgr2=0x7f55780c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.217+0000 7f5577200640 1 --2- 172.21.15.100:0/4145433029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5578159ca0 0x7f55780c5be0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5570009fa0 tx=0x7f5570009900 comp rx=0 tx=0).stop 2024-08-17T02:46:11.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.217+0000 7f5577200640 1 -- 172.21.15.100:0/4145433029 shutdown_connections 2024-08-17T02:46:11.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.217+0000 7f5577200640 1 --2- 172.21.15.100:0/4145433029 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5554065150 0x7f5554067600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.217+0000 7f5577200640 1 --2- 172.21.15.100:0/4145433029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5578159ca0 0x7f55780c5be0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.217+0000 7f5577200640 1 --2- 172.21.15.100:0/4145433029 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55780ceb40 0x7f55780c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.217+0000 7f5577200640 1 --2- 172.21.15.100:0/4145433029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55780ccad0 0x7f5578168750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.217+0000 7f5577200640 1 -- 172.21.15.100:0/4145433029 >> 172.21.15.100:0/4145433029 conn(0x7f5578098e00 msgr2=0x7f5578068bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:11.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.217+0000 7f5577200640 1 -- 172.21.15.100:0/4145433029 shutdown_connections 2024-08-17T02:46:11.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.217+0000 7f5577200640 1 -- 172.21.15.100:0/4145433029 wait complete. 2024-08-17T02:46:11.233 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:45:35.140990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:45:39.036964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:45:40.232954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:46:11.234 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:11.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.384+0000 7f5ec3400640 1 Processor -- start 2024-08-17T02:46:11.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.384+0000 7f5ec3400640 1 -- start start 2024-08-17T02:46:11.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.385+0000 7f5ec3400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ebc06d9e0 0x7f5ebc06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.385+0000 7f5ec3400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ebc0cb0c0 0x7f5ebc154d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.385+0000 7f5ec3400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5ebc0cb4f0 0x7f5ebc155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.385+0000 7f5ec3400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ebc155790 con 0x7f5ebc0cb0c0 2024-08-17T02:46:11.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.385+0000 7f5ec3400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ebc0c83e0 con 0x7f5ebc0cb4f0 2024-08-17T02:46:11.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.385+0000 7f5ec3400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc0aed90 con 0x7f5ebc06d9e0 2024-08-17T02:46:11.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.385+0000 7f5ebbe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ebc0cb0c0 0x7f5ebc154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.385+0000 7f5ebbe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ebc0cb0c0 0x7f5ebc154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45214/0 (socket says 172.21.15.100:45214) 2024-08-17T02:46:11.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.385+0000 7f5ebbe00640 1 -- 172.21.15.100:0/2462618811 learned_addr learned my addr 172.21.15.100:0/2462618811 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:11.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.386+0000 7f5ec0a00640 1 --2- 172.21.15.100:0/2462618811 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ebc06d9e0 0x7f5ebc06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.386+0000 7f5ec1400640 1 --2- 172.21.15.100:0/2462618811 >> v2:172.21.15.123:3300/0 conn(0x7f5ebc0cb4f0 0x7f5ebc155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.386+0000 7f5ebbe00640 1 -- 172.21.15.100:0/2462618811 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ebc06d9e0 msgr2=0x7f5ebc06ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:11.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.386+0000 7f5ebbe00640 1 --2- 172.21.15.100:0/2462618811 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ebc06d9e0 0x7f5ebc06ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.386+0000 7f5ebbe00640 1 -- 172.21.15.100:0/2462618811 >> v2:172.21.15.123:3300/0 conn(0x7f5ebc0cb4f0 msgr2=0x7f5ebc155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:11.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.386+0000 7f5ebbe00640 1 --2- 172.21.15.100:0/2462618811 >> v2:172.21.15.123:3300/0 conn(0x7f5ebc0cb4f0 0x7f5ebc155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.386+0000 7f5ebbe00640 1 -- 172.21.15.100:0/2462618811 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc0af070 con 0x7f5ebc0cb0c0 2024-08-17T02:46:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.387+0000 7f5ebbe00640 1 --2- 172.21.15.100:0/2462618811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ebc0cb0c0 0x7f5ebc154d10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0b0640 tx=0x7f5ea80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d525056d91fe47 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.387+0000 7f5ebb400640 1 -- 172.21.15.100:0/2462618811 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea802ac90 con 0x7f5ebc0cb0c0 2024-08-17T02:46:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.387+0000 7f5ebb400640 1 -- 172.21.15.100:0/2462618811 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea802adf0 con 0x7f5ebc0cb0c0 2024-08-17T02:46:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.387+0000 7f5ebb400640 1 -- 172.21.15.100:0/2462618811 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8032670 con 0x7f5ebc0cb0c0 2024-08-17T02:46:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.388+0000 7f5ec3400640 1 -- 172.21.15.100:0/2462618811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ebc0cb0c0 msgr2=0x7f5ebc154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.388+0000 7f5ec3400640 1 --2- 172.21.15.100:0/2462618811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ebc0cb0c0 0x7f5ebc154d10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0b0640 tx=0x7f5ea80091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.388+0000 7f5ec3400640 1 -- 172.21.15.100:0/2462618811 shutdown_connections 2024-08-17T02:46:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.388+0000 7f5ec3400640 1 --2- 172.21.15.100:0/2462618811 >> v2:172.21.15.123:3300/0 conn(0x7f5ebc0cb4f0 0x7f5ebc155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.388+0000 7f5ec3400640 1 --2- 172.21.15.100:0/2462618811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ebc0cb0c0 0x7f5ebc154d10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.388+0000 7f5ec3400640 1 --2- 172.21.15.100:0/2462618811 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ebc06d9e0 0x7f5ebc06ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.388+0000 7f5ec3400640 1 -- 172.21.15.100:0/2462618811 >> 172.21.15.100:0/2462618811 conn(0x7f5ebc067750 msgr2=0x7f5ebc0cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:11.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.388+0000 7f5ec3400640 1 -- 172.21.15.100:0/2462618811 shutdown_connections 2024-08-17T02:46:11.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.388+0000 7f5ec3400640 1 -- 172.21.15.100:0/2462618811 wait complete. 2024-08-17T02:46:11.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.389+0000 7f5ec3400640 1 Processor -- start 2024-08-17T02:46:11.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.389+0000 7f5ec3400640 1 -- start start 2024-08-17T02:46:11.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.390+0000 7f5ec3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ebc06d9e0 0x7f5ebc156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.390+0000 7f5ec3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ebc0cb0c0 0x7f5ebc147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.390+0000 7f5ec3400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ebc0cb4f0 0x7f5ebc157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.390+0000 7f5ec3400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc156ec0 con 0x7f5ebc0cb0c0 2024-08-17T02:46:11.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.390+0000 7f5ec3400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc1571a0 con 0x7f5ebc06d9e0 2024-08-17T02:46:11.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.390+0000 7f5ec3400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc157480 con 0x7f5ebc0cb4f0 2024-08-17T02:46:11.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.390+0000 7f5ebbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ebc0cb0c0 0x7f5ebc147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.390+0000 7f5ebbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ebc0cb0c0 0x7f5ebc147b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45230/0 (socket says 172.21.15.100:45230) 2024-08-17T02:46:11.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.390+0000 7f5ebbe00640 1 -- 172.21.15.100:0/1803816216 learned_addr learned my addr 172.21.15.100:0/1803816216 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:11.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.391+0000 7f5ec1400640 1 --2- 172.21.15.100:0/1803816216 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ebc0cb4f0 0x7f5ebc157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.391+0000 7f5ec0a00640 1 --2- 172.21.15.100:0/1803816216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ebc06d9e0 0x7f5ebc156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.391+0000 7f5ebbe00640 1 -- 172.21.15.100:0/1803816216 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ebc0cb4f0 msgr2=0x7f5ebc157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.391+0000 7f5ebbe00640 1 --2- 172.21.15.100:0/1803816216 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ebc0cb4f0 0x7f5ebc157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.391+0000 7f5ebbe00640 1 -- 172.21.15.100:0/1803816216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ebc06d9e0 msgr2=0x7f5ebc156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.391+0000 7f5ebbe00640 1 --2- 172.21.15.100:0/1803816216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ebc06d9e0 0x7f5ebc156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.391+0000 7f5ebbe00640 1 -- 172.21.15.100:0/1803816216 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea8009450 con 0x7f5ebc0cb0c0 2024-08-17T02:46:11.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.391+0000 7f5ec0a00640 1 --2- 172.21.15.100:0/1803816216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ebc06d9e0 0x7f5ebc156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:11.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.391+0000 7f5ebbe00640 1 --2- 172.21.15.100:0/1803816216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ebc0cb0c0 0x7f5ebc147b70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8035040 tx=0x7f5ea8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:11.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.391+0000 7f5eafe00640 1 -- 172.21.15.100:0/1803816216 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea803d630 con 0x7f5ebc0cb0c0 2024-08-17T02:46:11.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.391+0000 7f5eafe00640 1 -- 172.21.15.100:0/1803816216 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea803d7b0 con 0x7f5ebc0cb0c0 2024-08-17T02:46:11.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.391+0000 7f5eafe00640 1 -- 172.21.15.100:0/1803816216 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea803db70 con 0x7f5ebc0cb0c0 2024-08-17T02:46:11.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.391+0000 7f5ec3400640 1 -- 172.21.15.100:0/1803816216 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ebc157760 con 0x7f5ebc0cb0c0 2024-08-17T02:46:11.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.392+0000 7f5ec3400640 1 -- 172.21.15.100:0/1803816216 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ebc14a0d0 con 0x7f5ebc0cb0c0 2024-08-17T02:46:11.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.392+0000 7f5ec3400640 1 -- 172.21.15.100:0/1803816216 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ebc14a310 con 0x7f5ebc0cb0c0 2024-08-17T02:46:11.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.393+0000 7f5eafe00640 1 -- 172.21.15.100:0/1803816216 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5ea8039040 con 0x7f5ebc0cb0c0 2024-08-17T02:46:11.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.394+0000 7f5eafe00640 1 --2- 172.21.15.100:0/1803816216 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5e9c065150 0x7f5e9c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.394+0000 7f5eafe00640 1 -- 172.21.15.100:0/1803816216 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ea80a1c50 con 0x7f5ebc0cb0c0 2024-08-17T02:46:11.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.394+0000 7f5ec0a00640 1 --2- 172.21.15.100:0/1803816216 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5e9c065150 0x7f5e9c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.395+0000 7f5ec0a00640 1 --2- 172.21.15.100:0/1803816216 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5e9c065150 0x7f5e9c067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0009cf0 tx=0x7f5eb0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:11.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.398+0000 7f5eafe00640 1 -- 172.21.15.100:0/1803816216 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5ea806fde0 con 0x7f5ebc0cb0c0 2024-08-17T02:46:11.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.569+0000 7f5ec3400640 1 -- 172.21.15.100:0/1803816216 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ebc064db0 con 0x7f5ebc0cb0c0 2024-08-17T02:46:11.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.569+0000 7f5eafe00640 1 -- 172.21.15.100:0/1803816216 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ea80420a0 con 0x7f5ebc0cb0c0 2024-08-17T02:46:11.571 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-08-17T02:46:11.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.571+0000 7f5ec3400640 1 -- 172.21.15.100:0/1803816216 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5e9c065150 msgr2=0x7f5e9c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.571+0000 7f5ec3400640 1 --2- 172.21.15.100:0/1803816216 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5e9c065150 0x7f5e9c067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0009cf0 tx=0x7f5eb0008040 comp rx=0 tx=0).stop 2024-08-17T02:46:11.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.571+0000 7f5ec3400640 1 -- 172.21.15.100:0/1803816216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ebc0cb0c0 msgr2=0x7f5ebc147b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.571+0000 7f5ec3400640 1 --2- 172.21.15.100:0/1803816216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ebc0cb0c0 0x7f5ebc147b70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8035040 tx=0x7f5ea8032000 comp rx=0 tx=0).stop 2024-08-17T02:46:11.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.572+0000 7f5ec3400640 1 -- 172.21.15.100:0/1803816216 shutdown_connections 2024-08-17T02:46:11.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.572+0000 7f5ec3400640 1 --2- 172.21.15.100:0/1803816216 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5e9c065150 0x7f5e9c067600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.572+0000 7f5ec3400640 1 --2- 172.21.15.100:0/1803816216 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ebc0cb4f0 0x7f5ebc157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.572+0000 7f5ec3400640 1 --2- 172.21.15.100:0/1803816216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ebc0cb0c0 0x7f5ebc147b70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.572+0000 7f5ec3400640 1 --2- 172.21.15.100:0/1803816216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ebc06d9e0 0x7f5ebc156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.572+0000 7f5ec3400640 1 -- 172.21.15.100:0/1803816216 >> 172.21.15.100:0/1803816216 conn(0x7f5ebc067750 msgr2=0x7f5ebc158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:11.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.572+0000 7f5ec3400640 1 -- 172.21.15.100:0/1803816216 shutdown_connections 2024-08-17T02:46:11.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.572+0000 7f5ec3400640 1 -- 172.21.15.100:0/1803816216 wait complete. 2024-08-17T02:46:11.589 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:46:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.738+0000 7fd506400640 1 Processor -- start 2024-08-17T02:46:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.739+0000 7fd506400640 1 -- start start 2024-08-17T02:46:11.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.740+0000 7fd506400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd500158d10 0x7fd500066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.740+0000 7fd506400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd500159160 0x7fd500067210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.740+0000 7fd506400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50006e660 con 0x7fd500158940 2024-08-17T02:46:11.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.740+0000 7fd506400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5000a9b70 con 0x7fd500159160 2024-08-17T02:46:11.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.740+0000 7fd506400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50006da50 con 0x7fd500158d10 2024-08-17T02:46:11.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.740+0000 7fd505000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd500158940 0x7fd50015d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45558/0 (socket says 172.21.15.100:45558) 2024-08-17T02:46:11.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.740+0000 7fd505000640 1 -- 172.21.15.100:0/314135361 learned_addr learned my addr 172.21.15.100:0/314135361 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.740+0000 7fd4f7e00640 1 --2- 172.21.15.100:0/314135361 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd500158d10 0x7fd500066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.740+0000 7fd4ffe00640 1 -- 172.21.15.100:0/314135361 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745606199 0 0) 0x7fd50006e660 con 0x7fd500158940 2024-08-17T02:46:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.741+0000 7fd4ffe00640 1 -- 172.21.15.100:0/314135361 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4e40034e0 con 0x7fd500158940 2024-08-17T02:46:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.740+0000 7fd505a00640 1 --2- 172.21.15.100:0/314135361 >> v2:172.21.15.123:3300/0 conn(0x7fd500159160 0x7fd500067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.741+0000 7fd4ffe00640 1 -- 172.21.15.100:0/314135361 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 251718747 0 0) 0x7fd4e40034e0 con 0x7fd500158940 2024-08-17T02:46:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.741+0000 7fd4ffe00640 1 -- 172.21.15.100:0/314135361 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd500158d10 msgr2=0x7fd500066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.741+0000 7fd4ffe00640 1 --2- 172.21.15.100:0/314135361 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd500158d10 0x7fd500066cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.741+0000 7fd4ffe00640 1 -- 172.21.15.100:0/314135361 >> v2:172.21.15.123:3300/0 conn(0x7fd500159160 msgr2=0x7fd500067210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.741+0000 7fd4ffe00640 1 --2- 172.21.15.100:0/314135361 >> v2:172.21.15.123:3300/0 conn(0x7fd500159160 0x7fd500067210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.741+0000 7fd4ffe00640 1 -- 172.21.15.100:0/314135361 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50006dd30 con 0x7fd500158940 2024-08-17T02:46:11.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.741+0000 7fd4ffe00640 1 -- 172.21.15.100:0/314135361 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1817143124 0 0) 0x7fd4f0001470 con 0x7fd500158940 2024-08-17T02:46:11.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.741+0000 7fd4ffe00640 1 -- 172.21.15.100:0/314135361 >> v1:172.21.15.100:6789/0 conn(0x7fd500158940 legacy=0x7fd50015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.741+0000 7fd4ffe00640 1 --2- 172.21.15.100:0/314135361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e40039d0 0x7fd4e4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.741+0000 7fd4ffe00640 1 --2- 172.21.15.100:0/314135361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4e4004780 0x7fd4e4004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.741+0000 7fd4ffe00640 1 --2- 172.21.15.100:0/314135361 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd500158d10 0x7fd4e4005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.741+0000 7fd4ffe00640 1 -- 172.21.15.100:0/314135361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5000a9b70 con 0x7fd4e4004780 2024-08-17T02:46:11.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.741+0000 7fd4ffe00640 1 -- 172.21.15.100:0/314135361 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50006da50 con 0x7fd4e40039d0 2024-08-17T02:46:11.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.741+0000 7fd4ffe00640 1 -- 172.21.15.100:0/314135361 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e400b9d0 con 0x7fd500158d10 2024-08-17T02:46:11.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.741+0000 7fd4f7e00640 1 --2- 172.21.15.100:0/314135361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4e4004780 0x7fd4e4004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.741+0000 7fd505a00640 1 --2- 172.21.15.100:0/314135361 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd500158d10 0x7fd4e4005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.741+0000 7fd505000640 1 --2- 172.21.15.100:0/314135361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e40039d0 0x7fd4e4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.742+0000 7fd4f7e00640 1 -- 172.21.15.100:0/314135361 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd500158d10 msgr2=0x7fd4e4005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:11.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.742+0000 7fd4f7e00640 1 --2- 172.21.15.100:0/314135361 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd500158d10 0x7fd4e4005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.742+0000 7fd4f7e00640 1 -- 172.21.15.100:0/314135361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e40039d0 msgr2=0x7fd4e4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:11.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.742+0000 7fd4f7e00640 1 --2- 172.21.15.100:0/314135361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e40039d0 0x7fd4e4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.742+0000 7fd4f7e00640 1 -- 172.21.15.100:0/314135361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e40034e0 con 0x7fd4e4004780 2024-08-17T02:46:11.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.742+0000 7fd505000640 1 --2- 172.21.15.100:0/314135361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e40039d0 0x7fd4e4003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:11.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.743+0000 7fd4f7e00640 1 --2- 172.21.15.100:0/314135361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4e4004780 0x7fd4e4004bf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8009ba0 tx=0x7fd4e80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d66600982bd511d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:11.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.743+0000 7fd4ffe00640 1 -- 172.21.15.100:0/314135361 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8031400 con 0x7fd4e4004780 2024-08-17T02:46:11.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.743+0000 7fd4ffe00640 1 -- 172.21.15.100:0/314135361 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e802d050 con 0x7fd4e4004780 2024-08-17T02:46:11.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.743+0000 7fd4ffe00640 1 -- 172.21.15.100:0/314135361 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8031790 con 0x7fd4e4004780 2024-08-17T02:46:11.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.743+0000 7fd506400640 1 -- 172.21.15.100:0/314135361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4e4004780 msgr2=0x7fd4e4004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.743+0000 7fd506400640 1 --2- 172.21.15.100:0/314135361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4e4004780 0x7fd4e4004bf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8009ba0 tx=0x7fd4e80090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.743+0000 7fd505a00640 1 -- 172.21.15.100:0/314135361 reap_dead start 2024-08-17T02:46:11.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.743+0000 7fd506400640 1 -- 172.21.15.100:0/314135361 shutdown_connections 2024-08-17T02:46:11.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.743+0000 7fd506400640 1 -- 172.21.15.100:0/314135361 >> 172.21.15.100:0/314135361 conn(0x7fd500067de0 msgr2=0x7fd5000681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:11.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.744+0000 7fd506400640 1 -- 172.21.15.100:0/314135361 shutdown_connections 2024-08-17T02:46:11.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.744+0000 7fd506400640 1 -- 172.21.15.100:0/314135361 wait complete. 2024-08-17T02:46:11.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.745+0000 7fd506400640 1 Processor -- start 2024-08-17T02:46:11.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.745+0000 7fd506400640 1 -- start start 2024-08-17T02:46:11.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.746+0000 7fd506400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4e4004780 0x7fd500144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.746+0000 7fd506400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd50015d6e0 0x7fd500142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.746+0000 7fd506400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd500140a40 0x7fd500140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.746+0000 7fd506400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd500141420 con 0x7fd4e4004780 2024-08-17T02:46:11.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.746+0000 7fd506400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd500143580 con 0x7fd50015d6e0 2024-08-17T02:46:11.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.746+0000 7fd506400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd500142970 con 0x7fd500140a40 2024-08-17T02:46:11.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.746+0000 7fd505000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4e4004780 0x7fd500144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.746+0000 7fd505000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4e4004780 0x7fd500144b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45254/0 (socket says 172.21.15.100:45254) 2024-08-17T02:46:11.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.746+0000 7fd505000640 1 -- 172.21.15.100:0/225925711 learned_addr learned my addr 172.21.15.100:0/225925711 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:11.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.746+0000 7fd505a00640 1 --2- 172.21.15.100:0/225925711 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd500140a40 0x7fd500140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.746+0000 7fd4f7e00640 1 --2- 172.21.15.100:0/225925711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd50015d6e0 0x7fd500142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.746+0000 7fd505000640 1 -- 172.21.15.100:0/225925711 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd500140a40 msgr2=0x7fd500140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.746+0000 7fd505000640 1 --2- 172.21.15.100:0/225925711 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd500140a40 0x7fd500140ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.746+0000 7fd505000640 1 -- 172.21.15.100:0/225925711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd50015d6e0 msgr2=0x7fd500142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.746+0000 7fd505000640 1 --2- 172.21.15.100:0/225925711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd50015d6e0 0x7fd500142020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.747+0000 7fd505000640 1 -- 172.21.15.100:0/225925711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd500142c50 con 0x7fd4e4004780 2024-08-17T02:46:11.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.747+0000 7fd505000640 1 --2- 172.21.15.100:0/225925711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4e4004780 0x7fd500144b60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd4f000eb90 tx=0x7fd500069460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:11.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.747+0000 7fd4fcc00640 1 -- 172.21.15.100:0/225925711 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0000cc0 con 0x7fd4e4004780 2024-08-17T02:46:11.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.747+0000 7fd4fcc00640 1 -- 172.21.15.100:0/225925711 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f000c850 con 0x7fd4e4004780 2024-08-17T02:46:11.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.747+0000 7fd506400640 1 -- 172.21.15.100:0/225925711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd500142f30 con 0x7fd4e4004780 2024-08-17T02:46:11.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.747+0000 7fd4fcc00640 1 -- 172.21.15.100:0/225925711 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f000cbd0 con 0x7fd4e4004780 2024-08-17T02:46:11.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.747+0000 7fd506400640 1 -- 172.21.15.100:0/225925711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5001450a0 con 0x7fd4e4004780 2024-08-17T02:46:11.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.748+0000 7fd506400640 1 -- 172.21.15.100:0/225925711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd500071050 con 0x7fd4e4004780 2024-08-17T02:46:11.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.749+0000 7fd4fcc00640 1 -- 172.21.15.100:0/225925711 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd4f001d460 con 0x7fd4e4004780 2024-08-17T02:46:11.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.750+0000 7fd4fcc00640 1 --2- 172.21.15.100:0/225925711 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd4dc065150 0x7fd4dc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.750+0000 7fd4fcc00640 1 -- 172.21.15.100:0/225925711 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd4f0082360 con 0x7fd4e4004780 2024-08-17T02:46:11.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.750+0000 7fd4f7e00640 1 --2- 172.21.15.100:0/225925711 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd4dc065150 0x7fd4dc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.751+0000 7fd4f7e00640 1 --2- 172.21.15.100:0/225925711 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd4dc065150 0x7fd4dc067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8034000 tx=0x7fd4e8035000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:11.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.754+0000 7fd4fcc00640 1 -- 172.21.15.100:0/225925711 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd4f0050380 con 0x7fd4e4004780 2024-08-17T02:46:11.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.925+0000 7fd506400640 1 -- 172.21.15.100:0/225925711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd500068af0 con 0x7fd4e4004780 2024-08-17T02:46:11.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.925+0000 7fd4fcc00640 1 -- 172.21.15.100:0/225925711 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd4f00539a0 con 0x7fd4e4004780 2024-08-17T02:46:11.927 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-08-17T02:46:11.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.927+0000 7fd506400640 1 -- 172.21.15.100:0/225925711 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd4dc065150 msgr2=0x7fd4dc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.927+0000 7fd506400640 1 --2- 172.21.15.100:0/225925711 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd4dc065150 0x7fd4dc067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8034000 tx=0x7fd4e8035000 comp rx=0 tx=0).stop 2024-08-17T02:46:11.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.927+0000 7fd506400640 1 -- 172.21.15.100:0/225925711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4e4004780 msgr2=0x7fd500144b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.927+0000 7fd506400640 1 --2- 172.21.15.100:0/225925711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4e4004780 0x7fd500144b60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd4f000eb90 tx=0x7fd500069460 comp rx=0 tx=0).stop 2024-08-17T02:46:11.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.927+0000 7fd506400640 1 -- 172.21.15.100:0/225925711 shutdown_connections 2024-08-17T02:46:11.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.927+0000 7fd506400640 1 --2- 172.21.15.100:0/225925711 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd4dc065150 0x7fd4dc067600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.927+0000 7fd506400640 1 --2- 172.21.15.100:0/225925711 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd500140a40 0x7fd500140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.927+0000 7fd506400640 1 --2- 172.21.15.100:0/225925711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd50015d6e0 0x7fd500142020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.927+0000 7fd506400640 1 --2- 172.21.15.100:0/225925711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4e4004780 0x7fd500144b60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.927+0000 7fd506400640 1 -- 172.21.15.100:0/225925711 >> 172.21.15.100:0/225925711 conn(0x7fd500067de0 msgr2=0x7fd50006a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:11.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.928+0000 7fd506400640 1 -- 172.21.15.100:0/225925711 shutdown_connections 2024-08-17T02:46:11.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:11.928+0000 7fd506400640 1 -- 172.21.15.100:0/225925711 wait complete. 2024-08-17T02:46:11.944 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:46:12.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.093+0000 7f9e19a00640 1 Processor -- start 2024-08-17T02:46:12.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.093+0000 7f9e19a00640 1 -- start start 2024-08-17T02:46:12.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.094+0000 7f9e19a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9e14159170 0x7f9e140ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.094+0000 7f9e19a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9e140aaf20 0x7f9e140ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.094+0000 7f9e19a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e140681f0 con 0x7f9e14158da0 2024-08-17T02:46:12.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.094+0000 7f9e19a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e140b08c0 con 0x7f9e14159170 2024-08-17T02:46:12.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.094+0000 7f9e19a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e140aca00 con 0x7f9e140aaf20 2024-08-17T02:46:12.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.094+0000 7f9e12000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9e14159170 0x7f9e140ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.094+0000 7f9e12000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9e14159170 0x7f9e140ac3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45256/0 (socket says 172.21.15.100:45256) 2024-08-17T02:46:12.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.094+0000 7f9e12000640 1 -- 172.21.15.100:0/904568926 learned_addr learned my addr 172.21.15.100:0/904568926 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:12.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.095+0000 7f9e13400640 1 --2- 172.21.15.100:0/904568926 >> v2:172.21.15.123:3300/0 conn(0x7f9e140aaf20 0x7f9e140ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.095+0000 7f9e12000640 1 -- 172.21.15.100:0/904568926 >> v2:172.21.15.123:3300/0 conn(0x7f9e140aaf20 msgr2=0x7f9e140ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.095+0000 7f9e12000640 1 --2- 172.21.15.100:0/904568926 >> v2:172.21.15.123:3300/0 conn(0x7f9e140aaf20 0x7f9e140ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.095+0000 7f9e12000640 1 -- 172.21.15.100:0/904568926 >> v1:172.21.15.123:6789/0 conn(0x7f9e14158da0 legacy=0x7f9e140aa810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.095+0000 7f9e12000640 1 -- 172.21.15.100:0/904568926 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e140acce0 con 0x7f9e14159170 2024-08-17T02:46:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.096+0000 7f9e12000640 1 --2- 172.21.15.100:0/904568926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e14159170 0x7f9e140ac3e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9e140b3ba0 tx=0x7f9e000091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1b65031a9ecaa1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.096+0000 7f9e11600640 1 -- 172.21.15.100:0/904568926 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0002adf0 con 0x7f9e14159170 2024-08-17T02:46:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.096+0000 7f9e11600640 1 -- 172.21.15.100:0/904568926 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e00032440 con 0x7f9e14159170 2024-08-17T02:46:12.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.096+0000 7f9e11600640 1 -- 172.21.15.100:0/904568926 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e00032820 con 0x7f9e14159170 2024-08-17T02:46:12.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.097+0000 7f9e19a00640 1 -- 172.21.15.100:0/904568926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e14159170 msgr2=0x7f9e140ac3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.097+0000 7f9e19a00640 1 --2- 172.21.15.100:0/904568926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e14159170 0x7f9e140ac3e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9e140b3ba0 tx=0x7f9e000091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.097+0000 7f9e19a00640 1 -- 172.21.15.100:0/904568926 shutdown_connections 2024-08-17T02:46:12.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.097+0000 7f9e19a00640 1 --2- 172.21.15.100:0/904568926 >> v2:172.21.15.123:3300/0 conn(0x7f9e140aaf20 0x7f9e140ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.097+0000 7f9e19a00640 1 --2- 172.21.15.100:0/904568926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e14159170 0x7f9e140ac3e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.097+0000 7f9e19a00640 1 -- 172.21.15.100:0/904568926 >> 172.21.15.100:0/904568926 conn(0x7f9e14096a70 msgr2=0x7f9e14096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:12.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.097+0000 7f9e19a00640 1 -- 172.21.15.100:0/904568926 shutdown_connections 2024-08-17T02:46:12.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.097+0000 7f9e19a00640 1 -- 172.21.15.100:0/904568926 wait complete. 2024-08-17T02:46:12.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.098+0000 7f9e19a00640 1 Processor -- start 2024-08-17T02:46:12.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.098+0000 7f9e19a00640 1 -- start start 2024-08-17T02:46:12.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.099+0000 7f9e19a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e140aaf20 0x7f9e140c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.099+0000 7f9e19a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e14158da0 0x7f9e1415a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.099+0000 7f9e19a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9e140c9670 0x7f9e1415a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.099+0000 7f9e19a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e140b2260 con 0x7f9e14158da0 2024-08-17T02:46:12.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.099+0000 7f9e19a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1416a2c0 con 0x7f9e140aaf20 2024-08-17T02:46:12.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.099+0000 7f9e19a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1415b070 con 0x7f9e140c9670 2024-08-17T02:46:12.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.100+0000 7f9e12000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e14158da0 0x7f9e1415a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.100+0000 7f9e12000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e14158da0 0x7f9e1415a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45266/0 (socket says 172.21.15.100:45266) 2024-08-17T02:46:12.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.100+0000 7f9e12000640 1 -- 172.21.15.100:0/2623778241 learned_addr learned my addr 172.21.15.100:0/2623778241 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:12.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.100+0000 7f9e13400640 1 --2- 172.21.15.100:0/2623778241 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9e140c9670 0x7f9e1415a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.100+0000 7f9e12a00640 1 --2- 172.21.15.100:0/2623778241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e140aaf20 0x7f9e140c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.100+0000 7f9e12000640 1 -- 172.21.15.100:0/2623778241 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9e140c9670 msgr2=0x7f9e1415a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.100+0000 7f9e12000640 1 --2- 172.21.15.100:0/2623778241 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9e140c9670 0x7f9e1415a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.100+0000 7f9e12000640 1 -- 172.21.15.100:0/2623778241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e140aaf20 msgr2=0x7f9e140c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.100+0000 7f9e12000640 1 --2- 172.21.15.100:0/2623778241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e140aaf20 0x7f9e140c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.100+0000 7f9e12000640 1 -- 172.21.15.100:0/2623778241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e00009450 con 0x7f9e14158da0 2024-08-17T02:46:12.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.100+0000 7f9e13400640 1 --2- 172.21.15.100:0/2623778241 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9e140c9670 0x7f9e1415a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:12.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.100+0000 7f9e12000640 1 --2- 172.21.15.100:0/2623778241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e14158da0 0x7f9e1415a420 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009210 tx=0x7f9e00032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:12.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.101+0000 7f9e0a000640 1 -- 172.21.15.100:0/2623778241 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e00031a60 con 0x7f9e14158da0 2024-08-17T02:46:12.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.101+0000 7f9e0a000640 1 -- 172.21.15.100:0/2623778241 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e00031c00 con 0x7f9e14158da0 2024-08-17T02:46:12.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.101+0000 7f9e0a000640 1 -- 172.21.15.100:0/2623778241 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0003d420 con 0x7f9e14158da0 2024-08-17T02:46:12.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.101+0000 7f9e19a00640 1 -- 172.21.15.100:0/2623778241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e1415b350 con 0x7f9e14158da0 2024-08-17T02:46:12.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.101+0000 7f9e19a00640 1 -- 172.21.15.100:0/2623778241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e1415b910 con 0x7f9e14158da0 2024-08-17T02:46:12.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.102+0000 7f9e19a00640 1 -- 172.21.15.100:0/2623778241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e140ca140 con 0x7f9e14158da0 2024-08-17T02:46:12.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.103+0000 7f9e0a000640 1 -- 172.21.15.100:0/2623778241 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9e00039040 con 0x7f9e14158da0 2024-08-17T02:46:12.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.103+0000 7f9e0a000640 1 --2- 172.21.15.100:0/2623778241 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9df4065150 0x7f9df4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.103+0000 7f9e0a000640 1 -- 172.21.15.100:0/2623778241 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e000a2150 con 0x7f9e14158da0 2024-08-17T02:46:12.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.104+0000 7f9e12a00640 1 --2- 172.21.15.100:0/2623778241 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9df4065150 0x7f9df4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.104+0000 7f9e12a00640 1 --2- 172.21.15.100:0/2623778241 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9df4065150 0x7f9df4067600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9e04007fd0 tx=0x7f9e04007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:12.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.107+0000 7f9e0a000640 1 -- 172.21.15.100:0/2623778241 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9e140ca140 con 0x7f9e14158da0 2024-08-17T02:46:12.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.280+0000 7f9e19a00640 1 -- 172.21.15.100:0/2623778241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9e140ca140 con 0x7f9e14158da0 2024-08-17T02:46:12.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.280+0000 7f9e0a000640 1 -- 172.21.15.100:0/2623778241 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9e140ca140 con 0x7f9e14158da0 2024-08-17T02:46:12.282 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-08-17T02:46:12.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.282+0000 7f9e19a00640 1 -- 172.21.15.100:0/2623778241 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9df4065150 msgr2=0x7f9df4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.282+0000 7f9e19a00640 1 --2- 172.21.15.100:0/2623778241 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9df4065150 0x7f9df4067600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9e04007fd0 tx=0x7f9e04007e30 comp rx=0 tx=0).stop 2024-08-17T02:46:12.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.282+0000 7f9e19a00640 1 -- 172.21.15.100:0/2623778241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e14158da0 msgr2=0x7f9e1415a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.282+0000 7f9e19a00640 1 --2- 172.21.15.100:0/2623778241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e14158da0 0x7f9e1415a420 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009210 tx=0x7f9e00032000 comp rx=0 tx=0).stop 2024-08-17T02:46:12.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.282+0000 7f9e19a00640 1 -- 172.21.15.100:0/2623778241 shutdown_connections 2024-08-17T02:46:12.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.282+0000 7f9e19a00640 1 --2- 172.21.15.100:0/2623778241 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9df4065150 0x7f9df4067600 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.282+0000 7f9e19a00640 1 --2- 172.21.15.100:0/2623778241 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9e140c9670 0x7f9e1415a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.282+0000 7f9e19a00640 1 --2- 172.21.15.100:0/2623778241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e14158da0 0x7f9e1415a420 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.282+0000 7f9e19a00640 1 --2- 172.21.15.100:0/2623778241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e140aaf20 0x7f9e140c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.282+0000 7f9e19a00640 1 -- 172.21.15.100:0/2623778241 >> 172.21.15.100:0/2623778241 conn(0x7f9e14096a70 msgr2=0x7f9e1406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:12.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.282+0000 7f9e19a00640 1 -- 172.21.15.100:0/2623778241 shutdown_connections 2024-08-17T02:46:12.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.282+0000 7f9e19a00640 1 -- 172.21.15.100:0/2623778241 wait complete. 2024-08-17T02:46:12.372 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-17T02:46:12.372 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:46:12.372 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:12.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.517+0000 7fefabc00640 1 Processor -- start 2024-08-17T02:46:12.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.517+0000 7fefabc00640 1 -- start start 2024-08-17T02:46:12.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.519+0000 7fefabc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fefa406df00 0x7fefa40adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.519+0000 7fefabc00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fefa4155df0 0x7fefa40ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.519+0000 7fefabc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa4156670 con 0x7fefa4155a20 2024-08-17T02:46:12.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.519+0000 7fefabc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa40b0350 con 0x7fefa406df00 2024-08-17T02:46:12.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.519+0000 7fefabc00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa406e5e0 con 0x7fefa4155df0 2024-08-17T02:46:12.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.519+0000 7fef9be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fefa406df00 0x7fefa40adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.519+0000 7fef9be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fefa406df00 0x7fefa40adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45280/0 (socket says 172.21.15.100:45280) 2024-08-17T02:46:12.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.519+0000 7fef9be00640 1 -- 172.21.15.100:0/162310748 learned_addr learned my addr 172.21.15.100:0/162310748 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:12.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.519+0000 7fefa9200640 1 --1- 172.21.15.100:0/162310748 >> v1:172.21.15.100:6789/0 conn(0x7fefa4155a20 0x7fefa406d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45562/0 (socket says 172.21.15.100:45562) 2024-08-17T02:46:12.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.519+0000 7fefa9c00640 1 --2- 172.21.15.100:0/162310748 >> v2:172.21.15.123:3300/0 conn(0x7fefa4155df0 0x7fefa40ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.519+0000 7fef9be00640 1 -- 172.21.15.100:0/162310748 >> v2:172.21.15.123:3300/0 conn(0x7fefa4155df0 msgr2=0x7fefa40ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:12.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.519+0000 7fef9be00640 1 --2- 172.21.15.100:0/162310748 >> v2:172.21.15.123:3300/0 conn(0x7fefa4155df0 0x7fefa40ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.519+0000 7fef9be00640 1 -- 172.21.15.100:0/162310748 >> v1:172.21.15.100:6789/0 conn(0x7fefa4155a20 legacy=0x7fefa406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.519+0000 7fef9be00640 1 -- 172.21.15.100:0/162310748 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa406e8c0 con 0x7fefa406df00 2024-08-17T02:46:12.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.519+0000 7fefa3e00640 1 -- 172.21.15.100:0/162310748 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1401212937 0 0) 0x7fefa4156670 con 0x7fefa4155a20 2024-08-17T02:46:12.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.520+0000 7fef9be00640 1 --2- 172.21.15.100:0/162310748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa406df00 0x7fefa40adf10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fefa40b0710 tx=0x7fef8c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806c7775207db618 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:12.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.521+0000 7fefa3e00640 1 -- 172.21.15.100:0/162310748 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c02adf0 con 0x7fefa406df00 2024-08-17T02:46:12.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.521+0000 7fefa3e00640 1 -- 172.21.15.100:0/162310748 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8c032440 con 0x7fefa406df00 2024-08-17T02:46:12.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.521+0000 7fefa3e00640 1 -- 172.21.15.100:0/162310748 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c0327e0 con 0x7fefa406df00 2024-08-17T02:46:12.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.521+0000 7fefabc00640 1 -- 172.21.15.100:0/162310748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa406df00 msgr2=0x7fefa40adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.521+0000 7fefabc00640 1 --2- 172.21.15.100:0/162310748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa406df00 0x7fefa40adf10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fefa40b0710 tx=0x7fef8c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.521+0000 7fefabc00640 1 -- 172.21.15.100:0/162310748 shutdown_connections 2024-08-17T02:46:12.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.521+0000 7fefabc00640 1 --2- 172.21.15.100:0/162310748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa406df00 0x7fefa40adf10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.521+0000 7fefabc00640 1 --2- 172.21.15.100:0/162310748 >> v2:172.21.15.123:3300/0 conn(0x7fefa4155df0 0x7fefa40ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.521+0000 7fefabc00640 1 -- 172.21.15.100:0/162310748 >> 172.21.15.100:0/162310748 conn(0x7fefa40cb9b0 msgr2=0x7fefa40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:12.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.521+0000 7fefabc00640 1 -- 172.21.15.100:0/162310748 shutdown_connections 2024-08-17T02:46:12.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.521+0000 7fefabc00640 1 -- 172.21.15.100:0/162310748 wait complete. 2024-08-17T02:46:12.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.523+0000 7fefabc00640 1 Processor -- start 2024-08-17T02:46:12.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.523+0000 7fefabc00640 1 -- start start 2024-08-17T02:46:12.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.524+0000 7fefabc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa406df00 0x7fefa40c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.524+0000 7fefabc00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefa4155a20 0x7fefa4140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.524+0000 7fefabc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefa4155df0 0x7fefa416c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.524+0000 7fefabc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa416a310 con 0x7fefa406df00 2024-08-17T02:46:12.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.524+0000 7fefabc00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa40c0f70 con 0x7fefa4155df0 2024-08-17T02:46:12.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.524+0000 7fefabc00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa4155140 con 0x7fefa4155a20 2024-08-17T02:46:12.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.524+0000 7fefa9200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa406df00 0x7fefa40c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.524+0000 7fefa9200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa406df00 0x7fefa40c0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45290/0 (socket says 172.21.15.100:45290) 2024-08-17T02:46:12.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.524+0000 7fefa9200640 1 -- 172.21.15.100:0/3183008045 learned_addr learned my addr 172.21.15.100:0/3183008045 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:12.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.524+0000 7fefa9200640 1 -- 172.21.15.100:0/3183008045 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefa4155a20 msgr2=0x7fefa4140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.524+0000 7fefa9200640 1 --2- 172.21.15.100:0/3183008045 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefa4155a20 0x7fefa4140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.524+0000 7fefa9200640 1 -- 172.21.15.100:0/3183008045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefa4155df0 msgr2=0x7fefa416c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.524+0000 7fefa9200640 1 --2- 172.21.15.100:0/3183008045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefa4155df0 0x7fefa416c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.524+0000 7fefa9200640 1 -- 172.21.15.100:0/3183008045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c009450 con 0x7fefa406df00 2024-08-17T02:46:12.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.525+0000 7fefa9200640 1 --2- 172.21.15.100:0/3183008045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa406df00 0x7fefa40c0a30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fef9400c600 tx=0x7fef94007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:12.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.525+0000 7fefa0c00640 1 -- 172.21.15.100:0/3183008045 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef940073d0 con 0x7fefa406df00 2024-08-17T02:46:12.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.525+0000 7fefa0c00640 1 -- 172.21.15.100:0/3183008045 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef94007550 con 0x7fefa406df00 2024-08-17T02:46:12.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.525+0000 7fefabc00640 1 -- 172.21.15.100:0/3183008045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa41548a0 con 0x7fefa406df00 2024-08-17T02:46:12.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.525+0000 7fefa0c00640 1 -- 172.21.15.100:0/3183008045 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef940049f0 con 0x7fefa406df00 2024-08-17T02:46:12.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.525+0000 7fefabc00640 1 -- 172.21.15.100:0/3183008045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa4154ee0 con 0x7fefa406df00 2024-08-17T02:46:12.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.526+0000 7fefabc00640 1 -- 172.21.15.100:0/3183008045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa4064db0 con 0x7fefa406df00 2024-08-17T02:46:12.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.527+0000 7fefa0c00640 1 -- 172.21.15.100:0/3183008045 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fef9401c3b0 con 0x7fefa406df00 2024-08-17T02:46:12.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.527+0000 7fefa0c00640 1 --2- 172.21.15.100:0/3183008045 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fef80065150 0x7fef80067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.528+0000 7fefa0c00640 1 -- 172.21.15.100:0/3183008045 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fef94081a00 con 0x7fefa406df00 2024-08-17T02:46:12.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.528+0000 7fef9be00640 1 --2- 172.21.15.100:0/3183008045 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fef80065150 0x7fef80067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.528+0000 7fef9be00640 1 --2- 172.21.15.100:0/3183008045 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fef80065150 0x7fef80067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fef8c034000 tx=0x7fef8c032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:12.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.532+0000 7fefa0c00640 1 -- 172.21.15.100:0/3183008045 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fef9404fb60 con 0x7fefa406df00 2024-08-17T02:46:12.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.706+0000 7fefabc00640 1 -- 172.21.15.100:0/3183008045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefa4068a00 con 0x7fefa406df00 2024-08-17T02:46:12.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.707+0000 7fefa0c00640 1 -- 172.21.15.100:0/3183008045 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fef94018070 con 0x7fefa406df00 2024-08-17T02:46:12.709 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:12.709 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:42.845503+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:45:39.036964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:45:40.232954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:12.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.709+0000 7fefabc00640 1 -- 172.21.15.100:0/3183008045 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fef80065150 msgr2=0x7fef80067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.709+0000 7fefabc00640 1 --2- 172.21.15.100:0/3183008045 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fef80065150 0x7fef80067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fef8c034000 tx=0x7fef8c032000 comp rx=0 tx=0).stop 2024-08-17T02:46:12.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.709+0000 7fefabc00640 1 -- 172.21.15.100:0/3183008045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa406df00 msgr2=0x7fefa40c0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.709+0000 7fefabc00640 1 --2- 172.21.15.100:0/3183008045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa406df00 0x7fefa40c0a30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fef9400c600 tx=0x7fef94007d80 comp rx=0 tx=0).stop 2024-08-17T02:46:12.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.709+0000 7fefabc00640 1 -- 172.21.15.100:0/3183008045 shutdown_connections 2024-08-17T02:46:12.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.709+0000 7fefabc00640 1 --2- 172.21.15.100:0/3183008045 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fef80065150 0x7fef80067600 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.709+0000 7fefabc00640 1 --2- 172.21.15.100:0/3183008045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefa4155df0 0x7fefa416c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.709+0000 7fefabc00640 1 --2- 172.21.15.100:0/3183008045 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefa4155a20 0x7fefa4140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.709+0000 7fefabc00640 1 --2- 172.21.15.100:0/3183008045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa406df00 0x7fefa40c0a30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.709+0000 7fefabc00640 1 -- 172.21.15.100:0/3183008045 >> 172.21.15.100:0/3183008045 conn(0x7fefa40cb9b0 msgr2=0x7fefa406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:12.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.709+0000 7fefabc00640 1 -- 172.21.15.100:0/3183008045 shutdown_connections 2024-08-17T02:46:12.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.709+0000 7fefabc00640 1 -- 172.21.15.100:0/3183008045 wait complete. 2024-08-17T02:46:12.727 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:45:35.140990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:45:39.036964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:45:40.232954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:46:12.727 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:12.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.878+0000 7faf61c00640 1 Processor -- start 2024-08-17T02:46:12.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.878+0000 7faf61c00640 1 -- start start 2024-08-17T02:46:12.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.880+0000 7faf61c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf5c0ac750 0x7faf5c068fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.880+0000 7faf61c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faf5c069510 0x7faf5c0af130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.880+0000 7faf61c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5c0aeca0 con 0x7faf5c158c20 2024-08-17T02:46:12.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.880+0000 7faf61c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5c0ae3e0 con 0x7faf5c069510 2024-08-17T02:46:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.880+0000 7faf61c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c0ae650 con 0x7faf5c0ac750 2024-08-17T02:46:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.880+0000 7faf5be00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7faf5c158c20 0x7faf5c0ac040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45578/0 (socket says 172.21.15.100:45578) 2024-08-17T02:46:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.880+0000 7faf5be00640 1 -- 172.21.15.100:0/1487483185 learned_addr learned my addr 172.21.15.100:0/1487483185 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.880+0000 7faf53400640 1 --2- 172.21.15.100:0/1487483185 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf5c0ac750 0x7faf5c068fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.880+0000 7faf61200640 1 --2- 172.21.15.100:0/1487483185 >> v2:172.21.15.123:3300/0 conn(0x7faf5c069510 0x7faf5c0af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.880+0000 7faf5b400640 1 -- 172.21.15.100:0/1487483185 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3353121557 0 0) 0x7faf5c0aeca0 con 0x7faf5c158c20 2024-08-17T02:46:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.880+0000 7faf5b400640 1 -- 172.21.15.100:0/1487483185 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf400034e0 con 0x7faf5c158c20 2024-08-17T02:46:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.881+0000 7faf53400640 1 -- 172.21.15.100:0/1487483185 >> v2:172.21.15.123:3300/0 conn(0x7faf5c069510 msgr2=0x7faf5c0af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.881+0000 7faf53400640 1 --2- 172.21.15.100:0/1487483185 >> v2:172.21.15.123:3300/0 conn(0x7faf5c069510 0x7faf5c0af130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.881+0000 7faf53400640 1 -- 172.21.15.100:0/1487483185 >> v1:172.21.15.100:6789/0 conn(0x7faf5c158c20 legacy=0x7faf5c0ac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.881+0000 7faf5b400640 1 -- 172.21.15.100:0/1487483185 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2696492905 0 0) 0x7faf400034e0 con 0x7faf5c158c20 2024-08-17T02:46:12.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.881+0000 7faf53400640 1 -- 172.21.15.100:0/1487483185 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c0ae930 con 0x7faf5c0ac750 2024-08-17T02:46:12.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.881+0000 7faf61200640 1 --2- 172.21.15.100:0/1487483185 >> v2:172.21.15.123:3300/0 conn(0x7faf5c069510 0x7faf5c0af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:12.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.882+0000 7faf53400640 1 --2- 172.21.15.100:0/1487483185 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf5c0ac750 0x7faf5c068fd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faf44009850 tx=0x7faf440090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=294665aaf48ba8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:12.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.882+0000 7faf5b400640 1 -- 172.21.15.100:0/1487483185 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4402ad00 con 0x7faf5c0ac750 2024-08-17T02:46:12.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.882+0000 7faf5b400640 1 -- 172.21.15.100:0/1487483185 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4402ae60 con 0x7faf5c0ac750 2024-08-17T02:46:12.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.882+0000 7faf5b400640 1 -- 172.21.15.100:0/1487483185 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf44032670 con 0x7faf5c0ac750 2024-08-17T02:46:12.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.882+0000 7faf61c00640 1 -- 172.21.15.100:0/1487483185 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf5c0ac750 msgr2=0x7faf5c068fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.882+0000 7faf61c00640 1 --2- 172.21.15.100:0/1487483185 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf5c0ac750 0x7faf5c068fd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faf44009850 tx=0x7faf440090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.883+0000 7faf61c00640 1 -- 172.21.15.100:0/1487483185 shutdown_connections 2024-08-17T02:46:12.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.883+0000 7faf61c00640 1 --2- 172.21.15.100:0/1487483185 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf5c0ac750 0x7faf5c068fd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.883+0000 7faf61c00640 1 --2- 172.21.15.100:0/1487483185 >> v2:172.21.15.123:3300/0 conn(0x7faf5c069510 0x7faf5c0af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.883+0000 7faf61c00640 1 -- 172.21.15.100:0/1487483185 >> 172.21.15.100:0/1487483185 conn(0x7faf5c096a70 msgr2=0x7faf5c096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:12.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.883+0000 7faf61c00640 1 -- 172.21.15.100:0/1487483185 shutdown_connections 2024-08-17T02:46:12.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.883+0000 7faf61c00640 1 -- 172.21.15.100:0/1487483185 wait complete. 2024-08-17T02:46:12.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.884+0000 7faf61c00640 1 Processor -- start 2024-08-17T02:46:12.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.884+0000 7faf61c00640 1 -- start start 2024-08-17T02:46:12.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.885+0000 7faf61c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf5c069510 0x7faf5c14e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.885+0000 7faf61c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf5c0ac750 0x7faf5c169670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.885+0000 7faf61c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf5c158c20 0x7faf5c15acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.885+0000 7faf61c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c169bb0 con 0x7faf5c158c20 2024-08-17T02:46:12.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.885+0000 7faf61c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c14ea50 con 0x7faf5c0ac750 2024-08-17T02:46:12.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.885+0000 7faf61c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c15c8f0 con 0x7faf5c069510 2024-08-17T02:46:12.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.885+0000 7faf61200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf5c158c20 0x7faf5c15acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.885+0000 7faf61200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf5c158c20 0x7faf5c15acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45306/0 (socket says 172.21.15.100:45306) 2024-08-17T02:46:12.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.885+0000 7faf61200640 1 -- 172.21.15.100:0/4236773084 learned_addr learned my addr 172.21.15.100:0/4236773084 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:12.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.885+0000 7faf5be00640 1 --2- 172.21.15.100:0/4236773084 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf5c069510 0x7faf5c14e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.886+0000 7faf53400640 1 --2- 172.21.15.100:0/4236773084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf5c0ac750 0x7faf5c169670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.886+0000 7faf61200640 1 -- 172.21.15.100:0/4236773084 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf5c069510 msgr2=0x7faf5c14e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.886+0000 7faf61200640 1 --2- 172.21.15.100:0/4236773084 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf5c069510 0x7faf5c14e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.886+0000 7faf61200640 1 -- 172.21.15.100:0/4236773084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf5c0ac750 msgr2=0x7faf5c169670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.886+0000 7faf61200640 1 --2- 172.21.15.100:0/4236773084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf5c0ac750 0x7faf5c169670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.886+0000 7faf61200640 1 -- 172.21.15.100:0/4236773084 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf54009a20 con 0x7faf5c158c20 2024-08-17T02:46:12.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.886+0000 7faf53400640 1 --2- 172.21.15.100:0/4236773084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf5c0ac750 0x7faf5c169670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:12.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.886+0000 7faf61200640 1 --2- 172.21.15.100:0/4236773084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf5c158c20 0x7faf5c15acf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faf5400c0f0 tx=0x7faf5400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:12.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.886+0000 7faf53e00640 1 -- 172.21.15.100:0/4236773084 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5400ced0 con 0x7faf5c158c20 2024-08-17T02:46:12.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.886+0000 7faf53e00640 1 -- 172.21.15.100:0/4236773084 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5400f040 con 0x7faf5c158c20 2024-08-17T02:46:12.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.886+0000 7faf61c00640 1 -- 172.21.15.100:0/4236773084 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf44009390 con 0x7faf5c158c20 2024-08-17T02:46:12.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.886+0000 7faf53e00640 1 -- 172.21.15.100:0/4236773084 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf540146d0 con 0x7faf5c158c20 2024-08-17T02:46:12.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.886+0000 7faf61c00640 1 -- 172.21.15.100:0/4236773084 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c15b230 con 0x7faf5c158c20 2024-08-17T02:46:12.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.887+0000 7faf61c00640 1 -- 172.21.15.100:0/4236773084 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5c071050 con 0x7faf5c158c20 2024-08-17T02:46:12.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.888+0000 7faf53e00640 1 -- 172.21.15.100:0/4236773084 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faf54003020 con 0x7faf5c158c20 2024-08-17T02:46:12.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.889+0000 7faf53e00640 1 --2- 172.21.15.100:0/4236773084 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7faf38065150 0x7faf38067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.889+0000 7faf53e00640 1 -- 172.21.15.100:0/4236773084 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf54082f70 con 0x7faf5c158c20 2024-08-17T02:46:12.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.889+0000 7faf5be00640 1 --2- 172.21.15.100:0/4236773084 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7faf38065150 0x7faf38067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.890+0000 7faf5be00640 1 --2- 172.21.15.100:0/4236773084 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7faf38065150 0x7faf38067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faf4c007650 tx=0x7faf4c007b40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:12.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:12.893+0000 7faf53e00640 1 -- 172.21.15.100:0/4236773084 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faf54054a20 con 0x7faf5c158c20 2024-08-17T02:46:13.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.062+0000 7faf61c00640 1 -- 172.21.15.100:0/4236773084 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faf5c0acf80 con 0x7faf5c158c20 2024-08-17T02:46:13.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.062+0000 7faf53e00640 1 -- 172.21.15.100:0/4236773084 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7faf540545b0 con 0x7faf5c158c20 2024-08-17T02:46:13.064 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-08-17T02:46:13.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.064+0000 7faf61c00640 1 -- 172.21.15.100:0/4236773084 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7faf38065150 msgr2=0x7faf38067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.064+0000 7faf61c00640 1 --2- 172.21.15.100:0/4236773084 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7faf38065150 0x7faf38067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faf4c007650 tx=0x7faf4c007b40 comp rx=0 tx=0).stop 2024-08-17T02:46:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.064+0000 7faf61c00640 1 -- 172.21.15.100:0/4236773084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf5c158c20 msgr2=0x7faf5c15acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.064+0000 7faf61c00640 1 --2- 172.21.15.100:0/4236773084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf5c158c20 0x7faf5c15acf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faf5400c0f0 tx=0x7faf5400b040 comp rx=0 tx=0).stop 2024-08-17T02:46:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.065+0000 7faf61c00640 1 -- 172.21.15.100:0/4236773084 shutdown_connections 2024-08-17T02:46:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.065+0000 7faf61c00640 1 --2- 172.21.15.100:0/4236773084 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7faf38065150 0x7faf38067600 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.065+0000 7faf61c00640 1 --2- 172.21.15.100:0/4236773084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf5c158c20 0x7faf5c15acf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.065+0000 7faf61c00640 1 --2- 172.21.15.100:0/4236773084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf5c0ac750 0x7faf5c169670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.065+0000 7faf61c00640 1 --2- 172.21.15.100:0/4236773084 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf5c069510 0x7faf5c14e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.065+0000 7faf61c00640 1 -- 172.21.15.100:0/4236773084 >> 172.21.15.100:0/4236773084 conn(0x7faf5c096a70 msgr2=0x7faf5c0682f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.065+0000 7faf61c00640 1 -- 172.21.15.100:0/4236773084 shutdown_connections 2024-08-17T02:46:13.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.065+0000 7faf61c00640 1 -- 172.21.15.100:0/4236773084 wait complete. 2024-08-17T02:46:13.082 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:46:13.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.232+0000 7f95f2e00640 1 Processor -- start 2024-08-17T02:46:13.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.232+0000 7f95f2e00640 1 -- start start 2024-08-17T02:46:13.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.233+0000 7f95f2e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f95ec155550 0x7f95ec069e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.233+0000 7f95f2e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95ec0c7e50 0x7f95ec06a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.233+0000 7f95f2e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ec06d470 con 0x7f95ec069a60 2024-08-17T02:46:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.233+0000 7f95f2e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95ec0c8250 con 0x7f95ec155550 2024-08-17T02:46:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.233+0000 7f95f2e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec0aec60 con 0x7f95ec0c7e50 2024-08-17T02:46:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.234+0000 7f95e3400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f95ec155550 0x7f95ec069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.234+0000 7f95e3400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f95ec155550 0x7f95ec069e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45318/0 (socket says 172.21.15.100:45318) 2024-08-17T02:46:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.234+0000 7f95e3400640 1 -- 172.21.15.100:0/1035180634 learned_addr learned my addr 172.21.15.100:0/1035180634 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.234+0000 7f95e3400640 1 -- 172.21.15.100:0/1035180634 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95ec0c7e50 msgr2=0x7f95ec06a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.234+0000 7f95e3400640 1 --2- 172.21.15.100:0/1035180634 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95ec0c7e50 0x7f95ec06a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.234+0000 7f95e3400640 1 -- 172.21.15.100:0/1035180634 >> v1:172.21.15.100:6789/0 conn(0x7f95ec069a60 legacy=0x7f95ec154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.234+0000 7f95e3400640 1 -- 172.21.15.100:0/1035180634 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec06c860 con 0x7f95ec155550 2024-08-17T02:46:13.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.235+0000 7f95e3400640 1 --2- 172.21.15.100:0/1035180634 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95ec155550 0x7f95ec069e30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f95d4009910 tx=0x7f95d40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89d97d4a242ff32 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:13.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.235+0000 7f95eb400640 1 -- 172.21.15.100:0/1035180634 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d402add0 con 0x7f95ec155550 2024-08-17T02:46:13.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.235+0000 7f95eb400640 1 -- 172.21.15.100:0/1035180634 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d4032440 con 0x7f95ec155550 2024-08-17T02:46:13.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.235+0000 7f95eb400640 1 -- 172.21.15.100:0/1035180634 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d4032820 con 0x7f95ec155550 2024-08-17T02:46:13.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.236+0000 7f95f2e00640 1 -- 172.21.15.100:0/1035180634 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95ec155550 msgr2=0x7f95ec069e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.236+0000 7f95f2e00640 1 --2- 172.21.15.100:0/1035180634 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95ec155550 0x7f95ec069e30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f95d4009910 tx=0x7f95d40091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.236+0000 7f95f2e00640 1 -- 172.21.15.100:0/1035180634 shutdown_connections 2024-08-17T02:46:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.236+0000 7f95f2e00640 1 --2- 172.21.15.100:0/1035180634 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95ec0c7e50 0x7f95ec06a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.236+0000 7f95f2e00640 1 --2- 172.21.15.100:0/1035180634 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95ec155550 0x7f95ec069e30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.236+0000 7f95f2e00640 1 -- 172.21.15.100:0/1035180634 >> 172.21.15.100:0/1035180634 conn(0x7f95ec067750 msgr2=0x7f95ec0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:13.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.236+0000 7f95f2e00640 1 -- 172.21.15.100:0/1035180634 shutdown_connections 2024-08-17T02:46:13.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.236+0000 7f95f2e00640 1 -- 172.21.15.100:0/1035180634 wait complete. 2024-08-17T02:46:13.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.237+0000 7f95f2e00640 1 Processor -- start 2024-08-17T02:46:13.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.237+0000 7f95f2e00640 1 -- start start 2024-08-17T02:46:13.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.238+0000 7f95f2e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95ec069a60 0x7f95ec0a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.238+0000 7f95f2e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95ec0c7e50 0x7f95ec14fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.238+0000 7f95f2e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95ec155550 0x7f95ec0ac160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.238+0000 7f95f2e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec0ad1d0 con 0x7f95ec0c7e50 2024-08-17T02:46:13.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.238+0000 7f95f2e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec16e6f0 con 0x7f95ec069a60 2024-08-17T02:46:13.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.238+0000 7f95f2e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec0ac6a0 con 0x7f95ec155550 2024-08-17T02:46:13.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.239+0000 7f95e3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95ec0c7e50 0x7f95ec14fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.239+0000 7f95e3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95ec0c7e50 0x7f95ec14fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45322/0 (socket says 172.21.15.100:45322) 2024-08-17T02:46:13.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.239+0000 7f95e3400640 1 -- 172.21.15.100:0/582151636 learned_addr learned my addr 172.21.15.100:0/582151636 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:13.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.239+0000 7f95f0e00640 1 --2- 172.21.15.100:0/582151636 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95ec155550 0x7f95ec0ac160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.239+0000 7f95ebe00640 1 --2- 172.21.15.100:0/582151636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95ec069a60 0x7f95ec0a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.239+0000 7f95e3400640 1 -- 172.21.15.100:0/582151636 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95ec155550 msgr2=0x7f95ec0ac160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.239+0000 7f95e3400640 1 --2- 172.21.15.100:0/582151636 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95ec155550 0x7f95ec0ac160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.239+0000 7f95e3400640 1 -- 172.21.15.100:0/582151636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95ec069a60 msgr2=0x7f95ec0a60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.239+0000 7f95e3400640 1 --2- 172.21.15.100:0/582151636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95ec069a60 0x7f95ec0a60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.239+0000 7f95e3400640 1 -- 172.21.15.100:0/582151636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d4009450 con 0x7f95ec0c7e50 2024-08-17T02:46:13.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.239+0000 7f95e3400640 1 --2- 172.21.15.100:0/582151636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95ec0c7e50 0x7f95ec14fcf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f95d4035040 tx=0x7f95d4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:13.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.240+0000 7f95e3e00640 1 -- 172.21.15.100:0/582151636 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d4031a60 con 0x7f95ec0c7e50 2024-08-17T02:46:13.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.240+0000 7f95e3e00640 1 -- 172.21.15.100:0/582151636 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d4031be0 con 0x7f95ec0c7e50 2024-08-17T02:46:13.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.240+0000 7f95e3e00640 1 -- 172.21.15.100:0/582151636 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d403d420 con 0x7f95ec0c7e50 2024-08-17T02:46:13.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.240+0000 7f95f2e00640 1 -- 172.21.15.100:0/582151636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ec0ac930 con 0x7f95ec0c7e50 2024-08-17T02:46:13.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.240+0000 7f95f2e00640 1 -- 172.21.15.100:0/582151636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ec0acef0 con 0x7f95ec0c7e50 2024-08-17T02:46:13.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.241+0000 7f95f2e00640 1 -- 172.21.15.100:0/582151636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ec071050 con 0x7f95ec0c7e50 2024-08-17T02:46:13.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.241+0000 7f95e3e00640 1 -- 172.21.15.100:0/582151636 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f95d4039040 con 0x7f95ec0c7e50 2024-08-17T02:46:13.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.242+0000 7f95e3e00640 1 --2- 172.21.15.100:0/582151636 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f95c8065150 0x7f95c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.242+0000 7f95e3e00640 1 -- 172.21.15.100:0/582151636 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f95d40a21b0 con 0x7f95ec0c7e50 2024-08-17T02:46:13.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.242+0000 7f95ebe00640 1 --2- 172.21.15.100:0/582151636 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f95c8065150 0x7f95c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.243+0000 7f95ebe00640 1 --2- 172.21.15.100:0/582151636 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f95c8065150 0x7f95c8067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f95dc0037c0 tx=0x7f95dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:13.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.246+0000 7f95e3e00640 1 -- 172.21.15.100:0/582151636 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f95d40701d0 con 0x7f95ec0c7e50 2024-08-17T02:46:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.416+0000 7f95f2e00640 1 -- 172.21.15.100:0/582151636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f95ec06a370 con 0x7f95ec0c7e50 2024-08-17T02:46:13.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.416+0000 7f95e3e00640 1 -- 172.21.15.100:0/582151636 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f95d40737f0 con 0x7f95ec0c7e50 2024-08-17T02:46:13.418 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-08-17T02:46:13.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.418+0000 7f95f2e00640 1 -- 172.21.15.100:0/582151636 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f95c8065150 msgr2=0x7f95c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.418+0000 7f95f2e00640 1 --2- 172.21.15.100:0/582151636 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f95c8065150 0x7f95c8067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f95dc0037c0 tx=0x7f95dc009040 comp rx=0 tx=0).stop 2024-08-17T02:46:13.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.418+0000 7f95f2e00640 1 -- 172.21.15.100:0/582151636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95ec0c7e50 msgr2=0x7f95ec14fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.418+0000 7f95f2e00640 1 --2- 172.21.15.100:0/582151636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95ec0c7e50 0x7f95ec14fcf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f95d4035040 tx=0x7f95d4032000 comp rx=0 tx=0).stop 2024-08-17T02:46:13.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.418+0000 7f95f2e00640 1 -- 172.21.15.100:0/582151636 shutdown_connections 2024-08-17T02:46:13.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.418+0000 7f95f2e00640 1 --2- 172.21.15.100:0/582151636 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f95c8065150 0x7f95c8067600 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.418+0000 7f95f2e00640 1 --2- 172.21.15.100:0/582151636 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95ec155550 0x7f95ec0ac160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.418+0000 7f95f2e00640 1 --2- 172.21.15.100:0/582151636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95ec0c7e50 0x7f95ec14fcf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.418+0000 7f95f2e00640 1 --2- 172.21.15.100:0/582151636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95ec069a60 0x7f95ec0a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.418+0000 7f95f2e00640 1 -- 172.21.15.100:0/582151636 >> 172.21.15.100:0/582151636 conn(0x7f95ec067750 msgr2=0x7f95ec0c8390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:13.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.419+0000 7f95f2e00640 1 -- 172.21.15.100:0/582151636 shutdown_connections 2024-08-17T02:46:13.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.419+0000 7f95f2e00640 1 -- 172.21.15.100:0/582151636 wait complete. 2024-08-17T02:46:13.436 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:46:13.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.585+0000 7f1f90e00640 1 Processor -- start 2024-08-17T02:46:13.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.585+0000 7f1f90e00640 1 -- start start 2024-08-17T02:46:13.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.586+0000 7f1f90e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1f8c097180 0x7f1f8c0ab5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.586+0000 7f1f90e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8c0ad290 con 0x7f1f8c15c5c0 2024-08-17T02:46:13.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.586+0000 7f1f90e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8c0b0e20 con 0x7f1f8c15c1f0 2024-08-17T02:46:13.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.586+0000 7f1f90e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8c0ac370 con 0x7f1f8c097180 2024-08-17T02:46:13.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.587+0000 7f1f8a800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1f8c15c5c0 0x7f1f8c0abae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45598/0 (socket says 172.21.15.100:45598) 2024-08-17T02:46:13.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.587+0000 7f1f8a800640 1 -- 172.21.15.100:0/307177324 learned_addr learned my addr 172.21.15.100:0/307177324 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:13.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.587+0000 7f1f89400640 1 --2- 172.21.15.100:0/307177324 >> v2:172.21.15.123:3300/0 conn(0x7f1f8c097180 0x7f1f8c0ab5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.587+0000 7f1f88a00640 1 -- 172.21.15.100:0/307177324 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906871405 0 0) 0x7f1f8c0ad290 con 0x7f1f8c15c5c0 2024-08-17T02:46:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.587+0000 7f1f88a00640 1 -- 172.21.15.100:0/307177324 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f700034e0 con 0x7f1f8c15c5c0 2024-08-17T02:46:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.587+0000 7f1f88a00640 1 -- 172.21.15.100:0/307177324 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 827132299 0 0) 0x7f1f700034e0 con 0x7f1f8c15c5c0 2024-08-17T02:46:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.587+0000 7f1f88a00640 1 -- 172.21.15.100:0/307177324 >> v2:172.21.15.123:3300/0 conn(0x7f1f8c097180 msgr2=0x7f1f8c0ab5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.587+0000 7f1f88a00640 1 --2- 172.21.15.100:0/307177324 >> v2:172.21.15.123:3300/0 conn(0x7f1f8c097180 0x7f1f8c0ab5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.587+0000 7f1f88a00640 1 -- 172.21.15.100:0/307177324 >> v1:172.21.15.123:6789/0 conn(0x7f1f8c15c1f0 legacy=0x7f1f8c096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.587+0000 7f1f88a00640 1 -- 172.21.15.100:0/307177324 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c0ac650 con 0x7f1f8c15c5c0 2024-08-17T02:46:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.587+0000 7f1f88a00640 1 -- 172.21.15.100:0/307177324 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1817143124 0 0) 0x7f1f840017f0 con 0x7f1f8c15c5c0 2024-08-17T02:46:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.587+0000 7f1f88a00640 1 -- 172.21.15.100:0/307177324 >> v1:172.21.15.100:6789/0 conn(0x7f1f8c15c5c0 legacy=0x7f1f8c0abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.587+0000 7f1f88a00640 1 --2- 172.21.15.100:0/307177324 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f70003a20 0x7f1f70003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.588+0000 7f1f88a00640 1 --2- 172.21.15.100:0/307177324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f70004780 0x7f1f70004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.588+0000 7f1f88a00640 1 --2- 172.21.15.100:0/307177324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f70005180 0x7f1f7000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.588+0000 7f1f88a00640 1 -- 172.21.15.100:0/307177324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0ac370 con 0x7f1f70005180 2024-08-17T02:46:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.588+0000 7f1f88a00640 1 -- 172.21.15.100:0/307177324 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7000c0a0 con 0x7f1f70004780 2024-08-17T02:46:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.588+0000 7f1f88a00640 1 -- 172.21.15.100:0/307177324 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7000c230 con 0x7f1f70003a20 2024-08-17T02:46:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.588+0000 7f1f8a800640 1 --2- 172.21.15.100:0/307177324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f70005180 0x7f1f7000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.588+0000 7f1f89400640 1 --2- 172.21.15.100:0/307177324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f70004780 0x7f1f70004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.588+0000 7f1f89e00640 1 --2- 172.21.15.100:0/307177324 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f70003a20 0x7f1f70003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.588+0000 7f1f8a800640 1 -- 172.21.15.100:0/307177324 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f70003a20 msgr2=0x7f1f70003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.588+0000 7f1f8a800640 1 --2- 172.21.15.100:0/307177324 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f70003a20 0x7f1f70003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.588+0000 7f1f8a800640 1 -- 172.21.15.100:0/307177324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f70004780 msgr2=0x7f1f70004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.588+0000 7f1f8a800640 1 --2- 172.21.15.100:0/307177324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f70004780 0x7f1f70004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.588+0000 7f1f8a800640 1 -- 172.21.15.100:0/307177324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f700034e0 con 0x7f1f70005180 2024-08-17T02:46:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.588+0000 7f1f89400640 1 --2- 172.21.15.100:0/307177324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f70004780 0x7f1f70004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.589+0000 7f1f8a800640 1 -- 172.21.15.100:0/307177324 reap_dead start 2024-08-17T02:46:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.589+0000 7f1f8a800640 1 --2- 172.21.15.100:0/307177324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f70005180 0x7f1f7000b9d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400a880 tx=0x7f1f84002120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f823d63210fb511e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:13.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.589+0000 7f1f88a00640 1 -- 172.21.15.100:0/307177324 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f840070f0 con 0x7f1f70005180 2024-08-17T02:46:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.589+0000 7f1f88a00640 1 -- 172.21.15.100:0/307177324 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f84007270 con 0x7f1f70005180 2024-08-17T02:46:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.589+0000 7f1f88a00640 1 -- 172.21.15.100:0/307177324 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84007630 con 0x7f1f70005180 2024-08-17T02:46:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.590+0000 7f1f90e00640 1 -- 172.21.15.100:0/307177324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f70005180 msgr2=0x7f1f7000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.590+0000 7f1f90e00640 1 --2- 172.21.15.100:0/307177324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f70005180 0x7f1f7000b9d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400a880 tx=0x7f1f84002120 comp rx=0 tx=0).stop 2024-08-17T02:46:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.590+0000 7f1f90e00640 1 -- 172.21.15.100:0/307177324 shutdown_connections 2024-08-17T02:46:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.590+0000 7f1f90e00640 1 --2- 172.21.15.100:0/307177324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f70005180 0x7f1f7000b9d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.590+0000 7f1f90e00640 1 -- 172.21.15.100:0/307177324 >> 172.21.15.100:0/307177324 conn(0x7f1f8c0b2fd0 msgr2=0x7f1f8c0b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.590+0000 7f1f90e00640 1 -- 172.21.15.100:0/307177324 shutdown_connections 2024-08-17T02:46:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.590+0000 7f1f90e00640 1 -- 172.21.15.100:0/307177324 wait complete. 2024-08-17T02:46:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.591+0000 7f1f90e00640 1 Processor -- start 2024-08-17T02:46:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.592+0000 7f1f90e00640 1 -- start start 2024-08-17T02:46:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.592+0000 7f1f90e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f70005180 0x7f1f8c142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.592+0000 7f1f90e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f8c1431a0 0x7f1f8c143610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.593+0000 7f1f90e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f8c143b50 0x7f1f8c0ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.593+0000 7f1f90e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c143fb0 con 0x7f1f70005180 2024-08-17T02:46:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.593+0000 7f1f90e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0afab0 con 0x7f1f8c143b50 2024-08-17T02:46:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.593+0000 7f1f90e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c141ea0 con 0x7f1f8c1431a0 2024-08-17T02:46:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.593+0000 7f1f89e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f70005180 0x7f1f8c142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.593+0000 7f1f89e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f70005180 0x7f1f8c142c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45342/0 (socket says 172.21.15.100:45342) 2024-08-17T02:46:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.593+0000 7f1f89e00640 1 -- 172.21.15.100:0/201866694 learned_addr learned my addr 172.21.15.100:0/201866694 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.593+0000 7f1f89400640 1 --2- 172.21.15.100:0/201866694 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f8c1431a0 0x7f1f8c143610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.593+0000 7f1f8a800640 1 --2- 172.21.15.100:0/201866694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f8c143b50 0x7f1f8c0ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.593+0000 7f1f89e00640 1 -- 172.21.15.100:0/201866694 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f8c1431a0 msgr2=0x7f1f8c143610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.593+0000 7f1f89e00640 1 --2- 172.21.15.100:0/201866694 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f8c1431a0 0x7f1f8c143610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.593+0000 7f1f89e00640 1 -- 172.21.15.100:0/201866694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f8c143b50 msgr2=0x7f1f8c0ae3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.593+0000 7f1f89e00640 1 --2- 172.21.15.100:0/201866694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f8c143b50 0x7f1f8c0ae3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.593+0000 7f1f89e00640 1 -- 172.21.15.100:0/201866694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c142180 con 0x7f1f70005180 2024-08-17T02:46:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.593+0000 7f1f89e00640 1 --2- 172.21.15.100:0/201866694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f70005180 0x7f1f8c142c60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c0079f0 tx=0x7f1f7c007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.594+0000 7f1f81600640 1 -- 172.21.15.100:0/201866694 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c002e20 con 0x7f1f70005180 2024-08-17T02:46:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.594+0000 7f1f81600640 1 -- 172.21.15.100:0/201866694 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7c00f9c0 con 0x7f1f70005180 2024-08-17T02:46:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.594+0000 7f1f81600640 1 -- 172.21.15.100:0/201866694 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c00fd80 con 0x7f1f70005180 2024-08-17T02:46:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.594+0000 7f1f90e00640 1 -- 172.21.15.100:0/201866694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8c142460 con 0x7f1f70005180 2024-08-17T02:46:13.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.594+0000 7f1f90e00640 1 -- 172.21.15.100:0/201866694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8c0ae910 con 0x7f1f70005180 2024-08-17T02:46:13.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.595+0000 7f1f90e00640 1 -- 172.21.15.100:0/201866694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8c071050 con 0x7f1f70005180 2024-08-17T02:46:13.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.595+0000 7f1f81600640 1 -- 172.21.15.100:0/201866694 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1f7c013600 con 0x7f1f70005180 2024-08-17T02:46:13.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.596+0000 7f1f81600640 1 --2- 172.21.15.100:0/201866694 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1f6c065150 0x7f1f6c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.596+0000 7f1f81600640 1 -- 172.21.15.100:0/201866694 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f7c0826d0 con 0x7f1f70005180 2024-08-17T02:46:13.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.596+0000 7f1f89400640 1 --2- 172.21.15.100:0/201866694 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1f6c065150 0x7f1f6c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.597+0000 7f1f89400640 1 --2- 172.21.15.100:0/201866694 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1f6c065150 0x7f1f6c067600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1f78006e70 tx=0x7f1f780090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:13.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.600+0000 7f1f81600640 1 -- 172.21.15.100:0/201866694 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1f7c0506f0 con 0x7f1f70005180 2024-08-17T02:46:13.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.773+0000 7f1f90e00640 1 -- 172.21.15.100:0/201866694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1f8c0b2d90 con 0x7f1f70005180 2024-08-17T02:46:13.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.773+0000 7f1f81600640 1 -- 172.21.15.100:0/201866694 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1f7c053d10 con 0x7f1f70005180 2024-08-17T02:46:13.775 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-08-17T02:46:13.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.775+0000 7f1f90e00640 1 -- 172.21.15.100:0/201866694 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1f6c065150 msgr2=0x7f1f6c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.775+0000 7f1f90e00640 1 --2- 172.21.15.100:0/201866694 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1f6c065150 0x7f1f6c067600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1f78006e70 tx=0x7f1f780090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.775+0000 7f1f90e00640 1 -- 172.21.15.100:0/201866694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f70005180 msgr2=0x7f1f8c142c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.775+0000 7f1f90e00640 1 --2- 172.21.15.100:0/201866694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f70005180 0x7f1f8c142c60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c0079f0 tx=0x7f1f7c007ca0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.775+0000 7f1f90e00640 1 -- 172.21.15.100:0/201866694 shutdown_connections 2024-08-17T02:46:13.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.775+0000 7f1f90e00640 1 --2- 172.21.15.100:0/201866694 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1f6c065150 0x7f1f6c067600 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.775+0000 7f1f90e00640 1 --2- 172.21.15.100:0/201866694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f8c143b50 0x7f1f8c0ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.775+0000 7f1f90e00640 1 --2- 172.21.15.100:0/201866694 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f8c1431a0 0x7f1f8c143610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.775+0000 7f1f90e00640 1 --2- 172.21.15.100:0/201866694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f70005180 0x7f1f8c142c60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.775+0000 7f1f90e00640 1 -- 172.21.15.100:0/201866694 >> 172.21.15.100:0/201866694 conn(0x7f1f8c0b2fd0 msgr2=0x7f1f8c1580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:13.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.775+0000 7f1f90e00640 1 -- 172.21.15.100:0/201866694 shutdown_connections 2024-08-17T02:46:13.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.775+0000 7f1f90e00640 1 -- 172.21.15.100:0/201866694 wait complete. 2024-08-17T02:46:13.792 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:46:13.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.941+0000 7f0549c00640 1 Processor -- start 2024-08-17T02:46:13.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.941+0000 7f0549c00640 1 -- start start 2024-08-17T02:46:13.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.943+0000 7f0549c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0544155a20 0x7f05440adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.943+0000 7f0549c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f054406df00 0x7f05440ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.943+0000 7f0549c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0544156670 con 0x7f0544155df0 2024-08-17T02:46:13.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.943+0000 7f0549c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05440b0350 con 0x7f0544155a20 2024-08-17T02:46:13.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.943+0000 7f0549c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f054406e5e0 con 0x7f054406df00 2024-08-17T02:46:13.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.943+0000 7f0542a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0544155a20 0x7f05440adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.943+0000 7f0542a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0544155a20 0x7f05440adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45358/0 (socket says 172.21.15.100:45358) 2024-08-17T02:46:13.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.943+0000 7f0542a00640 1 -- 172.21.15.100:0/3431122942 learned_addr learned my addr 172.21.15.100:0/3431122942 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:13.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.943+0000 7f0542a00640 1 -- 172.21.15.100:0/3431122942 >> v2:172.21.15.123:3300/0 conn(0x7f054406df00 msgr2=0x7f05440ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:13.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.943+0000 7f0542a00640 1 --2- 172.21.15.100:0/3431122942 >> v2:172.21.15.123:3300/0 conn(0x7f054406df00 0x7f05440ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.943+0000 7f0542a00640 1 -- 172.21.15.100:0/3431122942 >> v1:172.21.15.123:6789/0 conn(0x7f0544155df0 legacy=0x7f054406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:13.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.943+0000 7f0542a00640 1 -- 172.21.15.100:0/3431122942 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054406e8c0 con 0x7f0544155a20 2024-08-17T02:46:13.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.944+0000 7f0542a00640 1 --2- 172.21.15.100:0/3431122942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0544155a20 0x7f05440adf10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f05441565e0 tx=0x7f05340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e6a90c5d31af03 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:13.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.945+0000 7f0542000640 1 -- 172.21.15.100:0/3431122942 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0534031510 con 0x7f0544155a20 2024-08-17T02:46:13.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.945+0000 7f0542000640 1 -- 172.21.15.100:0/3431122942 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053402f050 con 0x7f0544155a20 2024-08-17T02:46:13.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.945+0000 7f0542000640 1 -- 172.21.15.100:0/3431122942 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05340318e0 con 0x7f0544155a20 2024-08-17T02:46:13.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.945+0000 7f0549c00640 1 -- 172.21.15.100:0/3431122942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0544155a20 msgr2=0x7f05440adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.945+0000 7f0549c00640 1 --2- 172.21.15.100:0/3431122942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0544155a20 0x7f05440adf10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f05441565e0 tx=0x7f05340091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.945+0000 7f0549c00640 1 -- 172.21.15.100:0/3431122942 shutdown_connections 2024-08-17T02:46:13.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.945+0000 7f0549c00640 1 --2- 172.21.15.100:0/3431122942 >> v2:172.21.15.123:3300/0 conn(0x7f054406df00 0x7f05440ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.945+0000 7f0549c00640 1 --2- 172.21.15.100:0/3431122942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0544155a20 0x7f05440adf10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.945+0000 7f0549c00640 1 -- 172.21.15.100:0/3431122942 >> 172.21.15.100:0/3431122942 conn(0x7f05440cb9b0 msgr2=0x7f05440cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:13.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.945+0000 7f0549c00640 1 -- 172.21.15.100:0/3431122942 shutdown_connections 2024-08-17T02:46:13.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.945+0000 7f0549c00640 1 -- 172.21.15.100:0/3431122942 wait complete. 2024-08-17T02:46:13.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.947+0000 7f0549c00640 1 Processor -- start 2024-08-17T02:46:13.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.947+0000 7f0549c00640 1 -- start start 2024-08-17T02:46:13.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.948+0000 7f0549c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f054406df00 0x7f05440ad710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.948+0000 7f0549c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0544155a20 0x7f054414bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.948+0000 7f0549c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0544155df0 0x7f0544149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.948+0000 7f0549c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054414d2e0 con 0x7f054406df00 2024-08-17T02:46:13.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.948+0000 7f0549c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054414c2b0 con 0x7f0544155df0 2024-08-17T02:46:13.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.948+0000 7f0549c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054414c4e0 con 0x7f0544155a20 2024-08-17T02:46:13.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.948+0000 7f0542a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f054406df00 0x7f05440ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.948+0000 7f0542a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f054406df00 0x7f05440ad710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45368/0 (socket says 172.21.15.100:45368) 2024-08-17T02:46:13.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.948+0000 7f0542a00640 1 -- 172.21.15.100:0/4275629531 learned_addr learned my addr 172.21.15.100:0/4275629531 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:13.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.948+0000 7f053a000640 1 --2- 172.21.15.100:0/4275629531 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0544155a20 0x7f054414bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.948+0000 7f0543400640 1 --2- 172.21.15.100:0/4275629531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0544155df0 0x7f0544149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.948+0000 7f0542a00640 1 -- 172.21.15.100:0/4275629531 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0544155a20 msgr2=0x7f054414bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.948+0000 7f0542a00640 1 --2- 172.21.15.100:0/4275629531 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0544155a20 0x7f054414bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.948+0000 7f0542a00640 1 -- 172.21.15.100:0/4275629531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0544155df0 msgr2=0x7f0544149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.948+0000 7f0542a00640 1 --2- 172.21.15.100:0/4275629531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0544155df0 0x7f0544149590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.948+0000 7f0542a00640 1 -- 172.21.15.100:0/4275629531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0534009450 con 0x7f054406df00 2024-08-17T02:46:13.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.948+0000 7f0543400640 1 --2- 172.21.15.100:0/4275629531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0544155df0 0x7f0544149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:13.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.949+0000 7f0542a00640 1 --2- 172.21.15.100:0/4275629531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f054406df00 0x7f05440ad710 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0534009210 tx=0x7f0534037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:13.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.949+0000 7f053aa00640 1 -- 172.21.15.100:0/4275629531 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0534033ac0 con 0x7f054406df00 2024-08-17T02:46:13.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.949+0000 7f053aa00640 1 -- 172.21.15.100:0/4275629531 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0534033c20 con 0x7f054406df00 2024-08-17T02:46:13.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.949+0000 7f0549c00640 1 -- 172.21.15.100:0/4275629531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0544147f70 con 0x7f054406df00 2024-08-17T02:46:13.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.949+0000 7f053aa00640 1 -- 172.21.15.100:0/4275629531 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0534047460 con 0x7f054406df00 2024-08-17T02:46:13.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.949+0000 7f0549c00640 1 -- 172.21.15.100:0/4275629531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05441485b0 con 0x7f054406df00 2024-08-17T02:46:13.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.950+0000 7f0549c00640 1 -- 172.21.15.100:0/4275629531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0544148740 con 0x7f054406df00 2024-08-17T02:46:13.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.951+0000 7f053aa00640 1 -- 172.21.15.100:0/4275629531 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f05340478b0 con 0x7f054406df00 2024-08-17T02:46:13.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.951+0000 7f053aa00640 1 --2- 172.21.15.100:0/4275629531 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0520065180 0x7f0520067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.952+0000 7f053aa00640 1 -- 172.21.15.100:0/4275629531 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f05340a5cd0 con 0x7f054406df00 2024-08-17T02:46:13.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.952+0000 7f053a000640 1 --2- 172.21.15.100:0/4275629531 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0520065180 0x7f0520067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.952+0000 7f053a000640 1 --2- 172.21.15.100:0/4275629531 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0520065180 0x7f0520067630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f05440cb190 tx=0x7f052c006f50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:13.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:13.955+0000 7f053aa00640 1 -- 172.21.15.100:0/4275629531 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0534073cf0 con 0x7f054406df00 2024-08-17T02:46:14.121 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:46:14.126 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:46:14.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.195+0000 7f0549c00640 1 -- 172.21.15.100:0/4275629531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f0544064db0 con 0x7f054406df00 2024-08-17T02:46:14.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.208+0000 7f053aa00640 1 -- 172.21.15.100:0/4275629531 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v50) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0534077310 con 0x7f054406df00 2024-08-17T02:46:14.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.210+0000 7f0549c00640 1 -- 172.21.15.100:0/4275629531 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0520065180 msgr2=0x7f0520067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:14.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.210+0000 7f0549c00640 1 --2- 172.21.15.100:0/4275629531 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0520065180 0x7f0520067630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f05440cb190 tx=0x7f052c006f50 comp rx=0 tx=0).stop 2024-08-17T02:46:14.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.211+0000 7f0549c00640 1 -- 172.21.15.100:0/4275629531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f054406df00 msgr2=0x7f05440ad710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:14.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.211+0000 7f0549c00640 1 --2- 172.21.15.100:0/4275629531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f054406df00 0x7f05440ad710 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0534009210 tx=0x7f0534037000 comp rx=0 tx=0).stop 2024-08-17T02:46:14.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.211+0000 7f0549c00640 1 -- 172.21.15.100:0/4275629531 shutdown_connections 2024-08-17T02:46:14.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.211+0000 7f0549c00640 1 --2- 172.21.15.100:0/4275629531 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0520065180 0x7f0520067630 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.211+0000 7f0549c00640 1 --2- 172.21.15.100:0/4275629531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0544155df0 0x7f0544149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.211+0000 7f0549c00640 1 --2- 172.21.15.100:0/4275629531 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0544155a20 0x7f054414bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.211+0000 7f0549c00640 1 --2- 172.21.15.100:0/4275629531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f054406df00 0x7f05440ad710 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.211+0000 7f0549c00640 1 -- 172.21.15.100:0/4275629531 >> 172.21.15.100:0/4275629531 conn(0x7f05440cb9b0 msgr2=0x7f0544156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:14.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.211+0000 7f0549c00640 1 -- 172.21.15.100:0/4275629531 shutdown_connections 2024-08-17T02:46:14.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.211+0000 7f0549c00640 1 -- 172.21.15.100:0/4275629531 wait complete. 2024-08-17T02:46:14.228 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:46:14.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.421+0000 7ff9c0a00640 1 Processor -- start 2024-08-17T02:46:14.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.421+0000 7ff9c0a00640 1 -- start start 2024-08-17T02:46:14.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.422+0000 7ff9c0a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff9bc069e30 0x7ff9bc0c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:14.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.422+0000 7ff9c0a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9bc06d470 con 0x7ff9bc155550 2024-08-17T02:46:14.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.422+0000 7ff9c0a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9bc0aec60 con 0x7ff9bc069a60 2024-08-17T02:46:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.422+0000 7ff9c0a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9bc06a230 con 0x7ff9bc069e30 2024-08-17T02:46:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.423+0000 7ff9ba800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff9bc069e30 0x7ff9bc0c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.423+0000 7ff9ba800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff9bc069e30 0x7ff9bc0c7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45378/0 (socket says 172.21.15.100:45378) 2024-08-17T02:46:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.423+0000 7ff9b9400640 1 --1- 172.21.15.100:0/1897270453 >> v1:172.21.15.100:6789/0 conn(0x7ff9bc155550 0x7ff9bc06d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45602/0 (socket says 172.21.15.100:45602) 2024-08-17T02:46:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.423+0000 7ff9ba800640 1 -- 172.21.15.100:0/1897270453 learned_addr learned my addr 172.21.15.100:0/1897270453 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.423+0000 7ff9ba800640 1 -- 172.21.15.100:0/1897270453 >> v1:172.21.15.123:6789/0 conn(0x7ff9bc069a60 legacy=0x7ff9bc154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:14.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.423+0000 7ff9ba800640 1 -- 172.21.15.100:0/1897270453 >> v1:172.21.15.100:6789/0 conn(0x7ff9bc155550 legacy=0x7ff9bc06d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:14.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.423+0000 7ff9b8a00640 1 -- 172.21.15.100:0/1897270453 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 558139278 0 0) 0x7ff9bc06d470 con 0x7ff9bc155550 2024-08-17T02:46:14.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.423+0000 7ff9ba800640 1 -- 172.21.15.100:0/1897270453 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc06c860 con 0x7ff9bc069e30 2024-08-17T02:46:14.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.425+0000 7ff9ba800640 1 --2- 172.21.15.100:0/1897270453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9bc069e30 0x7ff9bc0c7e50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400d1a0 tx=0x7ff9b400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91bbe6a547593a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:14.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.425+0000 7ff9b8a00640 1 -- 172.21.15.100:0/1897270453 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b400b2e0 con 0x7ff9bc069e30 2024-08-17T02:46:14.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.425+0000 7ff9b8a00640 1 -- 172.21.15.100:0/1897270453 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b400b440 con 0x7ff9bc069e30 2024-08-17T02:46:14.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.425+0000 7ff9b8a00640 1 -- 172.21.15.100:0/1897270453 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4009840 con 0x7ff9bc069e30 2024-08-17T02:46:14.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.426+0000 7ff9c0a00640 1 -- 172.21.15.100:0/1897270453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9bc069e30 msgr2=0x7ff9bc0c7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:14.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.426+0000 7ff9c0a00640 1 --2- 172.21.15.100:0/1897270453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9bc069e30 0x7ff9bc0c7e50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400d1a0 tx=0x7ff9b400ba50 comp rx=0 tx=0).stop 2024-08-17T02:46:14.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.426+0000 7ff9c0a00640 1 -- 172.21.15.100:0/1897270453 shutdown_connections 2024-08-17T02:46:14.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.426+0000 7ff9c0a00640 1 --2- 172.21.15.100:0/1897270453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9bc069e30 0x7ff9bc0c7e50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.426+0000 7ff9c0a00640 1 -- 172.21.15.100:0/1897270453 >> 172.21.15.100:0/1897270453 conn(0x7ff9bc067750 msgr2=0x7ff9bc0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:14.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.426+0000 7ff9c0a00640 1 -- 172.21.15.100:0/1897270453 shutdown_connections 2024-08-17T02:46:14.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.426+0000 7ff9c0a00640 1 -- 172.21.15.100:0/1897270453 wait complete. 2024-08-17T02:46:14.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.427+0000 7ff9c0a00640 1 Processor -- start 2024-08-17T02:46:14.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.427+0000 7ff9c0a00640 1 -- start start 2024-08-17T02:46:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.428+0000 7ff9c0a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff9bc069a60 0x7ff9bc145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.428+0000 7ff9c0a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9bc069e30 0x7ff9bc0aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.428+0000 7ff9c0a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9bc155550 0x7ff9bc0aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.428+0000 7ff9c0a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc14ff00 con 0x7ff9bc155550 2024-08-17T02:46:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.428+0000 7ff9c0a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0aae60 con 0x7ff9bc069e30 2024-08-17T02:46:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.428+0000 7ff9c0a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0ab140 con 0x7ff9bc069a60 2024-08-17T02:46:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.429+0000 7ff9ba800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9bc155550 0x7ff9bc0aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.429+0000 7ff9ba800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9bc155550 0x7ff9bc0aa7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45382/0 (socket says 172.21.15.100:45382) 2024-08-17T02:46:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.429+0000 7ff9ba800640 1 -- 172.21.15.100:0/2902768982 learned_addr learned my addr 172.21.15.100:0/2902768982 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.429+0000 7ff9b9e00640 1 --2- 172.21.15.100:0/2902768982 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff9bc069a60 0x7ff9bc145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.429+0000 7ff9b9400640 1 --2- 172.21.15.100:0/2902768982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9bc069e30 0x7ff9bc0aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.429+0000 7ff9ba800640 1 -- 172.21.15.100:0/2902768982 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff9bc069a60 msgr2=0x7ff9bc145ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:14.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.429+0000 7ff9ba800640 1 --2- 172.21.15.100:0/2902768982 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff9bc069a60 0x7ff9bc145ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.429+0000 7ff9ba800640 1 -- 172.21.15.100:0/2902768982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9bc069e30 msgr2=0x7ff9bc0aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:14.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.429+0000 7ff9ba800640 1 --2- 172.21.15.100:0/2902768982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9bc069e30 0x7ff9bc0aa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.429+0000 7ff9ba800640 1 -- 172.21.15.100:0/2902768982 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b400bcf0 con 0x7ff9bc155550 2024-08-17T02:46:14.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.429+0000 7ff9ba800640 1 --2- 172.21.15.100:0/2902768982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9bc155550 0x7ff9bc0aa7e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400bcc0 tx=0x7ff9b4039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:14.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.430+0000 7ff9b1600640 1 -- 172.21.15.100:0/2902768982 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b403ab20 con 0x7ff9bc155550 2024-08-17T02:46:14.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.430+0000 7ff9b1600640 1 -- 172.21.15.100:0/2902768982 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b403aca0 con 0x7ff9bc155550 2024-08-17T02:46:14.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.430+0000 7ff9c0a00640 1 -- 172.21.15.100:0/2902768982 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9bc14cfd0 con 0x7ff9bc155550 2024-08-17T02:46:14.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.430+0000 7ff9b1600640 1 -- 172.21.15.100:0/2902768982 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4030680 con 0x7ff9bc155550 2024-08-17T02:46:14.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.430+0000 7ff9c0a00640 1 -- 172.21.15.100:0/2902768982 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9bc14d590 con 0x7ff9bc155550 2024-08-17T02:46:14.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.431+0000 7ff9c0a00640 1 -- 172.21.15.100:0/2902768982 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9bc0ab300 con 0x7ff9bc155550 2024-08-17T02:46:14.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.433+0000 7ff9b1600640 1 -- 172.21.15.100:0/2902768982 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff9b4003020 con 0x7ff9bc155550 2024-08-17T02:46:14.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.434+0000 7ff9b1600640 1 --2- 172.21.15.100:0/2902768982 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff99c065150 0x7ff99c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:14.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.434+0000 7ff9b1600640 1 -- 172.21.15.100:0/2902768982 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9b40a3e00 con 0x7ff9bc155550 2024-08-17T02:46:14.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.435+0000 7ff9b9e00640 1 --2- 172.21.15.100:0/2902768982 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff99c065150 0x7ff99c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:14.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.435+0000 7ff9b9e00640 1 --2- 172.21.15.100:0/2902768982 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff99c065150 0x7ff99c067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc06d820 tx=0x7ff9ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:14.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.438+0000 7ff9b1600640 1 -- 172.21.15.100:0/2902768982 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff9b4071f70 con 0x7ff9bc155550 2024-08-17T02:46:14.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.618+0000 7ff9c0a00640 1 -- 172.21.15.100:0/2902768982 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff9bc071050 con 0x7ff9bc155550 2024-08-17T02:46:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.623+0000 7ff9b1600640 1 -- 172.21.15.100:0/2902768982 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff9b4075590 con 0x7ff9bc155550 2024-08-17T02:46:14.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.626+0000 7ff9c0a00640 1 -- 172.21.15.100:0/2902768982 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff99c065150 msgr2=0x7ff99c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:14.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.626+0000 7ff9c0a00640 1 --2- 172.21.15.100:0/2902768982 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff99c065150 0x7ff99c067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc06d820 tx=0x7ff9ac009040 comp rx=0 tx=0).stop 2024-08-17T02:46:14.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.626+0000 7ff9c0a00640 1 -- 172.21.15.100:0/2902768982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9bc155550 msgr2=0x7ff9bc0aa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:14.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.626+0000 7ff9c0a00640 1 --2- 172.21.15.100:0/2902768982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9bc155550 0x7ff9bc0aa7e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400bcc0 tx=0x7ff9b4039000 comp rx=0 tx=0).stop 2024-08-17T02:46:14.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.626+0000 7ff9c0a00640 1 -- 172.21.15.100:0/2902768982 shutdown_connections 2024-08-17T02:46:14.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.626+0000 7ff9c0a00640 1 --2- 172.21.15.100:0/2902768982 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff99c065150 0x7ff99c067600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.626+0000 7ff9c0a00640 1 --2- 172.21.15.100:0/2902768982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9bc155550 0x7ff9bc0aa7e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.626+0000 7ff9c0a00640 1 --2- 172.21.15.100:0/2902768982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9bc069e30 0x7ff9bc0aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.626+0000 7ff9c0a00640 1 --2- 172.21.15.100:0/2902768982 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff9bc069a60 0x7ff9bc145ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.626+0000 7ff9c0a00640 1 -- 172.21.15.100:0/2902768982 >> 172.21.15.100:0/2902768982 conn(0x7ff9bc067750 msgr2=0x7ff9bc0c8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:14.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.626+0000 7ff9c0a00640 1 -- 172.21.15.100:0/2902768982 shutdown_connections 2024-08-17T02:46:14.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:14.626+0000 7ff9c0a00640 1 -- 172.21.15.100:0/2902768982 wait complete. 2024-08-17T02:46:14.643 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:46:14.643 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:46:14.741 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:46:14.831 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:46:14.832 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:46:14.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:46:14.832 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-17T02:46:14.896 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-08-17T02:46:14.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:14.896 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:46:14.944 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:46:14.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:46:14.945 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-08-17T02:46:15.011 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-08-17T02:46:15.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:15.011 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:46:15.060 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-08-17T02:46:15.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:46:15.060 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-08-17T02:46:15.121 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-08-17T02:46:15.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:15.121 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:46:15.157 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-08-17T02:46:15.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:46:15.158 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-08-17T02:46:15.217 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-08-17T02:46:15.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:15.217 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:46:15.254 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-17T02:46:15.255 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:46:15.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.403+0000 7f5ee6000640 1 Processor -- start 2024-08-17T02:46:15.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.404+0000 7f5ee6000640 1 -- start start 2024-08-17T02:46:15.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.405+0000 7f5ee6000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ee0158d60 0x7f5ee00b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:15.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.405+0000 7f5ee6000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ee00c7420 0x7f5ee00b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:15.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.405+0000 7f5ee6000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee00b18d0 con 0x7f5ee015cb30 2024-08-17T02:46:15.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.405+0000 7f5ee6000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee00b0d00 con 0x7f5ee00c7420 2024-08-17T02:46:15.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.405+0000 7f5ee6000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee00b0fa0 con 0x7f5ee0158d60 2024-08-17T02:46:15.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.405+0000 7f5edfe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ee00c7420 0x7f5ee00b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:15.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.405+0000 7f5edfe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ee00c7420 0x7f5ee00b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45386/0 (socket says 172.21.15.100:45386) 2024-08-17T02:46:15.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.405+0000 7f5edfe00640 1 -- 172.21.15.100:0/2980420678 learned_addr learned my addr 172.21.15.100:0/2980420678 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:15.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.405+0000 7f5edf400640 1 --2- 172.21.15.100:0/2980420678 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ee0158d60 0x7f5ee00b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:15.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.406+0000 7f5edfe00640 1 -- 172.21.15.100:0/2980420678 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ee0158d60 msgr2=0x7f5ee00b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:15.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.406+0000 7f5edfe00640 1 --2- 172.21.15.100:0/2980420678 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ee0158d60 0x7f5ee00b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.406+0000 7f5edfe00640 1 -- 172.21.15.100:0/2980420678 >> v1:172.21.15.123:6789/0 conn(0x7f5ee015cb30 legacy=0x7f5ee00c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:15.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.406+0000 7f5edfe00640 1 -- 172.21.15.100:0/2980420678 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee00b1280 con 0x7f5ee00c7420 2024-08-17T02:46:15.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.407+0000 7f5edfe00640 1 --2- 172.21.15.100:0/2980420678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ee00c7420 0x7f5ee00b22a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009f20 tx=0x7f5ed8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd56e620b30cfe1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:15.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.407+0000 7f5ede000640 1 -- 172.21.15.100:0/2980420678 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8031400 con 0x7f5ee00c7420 2024-08-17T02:46:15.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.407+0000 7f5ede000640 1 -- 172.21.15.100:0/2980420678 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed802d050 con 0x7f5ee00c7420 2024-08-17T02:46:15.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.407+0000 7f5ede000640 1 -- 172.21.15.100:0/2980420678 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed80317d0 con 0x7f5ee00c7420 2024-08-17T02:46:15.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.407+0000 7f5ee6000640 1 -- 172.21.15.100:0/2980420678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ee00c7420 msgr2=0x7f5ee00b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:15.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.407+0000 7f5ee6000640 1 --2- 172.21.15.100:0/2980420678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ee00c7420 0x7f5ee00b22a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009f20 tx=0x7f5ed8009840 comp rx=0 tx=0).stop 2024-08-17T02:46:15.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.407+0000 7f5ee6000640 1 -- 172.21.15.100:0/2980420678 shutdown_connections 2024-08-17T02:46:15.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.407+0000 7f5ee6000640 1 --2- 172.21.15.100:0/2980420678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ee00c7420 0x7f5ee00b22a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.408+0000 7f5ee6000640 1 --2- 172.21.15.100:0/2980420678 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ee0158d60 0x7f5ee00b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.408+0000 7f5ee6000640 1 -- 172.21.15.100:0/2980420678 >> 172.21.15.100:0/2980420678 conn(0x7f5ee00b3040 msgr2=0x7f5ee00b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:15.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.408+0000 7f5ee6000640 1 -- 172.21.15.100:0/2980420678 shutdown_connections 2024-08-17T02:46:15.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.408+0000 7f5ee6000640 1 -- 172.21.15.100:0/2980420678 wait complete. 2024-08-17T02:46:15.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.409+0000 7f5ee6000640 1 Processor -- start 2024-08-17T02:46:15.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.409+0000 7f5ee6000640 1 -- start start 2024-08-17T02:46:15.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.410+0000 7f5ee6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ee00c7420 0x7f5ee0143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:15.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.410+0000 7f5ee6000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ee0158d60 0x7f5ee00cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:15.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.410+0000 7f5ee6000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ee015cb30 0x7f5ee00cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:15.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.410+0000 7f5ee6000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee016a0f0 con 0x7f5ee00c7420 2024-08-17T02:46:15.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.410+0000 7f5ee6000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee00ccfd0 con 0x7f5ee0158d60 2024-08-17T02:46:15.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.410+0000 7f5ee6000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee0143690 con 0x7f5ee015cb30 2024-08-17T02:46:15.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.410+0000 7f5edf400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ee00c7420 0x7f5ee0143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:15.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.410+0000 7f5edf400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ee00c7420 0x7f5ee0143150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45402/0 (socket says 172.21.15.100:45402) 2024-08-17T02:46:15.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.410+0000 7f5edf400640 1 -- 172.21.15.100:0/3471390103 learned_addr learned my addr 172.21.15.100:0/3471390103 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:15.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.410+0000 7f5edfe00640 1 --2- 172.21.15.100:0/3471390103 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ee015cb30 0x7f5ee00cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:15.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.410+0000 7f5edea00640 1 --2- 172.21.15.100:0/3471390103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ee0158d60 0x7f5ee00cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:15.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.411+0000 7f5edf400640 1 -- 172.21.15.100:0/3471390103 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ee015cb30 msgr2=0x7f5ee00cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:15.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.411+0000 7f5edf400640 1 --2- 172.21.15.100:0/3471390103 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ee015cb30 0x7f5ee00cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.411+0000 7f5edf400640 1 -- 172.21.15.100:0/3471390103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ee0158d60 msgr2=0x7f5ee00cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:15.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.411+0000 7f5edf400640 1 --2- 172.21.15.100:0/3471390103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ee0158d60 0x7f5ee00cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.411+0000 7f5edf400640 1 -- 172.21.15.100:0/3471390103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed8009ae0 con 0x7f5ee00c7420 2024-08-17T02:46:15.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.411+0000 7f5edf400640 1 --2- 172.21.15.100:0/3471390103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ee00c7420 0x7f5ee0143150 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000ea20 tx=0x7f5ed00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:15.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.411+0000 7f5ed6a00640 1 -- 172.21.15.100:0/3471390103 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed000ca10 con 0x7f5ee00c7420 2024-08-17T02:46:15.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.411+0000 7f5ed6a00640 1 -- 172.21.15.100:0/3471390103 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed000cb70 con 0x7f5ee00c7420 2024-08-17T02:46:15.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.411+0000 7f5ed6a00640 1 -- 172.21.15.100:0/3471390103 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0013470 con 0x7f5ee00c7420 2024-08-17T02:46:15.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.411+0000 7f5ee6000640 1 -- 172.21.15.100:0/3471390103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee0156810 con 0x7f5ee00c7420 2024-08-17T02:46:15.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.411+0000 7f5ee6000640 1 -- 172.21.15.100:0/3471390103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee0156dd0 con 0x7f5ee00c7420 2024-08-17T02:46:15.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.412+0000 7f5ee6000640 1 -- 172.21.15.100:0/3471390103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee0064db0 con 0x7f5ee00c7420 2024-08-17T02:46:15.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.413+0000 7f5ed6a00640 1 -- 172.21.15.100:0/3471390103 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5ed0013860 con 0x7f5ee00c7420 2024-08-17T02:46:15.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.414+0000 7f5ed6a00640 1 --2- 172.21.15.100:0/3471390103 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ec0065150 0x7f5ec0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:15.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.414+0000 7f5ed6a00640 1 -- 172.21.15.100:0/3471390103 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ed0082690 con 0x7f5ee00c7420 2024-08-17T02:46:15.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.414+0000 7f5edea00640 1 --2- 172.21.15.100:0/3471390103 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ec0065150 0x7f5ec0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:15.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.415+0000 7f5edea00640 1 --2- 172.21.15.100:0/3471390103 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ec0065150 0x7f5ec0067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5ee00cdd00 tx=0x7f5ecc007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:15.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.418+0000 7f5ed6a00640 1 -- 172.21.15.100:0/3471390103 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5ed0050800 con 0x7f5ee00c7420 2024-08-17T02:46:15.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.638+0000 7f5ee6000640 1 -- 172.21.15.100:0/3471390103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ee0069af0 con 0x7f5ee00c7420 2024-08-17T02:46:15.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.639+0000 7f5ed6a00640 1 -- 172.21.15.100:0/3471390103 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f5ed0053e20 con 0x7f5ee00c7420 2024-08-17T02:46:15.641 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:15.641 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3043714204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3043714204},{"type":"v1","addr":"172.21.15.100:6835","nonce":3043714204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/543049926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":543049926},{"type":"v1","addr":"172.21.15.100:6837","nonce":543049926}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2733092927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2733092927},{"type":"v1","addr":"172.21.15.123:6834","nonce":2733092927}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:45:41.237121+0000","modified":"2024-08-17T02:45:44.862501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/2872394530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2872394530},{"type":"v1","addr":"172.21.15.123:6835","nonce":2872394530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:46:15.641 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-08-17T02:46:15.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.641+0000 7f5ee6000640 1 -- 172.21.15.100:0/3471390103 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ec0065150 msgr2=0x7f5ec0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:15.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.641+0000 7f5ee6000640 1 --2- 172.21.15.100:0/3471390103 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ec0065150 0x7f5ec0067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5ee00cdd00 tx=0x7f5ecc007e30 comp rx=0 tx=0).stop 2024-08-17T02:46:15.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.641+0000 7f5ee6000640 1 -- 172.21.15.100:0/3471390103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ee00c7420 msgr2=0x7f5ee0143150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:15.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.641+0000 7f5ee6000640 1 --2- 172.21.15.100:0/3471390103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ee00c7420 0x7f5ee0143150 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000ea20 tx=0x7f5ed00090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.641+0000 7f5ee6000640 1 -- 172.21.15.100:0/3471390103 shutdown_connections 2024-08-17T02:46:15.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.641+0000 7f5ee6000640 1 --2- 172.21.15.100:0/3471390103 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ec0065150 0x7f5ec0067600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.641+0000 7f5ee6000640 1 --2- 172.21.15.100:0/3471390103 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ee015cb30 0x7f5ee00cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.641+0000 7f5ee6000640 1 --2- 172.21.15.100:0/3471390103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ee0158d60 0x7f5ee00cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.641+0000 7f5ee6000640 1 --2- 172.21.15.100:0/3471390103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ee00c7420 0x7f5ee0143150 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.641+0000 7f5ee6000640 1 -- 172.21.15.100:0/3471390103 >> 172.21.15.100:0/3471390103 conn(0x7f5ee00b3040 msgr2=0x7f5ee00b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:15.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.642+0000 7f5ee6000640 1 -- 172.21.15.100:0/3471390103 shutdown_connections 2024-08-17T02:46:15.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.642+0000 7f5ee6000640 1 -- 172.21.15.100:0/3471390103 wait complete. 2024-08-17T02:46:15.658 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:15.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.804+0000 7fb3dfa00640 1 Processor -- start 2024-08-17T02:46:15.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.804+0000 7fb3dfa00640 1 -- start start 2024-08-17T02:46:15.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.805+0000 7fb3dfa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb3d81401b0 0x7fb3d80caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:15.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.805+0000 7fb3dfa00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb3d8140580 0x7fb3d80b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:15.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.805+0000 7fb3dfa00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d80b16d0 con 0x7fb3d80b1270 2024-08-17T02:46:15.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.805+0000 7fb3dfa00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d80cb450 con 0x7fb3d81401b0 2024-08-17T02:46:15.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.805+0000 7fb3dfa00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d80caa80 con 0x7fb3d8140580 2024-08-17T02:46:15.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.806+0000 7fb3dd000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb3d81401b0 0x7fb3d80caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:15.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.806+0000 7fb3dd000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb3d81401b0 0x7fb3d80caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45418/0 (socket says 172.21.15.100:45418) 2024-08-17T02:46:15.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.806+0000 7fb3dd000640 1 -- 172.21.15.100:0/4144160000 learned_addr learned my addr 172.21.15.100:0/4144160000 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:15.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.806+0000 7fb3d7e00640 1 --2- 172.21.15.100:0/4144160000 >> v2:172.21.15.123:3300/0 conn(0x7fb3d8140580 0x7fb3d80b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:15.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.806+0000 7fb3dd000640 1 -- 172.21.15.100:0/4144160000 >> v2:172.21.15.123:3300/0 conn(0x7fb3d8140580 msgr2=0x7fb3d80b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:15.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.806+0000 7fb3dd000640 1 --2- 172.21.15.100:0/4144160000 >> v2:172.21.15.123:3300/0 conn(0x7fb3d8140580 0x7fb3d80b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.806+0000 7fb3dd000640 1 -- 172.21.15.100:0/4144160000 >> v1:172.21.15.123:6789/0 conn(0x7fb3d80b1270 legacy=0x7fb3d80c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:15.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.806+0000 7fb3dd000640 1 -- 172.21.15.100:0/4144160000 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d80c9e70 con 0x7fb3d81401b0 2024-08-17T02:46:15.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.807+0000 7fb3dd000640 1 --2- 172.21.15.100:0/4144160000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3d81401b0 0x7fb3d80caf10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb3d806aa80 tx=0x7fb3cc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a0dd361db4420c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:15.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.807+0000 7fb3d7400640 1 -- 172.21.15.100:0/4144160000 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc02adf0 con 0x7fb3d81401b0 2024-08-17T02:46:15.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.807+0000 7fb3d7400640 1 -- 172.21.15.100:0/4144160000 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc032440 con 0x7fb3d81401b0 2024-08-17T02:46:15.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.807+0000 7fb3d7400640 1 -- 172.21.15.100:0/4144160000 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc032820 con 0x7fb3d81401b0 2024-08-17T02:46:15.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.808+0000 7fb3dfa00640 1 -- 172.21.15.100:0/4144160000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3d81401b0 msgr2=0x7fb3d80caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:15.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.808+0000 7fb3dfa00640 1 --2- 172.21.15.100:0/4144160000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3d81401b0 0x7fb3d80caf10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb3d806aa80 tx=0x7fb3cc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.808+0000 7fb3dfa00640 1 -- 172.21.15.100:0/4144160000 shutdown_connections 2024-08-17T02:46:15.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.808+0000 7fb3dfa00640 1 --2- 172.21.15.100:0/4144160000 >> v2:172.21.15.123:3300/0 conn(0x7fb3d8140580 0x7fb3d80b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.808+0000 7fb3dfa00640 1 --2- 172.21.15.100:0/4144160000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3d81401b0 0x7fb3d80caf10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.808+0000 7fb3dfa00640 1 -- 172.21.15.100:0/4144160000 >> 172.21.15.100:0/4144160000 conn(0x7fb3d80cb9b0 msgr2=0x7fb3d80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:15.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.808+0000 7fb3dfa00640 1 -- 172.21.15.100:0/4144160000 shutdown_connections 2024-08-17T02:46:15.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.808+0000 7fb3dfa00640 1 -- 172.21.15.100:0/4144160000 wait complete. 2024-08-17T02:46:15.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.809+0000 7fb3dfa00640 1 Processor -- start 2024-08-17T02:46:15.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.810+0000 7fb3dfa00640 1 -- start start 2024-08-17T02:46:15.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.810+0000 7fb3dfa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3d80b1270 0x7fb3d8169010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:15.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.810+0000 7fb3dfa00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3d81401b0 0x7fb3d806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:15.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.810+0000 7fb3dfa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3d8140580 0x7fb3d816b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:15.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.810+0000 7fb3dfa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d815d660 con 0x7fb3d8140580 2024-08-17T02:46:15.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.810+0000 7fb3dfa00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d8169550 con 0x7fb3d80b1270 2024-08-17T02:46:15.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.810+0000 7fb3dfa00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d815ca50 con 0x7fb3d81401b0 2024-08-17T02:46:15.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.811+0000 7fb3dd000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3d80b1270 0x7fb3d8169010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:15.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.811+0000 7fb3dda00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3d8140580 0x7fb3d816b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:15.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.811+0000 7fb3dd000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3d80b1270 0x7fb3d8169010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:55652/0 (socket says 172.21.15.100:55652) 2024-08-17T02:46:15.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.811+0000 7fb3dd000640 1 -- 172.21.15.100:0/2860184727 learned_addr learned my addr 172.21.15.100:0/2860184727 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:15.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.811+0000 7fb3d7e00640 1 --2- 172.21.15.100:0/2860184727 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3d81401b0 0x7fb3d806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:15.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.811+0000 7fb3dd000640 1 -- 172.21.15.100:0/2860184727 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3d81401b0 msgr2=0x7fb3d806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:15.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.811+0000 7fb3dd000640 1 --2- 172.21.15.100:0/2860184727 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3d81401b0 0x7fb3d806d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.811+0000 7fb3dd000640 1 -- 172.21.15.100:0/2860184727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3d8140580 msgr2=0x7fb3d816b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:15.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.811+0000 7fb3dd000640 1 --2- 172.21.15.100:0/2860184727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3d8140580 0x7fb3d816b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.811+0000 7fb3dd000640 1 -- 172.21.15.100:0/2860184727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc009450 con 0x7fb3d80b1270 2024-08-17T02:46:15.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.811+0000 7fb3dd000640 1 --2- 172.21.15.100:0/2860184727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3d80b1270 0x7fb3d8169010 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009210 tx=0x7fb3cc032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:15.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.812+0000 7fb3cbe00640 1 -- 172.21.15.100:0/2860184727 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc000c90 con 0x7fb3d80b1270 2024-08-17T02:46:15.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.812+0000 7fb3cbe00640 1 -- 172.21.15.100:0/2860184727 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc031a60 con 0x7fb3d80b1270 2024-08-17T02:46:15.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.812+0000 7fb3dfa00640 1 -- 172.21.15.100:0/2860184727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d815cd30 con 0x7fb3d80b1270 2024-08-17T02:46:15.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.812+0000 7fb3cbe00640 1 -- 172.21.15.100:0/2860184727 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc031e60 con 0x7fb3d80b1270 2024-08-17T02:46:15.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.812+0000 7fb3dfa00640 1 -- 172.21.15.100:0/2860184727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d815d2f0 con 0x7fb3d80b1270 2024-08-17T02:46:15.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.813+0000 7fb3dfa00640 1 -- 172.21.15.100:0/2860184727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d8064db0 con 0x7fb3d80b1270 2024-08-17T02:46:15.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.814+0000 7fb3cbe00640 1 -- 172.21.15.100:0/2860184727 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb3cc039040 con 0x7fb3d80b1270 2024-08-17T02:46:15.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.814+0000 7fb3cbe00640 1 --2- 172.21.15.100:0/2860184727 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb3b8065180 0x7fb3b8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:15.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.814+0000 7fb3cbe00640 1 -- 172.21.15.100:0/2860184727 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb3cc0a20c0 con 0x7fb3d80b1270 2024-08-17T02:46:15.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.815+0000 7fb3d7e00640 1 --2- 172.21.15.100:0/2860184727 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb3b8065180 0x7fb3b8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:15.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.815+0000 7fb3d7e00640 1 --2- 172.21.15.100:0/2860184727 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb3b8065180 0x7fb3b8067630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80c8410 tx=0x7fb3c40090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:15.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.819+0000 7fb3cbe00640 1 -- 172.21.15.100:0/2860184727 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb3cc070190 con 0x7fb3d80b1270 2024-08-17T02:46:15.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.992+0000 7fb3dfa00640 1 -- 172.21.15.100:0/2860184727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3d815f760 con 0x7fb3d80b1270 2024-08-17T02:46:15.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.994+0000 7fb3cbe00640 1 -- 172.21.15.100:0/2860184727 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fb3cc0737b0 con 0x7fb3d80b1270 2024-08-17T02:46:15.996 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:15.996 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:42.845503+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:45:39.036964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:45:40.232954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.996+0000 7fb3dfa00640 1 -- 172.21.15.100:0/2860184727 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb3b8065180 msgr2=0x7fb3b8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.996+0000 7fb3dfa00640 1 --2- 172.21.15.100:0/2860184727 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb3b8065180 0x7fb3b8067630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80c8410 tx=0x7fb3c40090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.996+0000 7fb3dfa00640 1 -- 172.21.15.100:0/2860184727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3d80b1270 msgr2=0x7fb3d8169010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.996+0000 7fb3dfa00640 1 --2- 172.21.15.100:0/2860184727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3d80b1270 0x7fb3d8169010 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009210 tx=0x7fb3cc032000 comp rx=0 tx=0).stop 2024-08-17T02:46:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.996+0000 7fb3dfa00640 1 -- 172.21.15.100:0/2860184727 shutdown_connections 2024-08-17T02:46:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.996+0000 7fb3dfa00640 1 --2- 172.21.15.100:0/2860184727 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb3b8065180 0x7fb3b8067630 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.996+0000 7fb3dfa00640 1 --2- 172.21.15.100:0/2860184727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3d8140580 0x7fb3d816b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.996+0000 7fb3dfa00640 1 --2- 172.21.15.100:0/2860184727 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3d81401b0 0x7fb3d806d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.996+0000 7fb3dfa00640 1 --2- 172.21.15.100:0/2860184727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3d80b1270 0x7fb3d8169010 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.996+0000 7fb3dfa00640 1 -- 172.21.15.100:0/2860184727 >> 172.21.15.100:0/2860184727 conn(0x7fb3d80cb9b0 msgr2=0x7fb3d80ab8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.996+0000 7fb3dfa00640 1 -- 172.21.15.100:0/2860184727 shutdown_connections 2024-08-17T02:46:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:15.996+0000 7fb3dfa00640 1 -- 172.21.15.100:0/2860184727 wait complete. 2024-08-17T02:46:16.012 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:45:35.140990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:45:39.036964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:45:40.232954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:46:16.012 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:16.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.162+0000 7f33fe400640 1 Processor -- start 2024-08-17T02:46:16.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.162+0000 7f33fe400640 1 -- start start 2024-08-17T02:46:16.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.163+0000 7f33fe400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f33f80ac290 0x7f33f80ac660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.163+0000 7f33fe400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f8068d40 0x7f33f8069170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.163+0000 7f33fe400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f80aed20 con 0x7f33f80aa730 2024-08-17T02:46:16.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.163+0000 7f33fe400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f80ae460 con 0x7f33f80ac290 2024-08-17T02:46:16.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.163+0000 7f33fe400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f80acba0 con 0x7f33f8068d40 2024-08-17T02:46:16.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.163+0000 7f33fd000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f33f80ac290 0x7f33f80ac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.163+0000 7f33fd000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f33f80ac290 0x7f33f80ac660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45428/0 (socket says 172.21.15.100:45428) 2024-08-17T02:46:16.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.163+0000 7f33fd000640 1 -- 172.21.15.100:0/2411990299 learned_addr learned my addr 172.21.15.100:0/2411990299 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:16.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.163+0000 7f33fda00640 1 --1- 172.21.15.100:0/2411990299 >> v1:172.21.15.100:6789/0 conn(0x7f33f80aa730 0x7f33f80aabb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45610/0 (socket says 172.21.15.100:45610) 2024-08-17T02:46:16.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.164+0000 7f33f7e00640 1 --2- 172.21.15.100:0/2411990299 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f8068d40 0x7f33f8069170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.164+0000 7f33fd000640 1 -- 172.21.15.100:0/2411990299 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f8068d40 msgr2=0x7f33f8069170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:16.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.164+0000 7f33fd000640 1 --2- 172.21.15.100:0/2411990299 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f8068d40 0x7f33f8069170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.164+0000 7f33fd000640 1 -- 172.21.15.100:0/2411990299 >> v1:172.21.15.100:6789/0 conn(0x7f33f80aa730 legacy=0x7f33f80aabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.164+0000 7f33fd000640 1 -- 172.21.15.100:0/2411990299 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f8069aa0 con 0x7f33f80ac290 2024-08-17T02:46:16.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.164+0000 7f33f7e00640 1 --2- 172.21.15.100:0/2411990299 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f8068d40 0x7f33f8069170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:16.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.164+0000 7f33f7400640 1 -- 172.21.15.100:0/2411990299 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213391932 0 0) 0x7f33f80aed20 con 0x7f33f80aa730 2024-08-17T02:46:16.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.165+0000 7f33fd000640 1 --2- 172.21.15.100:0/2411990299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33f80ac290 0x7f33f80ac660 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009910 tx=0x7f33ec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979ba2417706d27d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:16.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.165+0000 7f33f7400640 1 -- 172.21.15.100:0/2411990299 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec02ae40 con 0x7f33f80ac290 2024-08-17T02:46:16.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.165+0000 7f33f7400640 1 -- 172.21.15.100:0/2411990299 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ec032440 con 0x7f33f80ac290 2024-08-17T02:46:16.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.165+0000 7f33f7400640 1 -- 172.21.15.100:0/2411990299 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec0327e0 con 0x7f33f80ac290 2024-08-17T02:46:16.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.165+0000 7f33fe400640 1 -- 172.21.15.100:0/2411990299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33f80ac290 msgr2=0x7f33f80ac660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.166+0000 7f33fe400640 1 --2- 172.21.15.100:0/2411990299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33f80ac290 0x7f33f80ac660 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009910 tx=0x7f33ec0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.166+0000 7f33fe400640 1 -- 172.21.15.100:0/2411990299 shutdown_connections 2024-08-17T02:46:16.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.166+0000 7f33fe400640 1 --2- 172.21.15.100:0/2411990299 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f8068d40 0x7f33f8069170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.166+0000 7f33fe400640 1 --2- 172.21.15.100:0/2411990299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33f80ac290 0x7f33f80ac660 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.166+0000 7f33fe400640 1 -- 172.21.15.100:0/2411990299 >> 172.21.15.100:0/2411990299 conn(0x7f33f8096a70 msgr2=0x7f33f8096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.166+0000 7f33fe400640 1 -- 172.21.15.100:0/2411990299 shutdown_connections 2024-08-17T02:46:16.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.166+0000 7f33fe400640 1 -- 172.21.15.100:0/2411990299 wait complete. 2024-08-17T02:46:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.167+0000 7f33fe400640 1 Processor -- start 2024-08-17T02:46:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.167+0000 7f33fe400640 1 -- start start 2024-08-17T02:46:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.168+0000 7f33fe400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33f8068d40 0x7f33f815bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.168+0000 7f33fe400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f80aa730 0x7f33f8156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.168+0000 7f33fe400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33f80ac290 0x7f33f8154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.168+0000 7f33fe400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f81689b0 con 0x7f33f80ac290 2024-08-17T02:46:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.168+0000 7f33fe400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f8168c80 con 0x7f33f8068d40 2024-08-17T02:46:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.168+0000 7f33fe400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f815c600 con 0x7f33f80aa730 2024-08-17T02:46:16.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.168+0000 7f33fda00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33f80ac290 0x7f33f8154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.168+0000 7f33fda00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33f80ac290 0x7f33f8154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45432/0 (socket says 172.21.15.100:45432) 2024-08-17T02:46:16.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.168+0000 7f33fda00640 1 -- 172.21.15.100:0/1065106559 learned_addr learned my addr 172.21.15.100:0/1065106559 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.169+0000 7f33fd000640 1 --2- 172.21.15.100:0/1065106559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33f8068d40 0x7f33f815bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.169+0000 7f33fda00640 1 -- 172.21.15.100:0/1065106559 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f80aa730 msgr2=0x7f33f8156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.169+0000 7f33f7e00640 1 --2- 172.21.15.100:0/1065106559 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f80aa730 0x7f33f8156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.169+0000 7f33fda00640 1 --2- 172.21.15.100:0/1065106559 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f80aa730 0x7f33f8156e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.169+0000 7f33fda00640 1 -- 172.21.15.100:0/1065106559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33f8068d40 msgr2=0x7f33f815bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.169+0000 7f33fda00640 1 --2- 172.21.15.100:0/1065106559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33f8068d40 0x7f33f815bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.169+0000 7f33fda00640 1 -- 172.21.15.100:0/1065106559 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec009450 con 0x7f33f80ac290 2024-08-17T02:46:16.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.169+0000 7f33fd000640 1 --2- 172.21.15.100:0/1065106559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33f8068d40 0x7f33f815bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:16.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.169+0000 7f33f7e00640 1 --2- 172.21.15.100:0/1065106559 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f80aa730 0x7f33f8156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:16.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.169+0000 7f33fda00640 1 --2- 172.21.15.100:0/1065106559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33f80ac290 0x7f33f8154d40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f33f000c960 tx=0x7f33f00016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:16.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.169+0000 7f33ebe00640 1 -- 172.21.15.100:0/1065106559 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0005d60 con 0x7f33f80ac290 2024-08-17T02:46:16.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.169+0000 7f33ebe00640 1 -- 172.21.15.100:0/1065106559 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f000a640 con 0x7f33f80ac290 2024-08-17T02:46:16.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.169+0000 7f33fe400640 1 -- 172.21.15.100:0/1065106559 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f815c8e0 con 0x7f33f80ac290 2024-08-17T02:46:16.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.169+0000 7f33ebe00640 1 -- 172.21.15.100:0/1065106559 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f000aa00 con 0x7f33f80ac290 2024-08-17T02:46:16.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.170+0000 7f33fe400640 1 -- 172.21.15.100:0/1065106559 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f815c2f0 con 0x7f33f80ac290 2024-08-17T02:46:16.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.171+0000 7f33fe400640 1 -- 172.21.15.100:0/1065106559 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f815cde0 con 0x7f33f80ac290 2024-08-17T02:46:16.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.171+0000 7f33ebe00640 1 -- 172.21.15.100:0/1065106559 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f33f00070f0 con 0x7f33f80ac290 2024-08-17T02:46:16.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.172+0000 7f33ebe00640 1 --2- 172.21.15.100:0/1065106559 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f33d8065180 0x7f33d8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.172+0000 7f33ebe00640 1 -- 172.21.15.100:0/1065106559 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f33f0082290 con 0x7f33f80ac290 2024-08-17T02:46:16.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.172+0000 7f33fd000640 1 --2- 172.21.15.100:0/1065106559 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f33d8065180 0x7f33d8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.173+0000 7f33fd000640 1 --2- 172.21.15.100:0/1065106559 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f33d8065180 0x7f33d8067630 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f33ec034000 tx=0x7f33ec032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:16.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.176+0000 7f33ebe00640 1 -- 172.21.15.100:0/1065106559 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f33f0050330 con 0x7f33f80ac290 2024-08-17T02:46:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.344+0000 7f33fe400640 1 -- 172.21.15.100:0/1065106559 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33f8071050 con 0x7f33f80ac290 2024-08-17T02:46:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.345+0000 7f33ebe00640 1 -- 172.21.15.100:0/1065106559 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33f0053950 con 0x7f33f80ac290 2024-08-17T02:46:16.347 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-08-17T02:46:16.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.347+0000 7f33fe400640 1 -- 172.21.15.100:0/1065106559 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f33d8065180 msgr2=0x7f33d8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.347+0000 7f33fe400640 1 --2- 172.21.15.100:0/1065106559 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f33d8065180 0x7f33d8067630 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f33ec034000 tx=0x7f33ec032000 comp rx=0 tx=0).stop 2024-08-17T02:46:16.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.347+0000 7f33fe400640 1 -- 172.21.15.100:0/1065106559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33f80ac290 msgr2=0x7f33f8154d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.347+0000 7f33fe400640 1 --2- 172.21.15.100:0/1065106559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33f80ac290 0x7f33f8154d40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f33f000c960 tx=0x7f33f00016c0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.347+0000 7f33fe400640 1 -- 172.21.15.100:0/1065106559 shutdown_connections 2024-08-17T02:46:16.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.347+0000 7f33fe400640 1 --2- 172.21.15.100:0/1065106559 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f33d8065180 0x7f33d8067630 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.347+0000 7f33fe400640 1 --2- 172.21.15.100:0/1065106559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33f80ac290 0x7f33f8154d40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.347+0000 7f33fe400640 1 --2- 172.21.15.100:0/1065106559 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f80aa730 0x7f33f8156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.347+0000 7f33fe400640 1 --2- 172.21.15.100:0/1065106559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33f8068d40 0x7f33f815bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.347+0000 7f33fe400640 1 -- 172.21.15.100:0/1065106559 >> 172.21.15.100:0/1065106559 conn(0x7f33f8096a70 msgr2=0x7f33f80682f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:16.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.347+0000 7f33fe400640 1 -- 172.21.15.100:0/1065106559 shutdown_connections 2024-08-17T02:46:16.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.347+0000 7f33fe400640 1 -- 172.21.15.100:0/1065106559 wait complete. 2024-08-17T02:46:16.364 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:46:16.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.513+0000 7f1f97200640 1 Processor -- start 2024-08-17T02:46:16.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.513+0000 7f1f97200640 1 -- start start 2024-08-17T02:46:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.514+0000 7f1f97200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1f90156c50 0x7f1f900c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.514+0000 7f1f97200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f900adcf0 0x7f1f900ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.514+0000 7f1f97200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f900ab130 con 0x7f1f900abb00 2024-08-17T02:46:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.514+0000 7f1f97200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f900ae5a0 con 0x7f1f90156c50 2024-08-17T02:46:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.514+0000 7f1f97200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f900ae2c0 con 0x7f1f900adcf0 2024-08-17T02:46:16.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.515+0000 7f1f95200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1f900abb00 0x7f1f900c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45618/0 (socket says 172.21.15.100:45618) 2024-08-17T02:46:16.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.515+0000 7f1f95200640 1 -- 172.21.15.100:0/594424310 learned_addr learned my addr 172.21.15.100:0/594424310 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:16.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.515+0000 7f1f8fe00640 1 --2- 172.21.15.100:0/594424310 >> v2:172.21.15.123:3300/0 conn(0x7f1f90156c50 0x7f1f900c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.515+0000 7f1f8f400640 1 --2- 172.21.15.100:0/594424310 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f900adcf0 0x7f1f900ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.515+0000 7f1f8ea00640 1 -- 172.21.15.100:0/594424310 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095974508 0 0) 0x7f1f900ab130 con 0x7f1f900abb00 2024-08-17T02:46:16.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.515+0000 7f1f8ea00640 1 -- 172.21.15.100:0/594424310 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f740034e0 con 0x7f1f900abb00 2024-08-17T02:46:16.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.515+0000 7f1f8f400640 1 -- 172.21.15.100:0/594424310 >> v2:172.21.15.123:3300/0 conn(0x7f1f90156c50 msgr2=0x7f1f900c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:16.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.515+0000 7f1f8f400640 1 --2- 172.21.15.100:0/594424310 >> v2:172.21.15.123:3300/0 conn(0x7f1f90156c50 0x7f1f900c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.515+0000 7f1f8f400640 1 -- 172.21.15.100:0/594424310 >> v1:172.21.15.100:6789/0 conn(0x7f1f900abb00 legacy=0x7f1f900c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.515+0000 7f1f8f400640 1 -- 172.21.15.100:0/594424310 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f900aaae0 con 0x7f1f900adcf0 2024-08-17T02:46:16.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.515+0000 7f1f8fe00640 1 --2- 172.21.15.100:0/594424310 >> v2:172.21.15.123:3300/0 conn(0x7f1f90156c50 0x7f1f900c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:16.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.516+0000 7f1f8f400640 1 --2- 172.21.15.100:0/594424310 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f900adcf0 0x7f1f900ab5c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c009850 tx=0x7f1f7c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17e6ba93fa2c04f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:16.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.516+0000 7f1f8ea00640 1 -- 172.21.15.100:0/594424310 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c02ad00 con 0x7f1f900adcf0 2024-08-17T02:46:16.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.517+0000 7f1f8ea00640 1 -- 172.21.15.100:0/594424310 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7c02ae60 con 0x7f1f900adcf0 2024-08-17T02:46:16.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.517+0000 7f1f8ea00640 1 -- 172.21.15.100:0/594424310 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c032650 con 0x7f1f900adcf0 2024-08-17T02:46:16.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.517+0000 7f1f97200640 1 -- 172.21.15.100:0/594424310 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f900adcf0 msgr2=0x7f1f900ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.517+0000 7f1f97200640 1 --2- 172.21.15.100:0/594424310 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f900adcf0 0x7f1f900ab5c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c009850 tx=0x7f1f7c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.517+0000 7f1f97200640 1 -- 172.21.15.100:0/594424310 shutdown_connections 2024-08-17T02:46:16.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.517+0000 7f1f97200640 1 --2- 172.21.15.100:0/594424310 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f900adcf0 0x7f1f900ab5c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.517+0000 7f1f97200640 1 --2- 172.21.15.100:0/594424310 >> v2:172.21.15.123:3300/0 conn(0x7f1f90156c50 0x7f1f900c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.517+0000 7f1f97200640 1 -- 172.21.15.100:0/594424310 >> 172.21.15.100:0/594424310 conn(0x7f1f90067750 msgr2=0x7f1f900c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:16.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.517+0000 7f1f97200640 1 -- 172.21.15.100:0/594424310 shutdown_connections 2024-08-17T02:46:16.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.517+0000 7f1f97200640 1 -- 172.21.15.100:0/594424310 wait complete. 2024-08-17T02:46:16.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.519+0000 7f1f97200640 1 Processor -- start 2024-08-17T02:46:16.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.519+0000 7f1f97200640 1 -- start start 2024-08-17T02:46:16.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.519+0000 7f1f97200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f900abb00 0x7f1f9014a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.520+0000 7f1f97200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f900adcf0 0x7f1f901484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.520+0000 7f1f97200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f90156c50 0x7f1f9014bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.520+0000 7f1f97200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f901581f0 con 0x7f1f90156c50 2024-08-17T02:46:16.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.520+0000 7f1f97200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9014c8f0 con 0x7f1f900adcf0 2024-08-17T02:46:16.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.520+0000 7f1f97200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9014cbd0 con 0x7f1f900abb00 2024-08-17T02:46:16.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.520+0000 7f1f95200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f90156c50 0x7f1f9014bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.520+0000 7f1f95200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f90156c50 0x7f1f9014bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45442/0 (socket says 172.21.15.100:45442) 2024-08-17T02:46:16.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.520+0000 7f1f95200640 1 -- 172.21.15.100:0/61143354 learned_addr learned my addr 172.21.15.100:0/61143354 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:16.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.520+0000 7f1f8fe00640 1 --2- 172.21.15.100:0/61143354 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f900abb00 0x7f1f9014a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.520+0000 7f1f8f400640 1 --2- 172.21.15.100:0/61143354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f900adcf0 0x7f1f901484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.520+0000 7f1f95200640 1 -- 172.21.15.100:0/61143354 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f900abb00 msgr2=0x7f1f9014a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.520+0000 7f1f95200640 1 --2- 172.21.15.100:0/61143354 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f900abb00 0x7f1f9014a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.520+0000 7f1f95200640 1 -- 172.21.15.100:0/61143354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f900adcf0 msgr2=0x7f1f901484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.520+0000 7f1f95200640 1 --2- 172.21.15.100:0/61143354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f900adcf0 0x7f1f901484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.520+0000 7f1f95200640 1 -- 172.21.15.100:0/61143354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f80009390 con 0x7f1f90156c50 2024-08-17T02:46:16.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.521+0000 7f1f95200640 1 --2- 172.21.15.100:0/61143354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f90156c50 0x7f1f9014bf30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800cc40 tx=0x7f1f88001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:16.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.521+0000 7f1f87400640 1 -- 172.21.15.100:0/61143354 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8800ce60 con 0x7f1f90156c50 2024-08-17T02:46:16.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.521+0000 7f1f87400640 1 -- 172.21.15.100:0/61143354 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8800a850 con 0x7f1f90156c50 2024-08-17T02:46:16.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.521+0000 7f1f87400640 1 -- 172.21.15.100:0/61143354 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8800ac10 con 0x7f1f90156c50 2024-08-17T02:46:16.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.521+0000 7f1f97200640 1 -- 172.21.15.100:0/61143354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7c009390 con 0x7f1f90156c50 2024-08-17T02:46:16.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.521+0000 7f1f97200640 1 -- 172.21.15.100:0/61143354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f90158720 con 0x7f1f90156c50 2024-08-17T02:46:16.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.522+0000 7f1f97200640 1 -- 172.21.15.100:0/61143354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f90071050 con 0x7f1f90156c50 2024-08-17T02:46:16.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.523+0000 7f1f87400640 1 -- 172.21.15.100:0/61143354 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1f88007300 con 0x7f1f90156c50 2024-08-17T02:46:16.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.524+0000 7f1f87400640 1 --2- 172.21.15.100:0/61143354 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1f70065150 0x7f1f70067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.524+0000 7f1f87400640 1 -- 172.21.15.100:0/61143354 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f88082510 con 0x7f1f90156c50 2024-08-17T02:46:16.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.524+0000 7f1f8fe00640 1 --2- 172.21.15.100:0/61143354 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1f70065150 0x7f1f70067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.525+0000 7f1f8fe00640 1 --2- 172.21.15.100:0/61143354 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1f70065150 0x7f1f70067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1f80009e10 tx=0x7f1f800090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:16.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.528+0000 7f1f87400640 1 -- 172.21.15.100:0/61143354 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1f88050660 con 0x7f1f90156c50 2024-08-17T02:46:16.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.699+0000 7f1f97200640 1 -- 172.21.15.100:0/61143354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f90158910 con 0x7f1f90156c50 2024-08-17T02:46:16.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.700+0000 7f1f87400640 1 -- 172.21.15.100:0/61143354 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1f88053c80 con 0x7f1f90156c50 2024-08-17T02:46:16.701 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-08-17T02:46:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.702+0000 7f1f97200640 1 -- 172.21.15.100:0/61143354 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1f70065150 msgr2=0x7f1f70067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.702+0000 7f1f97200640 1 --2- 172.21.15.100:0/61143354 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1f70065150 0x7f1f70067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1f80009e10 tx=0x7f1f800090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.702+0000 7f1f97200640 1 -- 172.21.15.100:0/61143354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f90156c50 msgr2=0x7f1f9014bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.702+0000 7f1f97200640 1 --2- 172.21.15.100:0/61143354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f90156c50 0x7f1f9014bf30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800cc40 tx=0x7f1f88001aa0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.702+0000 7f1f97200640 1 -- 172.21.15.100:0/61143354 shutdown_connections 2024-08-17T02:46:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.702+0000 7f1f97200640 1 --2- 172.21.15.100:0/61143354 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1f70065150 0x7f1f70067600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.702+0000 7f1f97200640 1 --2- 172.21.15.100:0/61143354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f90156c50 0x7f1f9014bf30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.702+0000 7f1f97200640 1 --2- 172.21.15.100:0/61143354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f900adcf0 0x7f1f901484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.702+0000 7f1f97200640 1 --2- 172.21.15.100:0/61143354 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f900abb00 0x7f1f9014a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.702+0000 7f1f97200640 1 -- 172.21.15.100:0/61143354 >> 172.21.15.100:0/61143354 conn(0x7f1f90067750 msgr2=0x7f1f90068920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:16.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.702+0000 7f1f97200640 1 -- 172.21.15.100:0/61143354 shutdown_connections 2024-08-17T02:46:16.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.702+0000 7f1f97200640 1 -- 172.21.15.100:0/61143354 wait complete. 2024-08-17T02:46:16.719 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:46:16.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.869+0000 7f694de00640 1 Processor -- start 2024-08-17T02:46:16.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.869+0000 7f694de00640 1 -- start start 2024-08-17T02:46:16.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.871+0000 7f694de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6948155660 0x7f69480c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.871+0000 7f694de00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f69480adfb0 0x7f69480ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.871+0000 7f694de00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69480afc40 con 0x7f6948155a30 2024-08-17T02:46:16.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.871+0000 7f694de00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69480af030 con 0x7f69480adfb0 2024-08-17T02:46:16.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.871+0000 7f694de00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69480af310 con 0x7f6948155660 2024-08-17T02:46:16.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.871+0000 7f693fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f69480adfb0 0x7f69480ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.871+0000 7f693fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f69480adfb0 0x7f69480ae750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32806/0 (socket says 172.21.15.100:32806) 2024-08-17T02:46:16.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.871+0000 7f693fe00640 1 -- 172.21.15.100:0/2954763423 learned_addr learned my addr 172.21.15.100:0/2954763423 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:16.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.871+0000 7f694ca00640 1 --2- 172.21.15.100:0/2954763423 >> v2:172.21.15.123:3300/0 conn(0x7f6948155660 0x7f69480c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.871+0000 7f693fe00640 1 -- 172.21.15.100:0/2954763423 >> v2:172.21.15.123:3300/0 conn(0x7f6948155660 msgr2=0x7f69480c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:16.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.871+0000 7f693fe00640 1 --2- 172.21.15.100:0/2954763423 >> v2:172.21.15.123:3300/0 conn(0x7f6948155660 0x7f69480c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.871+0000 7f693fe00640 1 -- 172.21.15.100:0/2954763423 >> v1:172.21.15.123:6789/0 conn(0x7f6948155a30 legacy=0x7f694806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:16.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.871+0000 7f693fe00640 1 -- 172.21.15.100:0/2954763423 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69480af5f0 con 0x7f69480adfb0 2024-08-17T02:46:16.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.871+0000 7f694ca00640 1 --2- 172.21.15.100:0/2954763423 >> v2:172.21.15.123:3300/0 conn(0x7f6948155660 0x7f69480c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:16.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.872+0000 7f693fe00640 1 --2- 172.21.15.100:0/2954763423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69480adfb0 0x7f69480ae750 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f694806aa30 tx=0x7f69300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aecb780e25429e88 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:16.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.873+0000 7f6947e00640 1 -- 172.21.15.100:0/2954763423 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693002ae60 con 0x7f69480adfb0 2024-08-17T02:46:16.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.873+0000 7f6947e00640 1 -- 172.21.15.100:0/2954763423 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6930032440 con 0x7f69480adfb0 2024-08-17T02:46:16.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.873+0000 7f6947e00640 1 -- 172.21.15.100:0/2954763423 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69300327e0 con 0x7f69480adfb0 2024-08-17T02:46:16.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.873+0000 7f694de00640 1 -- 172.21.15.100:0/2954763423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69480adfb0 msgr2=0x7f69480ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.873+0000 7f694de00640 1 --2- 172.21.15.100:0/2954763423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69480adfb0 0x7f69480ae750 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f694806aa30 tx=0x7f69300091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.873+0000 7f694de00640 1 -- 172.21.15.100:0/2954763423 shutdown_connections 2024-08-17T02:46:16.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.873+0000 7f694de00640 1 --2- 172.21.15.100:0/2954763423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69480adfb0 0x7f69480ae750 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.873+0000 7f694de00640 1 --2- 172.21.15.100:0/2954763423 >> v2:172.21.15.123:3300/0 conn(0x7f6948155660 0x7f69480c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.873+0000 7f694de00640 1 -- 172.21.15.100:0/2954763423 >> 172.21.15.100:0/2954763423 conn(0x7f6948066cd0 msgr2=0x7f69480670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:16.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.873+0000 7f694de00640 1 -- 172.21.15.100:0/2954763423 shutdown_connections 2024-08-17T02:46:16.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.873+0000 7f694de00640 1 -- 172.21.15.100:0/2954763423 wait complete. 2024-08-17T02:46:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.875+0000 7f694de00640 1 Processor -- start 2024-08-17T02:46:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.875+0000 7f694de00640 1 -- start start 2024-08-17T02:46:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.876+0000 7f694de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69480adfb0 0x7f69480c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.876+0000 7f694de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6948155660 0x7f6948143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.876+0000 7f694de00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6948155a30 0x7f694816ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.876+0000 7f694de00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6948152100 con 0x7f69480adfb0 2024-08-17T02:46:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.876+0000 7f694de00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69481523e0 con 0x7f6948155660 2024-08-17T02:46:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.876+0000 7f694de00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69481526c0 con 0x7f6948155a30 2024-08-17T02:46:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.876+0000 7f694ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69480adfb0 0x7f69480c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.876+0000 7f694ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69480adfb0 0x7f69480c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32814/0 (socket says 172.21.15.100:32814) 2024-08-17T02:46:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.876+0000 7f694ca00640 1 -- 172.21.15.100:0/432012882 learned_addr learned my addr 172.21.15.100:0/432012882 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.876+0000 7f693fe00640 1 --2- 172.21.15.100:0/432012882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6948155660 0x7f6948143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.876+0000 7f694d400640 1 --2- 172.21.15.100:0/432012882 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6948155a30 0x7f694816ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.876+0000 7f694ca00640 1 -- 172.21.15.100:0/432012882 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6948155a30 msgr2=0x7f694816ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.876+0000 7f694ca00640 1 --2- 172.21.15.100:0/432012882 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6948155a30 0x7f694816ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.876+0000 7f694ca00640 1 -- 172.21.15.100:0/432012882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6948155660 msgr2=0x7f6948143e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.876+0000 7f694ca00640 1 --2- 172.21.15.100:0/432012882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6948155660 0x7f6948143e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.877+0000 7f694ca00640 1 -- 172.21.15.100:0/432012882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6930009450 con 0x7f69480adfb0 2024-08-17T02:46:16.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.877+0000 7f694d400640 1 --2- 172.21.15.100:0/432012882 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6948155a30 0x7f694816ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:16.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.877+0000 7f694ca00640 1 --2- 172.21.15.100:0/432012882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69480adfb0 0x7f69480c7e40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f693800d890 tx=0x7f6938008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:16.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.877+0000 7f6944c00640 1 -- 172.21.15.100:0/432012882 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693800de80 con 0x7f69480adfb0 2024-08-17T02:46:16.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.877+0000 7f6944c00640 1 -- 172.21.15.100:0/432012882 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693800b8d0 con 0x7f69480adfb0 2024-08-17T02:46:16.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.877+0000 7f694de00640 1 -- 172.21.15.100:0/432012882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69481529a0 con 0x7f69480adfb0 2024-08-17T02:46:16.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.877+0000 7f6944c00640 1 -- 172.21.15.100:0/432012882 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693800bc90 con 0x7f69480adfb0 2024-08-17T02:46:16.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.877+0000 7f694de00640 1 -- 172.21.15.100:0/432012882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6948144390 con 0x7f69480adfb0 2024-08-17T02:46:16.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.878+0000 7f694de00640 1 -- 172.21.15.100:0/432012882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6948071050 con 0x7f69480adfb0 2024-08-17T02:46:16.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.879+0000 7f6944c00640 1 -- 172.21.15.100:0/432012882 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f693801e460 con 0x7f69480adfb0 2024-08-17T02:46:16.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.880+0000 7f6944c00640 1 --2- 172.21.15.100:0/432012882 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6924065150 0x7f6924067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.880+0000 7f6944c00640 1 -- 172.21.15.100:0/432012882 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6938082a80 con 0x7f69480adfb0 2024-08-17T02:46:16.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.880+0000 7f693fe00640 1 --2- 172.21.15.100:0/432012882 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6924065150 0x7f6924067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.881+0000 7f693fe00640 1 --2- 172.21.15.100:0/432012882 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6924065150 0x7f6924067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6930034000 tx=0x7f6930032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:16.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:16.884+0000 7f6944c00640 1 -- 172.21.15.100:0/432012882 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f69380545d0 con 0x7f69480adfb0 2024-08-17T02:46:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.055+0000 7f694de00640 1 -- 172.21.15.100:0/432012882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69480696d0 con 0x7f69480adfb0 2024-08-17T02:46:17.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.055+0000 7f6944c00640 1 -- 172.21.15.100:0/432012882 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6938054160 con 0x7f69480adfb0 2024-08-17T02:46:17.057 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-08-17T02:46:17.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.057+0000 7f694de00640 1 -- 172.21.15.100:0/432012882 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6924065150 msgr2=0x7f6924067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.057+0000 7f694de00640 1 --2- 172.21.15.100:0/432012882 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6924065150 0x7f6924067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6930034000 tx=0x7f6930032000 comp rx=0 tx=0).stop 2024-08-17T02:46:17.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.057+0000 7f694de00640 1 -- 172.21.15.100:0/432012882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69480adfb0 msgr2=0x7f69480c7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.057+0000 7f694de00640 1 --2- 172.21.15.100:0/432012882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69480adfb0 0x7f69480c7e40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f693800d890 tx=0x7f6938008040 comp rx=0 tx=0).stop 2024-08-17T02:46:17.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.057+0000 7f694de00640 1 -- 172.21.15.100:0/432012882 shutdown_connections 2024-08-17T02:46:17.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.057+0000 7f694de00640 1 --2- 172.21.15.100:0/432012882 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6924065150 0x7f6924067600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.057+0000 7f694de00640 1 --2- 172.21.15.100:0/432012882 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6948155a30 0x7f694816ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.057+0000 7f694de00640 1 --2- 172.21.15.100:0/432012882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6948155660 0x7f6948143e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.057+0000 7f694de00640 1 --2- 172.21.15.100:0/432012882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69480adfb0 0x7f69480c7e40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.057+0000 7f694de00640 1 -- 172.21.15.100:0/432012882 >> 172.21.15.100:0/432012882 conn(0x7f6948066cd0 msgr2=0x7f6948154640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:17.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.057+0000 7f694de00640 1 -- 172.21.15.100:0/432012882 shutdown_connections 2024-08-17T02:46:17.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.057+0000 7f694de00640 1 -- 172.21.15.100:0/432012882 wait complete. 2024-08-17T02:46:17.074 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:46:17.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.220+0000 7feaada00640 1 Processor -- start 2024-08-17T02:46:17.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.220+0000 7feaada00640 1 -- start start 2024-08-17T02:46:17.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.222+0000 7feaada00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feaa8155a20 0x7feaa80adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.222+0000 7feaada00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaa8155df0 0x7feaa80ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.222+0000 7feaada00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7feaa806d7f0 0x7feaa806dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.222+0000 7feaada00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa80b0350 con 0x7feaa8155a20 2024-08-17T02:46:17.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.222+0000 7feaada00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa806e1d0 con 0x7feaa806d7f0 2024-08-17T02:46:17.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.222+0000 7feaada00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa8156670 con 0x7feaa8155df0 2024-08-17T02:46:17.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.222+0000 7feaa6a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feaa8155a20 0x7feaa80adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.222+0000 7feaa6a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feaa8155a20 0x7feaa80adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32820/0 (socket says 172.21.15.100:32820) 2024-08-17T02:46:17.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.222+0000 7feaa6a00640 1 -- 172.21.15.100:0/3066017482 learned_addr learned my addr 172.21.15.100:0/3066017482 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:17.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.222+0000 7fea9e000640 1 --2- 172.21.15.100:0/3066017482 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaa8155df0 0x7feaa80ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.222+0000 7feaa7400640 1 --2- 172.21.15.100:0/3066017482 >> v2:172.21.15.123:3300/0 conn(0x7feaa806d7f0 0x7feaa806dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.223+0000 7feaa6a00640 1 -- 172.21.15.100:0/3066017482 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaa8155df0 msgr2=0x7feaa80ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:17.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.223+0000 7feaa6a00640 1 --2- 172.21.15.100:0/3066017482 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaa8155df0 0x7feaa80ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.223+0000 7feaa6a00640 1 -- 172.21.15.100:0/3066017482 >> v2:172.21.15.123:3300/0 conn(0x7feaa806d7f0 msgr2=0x7feaa806dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:17.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.223+0000 7feaa6a00640 1 --2- 172.21.15.100:0/3066017482 >> v2:172.21.15.123:3300/0 conn(0x7feaa806d7f0 0x7feaa806dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.223+0000 7feaa6a00640 1 -- 172.21.15.100:0/3066017482 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa806e5e0 con 0x7feaa8155a20 2024-08-17T02:46:17.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.223+0000 7feaa7400640 1 --2- 172.21.15.100:0/3066017482 >> v2:172.21.15.123:3300/0 conn(0x7feaa806d7f0 0x7feaa806dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:17.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.223+0000 7fea9e000640 1 --2- 172.21.15.100:0/3066017482 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaa8155df0 0x7feaa80ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:17.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.224+0000 7feaa6a00640 1 --2- 172.21.15.100:0/3066017482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaa8155a20 0x7feaa80adf10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7feaa81565e0 tx=0x7fea980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27043774ef999224 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:17.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.224+0000 7feaa6000640 1 -- 172.21.15.100:0/3066017482 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9802add0 con 0x7feaa8155a20 2024-08-17T02:46:17.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.224+0000 7feaa6000640 1 -- 172.21.15.100:0/3066017482 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea98032440 con 0x7feaa8155a20 2024-08-17T02:46:17.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.224+0000 7feaa6000640 1 -- 172.21.15.100:0/3066017482 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98032820 con 0x7feaa8155a20 2024-08-17T02:46:17.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.224+0000 7feaada00640 1 -- 172.21.15.100:0/3066017482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaa8155a20 msgr2=0x7feaa80adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.224+0000 7feaada00640 1 --2- 172.21.15.100:0/3066017482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaa8155a20 0x7feaa80adf10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7feaa81565e0 tx=0x7fea980091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.225+0000 7feaada00640 1 -- 172.21.15.100:0/3066017482 shutdown_connections 2024-08-17T02:46:17.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.225+0000 7feaada00640 1 --2- 172.21.15.100:0/3066017482 >> v2:172.21.15.123:3300/0 conn(0x7feaa806d7f0 0x7feaa806dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.225+0000 7feaada00640 1 --2- 172.21.15.100:0/3066017482 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaa8155df0 0x7feaa80ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.225+0000 7feaada00640 1 --2- 172.21.15.100:0/3066017482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaa8155a20 0x7feaa80adf10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.225+0000 7feaada00640 1 -- 172.21.15.100:0/3066017482 >> 172.21.15.100:0/3066017482 conn(0x7feaa80cb9b0 msgr2=0x7feaa80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:17.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.225+0000 7feaada00640 1 -- 172.21.15.100:0/3066017482 shutdown_connections 2024-08-17T02:46:17.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.225+0000 7feaada00640 1 -- 172.21.15.100:0/3066017482 wait complete. 2024-08-17T02:46:17.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.226+0000 7feaada00640 1 Processor -- start 2024-08-17T02:46:17.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.226+0000 7feaada00640 1 -- start start 2024-08-17T02:46:17.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.227+0000 7feaada00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaa806d7f0 0x7feaa8139df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.227+0000 7feaada00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaa8155a20 0x7feaa8166fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.227+0000 7feaada00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaa8155df0 0x7feaa80caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.227+0000 7feaada00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa8150800 con 0x7feaa806d7f0 2024-08-17T02:46:17.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.227+0000 7feaada00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa81674e0 con 0x7feaa8155a20 2024-08-17T02:46:17.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.227+0000 7feaada00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa814c070 con 0x7feaa8155df0 2024-08-17T02:46:17.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.227+0000 7feaa6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaa806d7f0 0x7feaa8139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.227+0000 7feaa6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaa806d7f0 0x7feaa8139df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32832/0 (socket says 172.21.15.100:32832) 2024-08-17T02:46:17.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.227+0000 7feaa6a00640 1 -- 172.21.15.100:0/2834234316 learned_addr learned my addr 172.21.15.100:0/2834234316 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:17.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.228+0000 7feaa6a00640 1 -- 172.21.15.100:0/2834234316 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaa8155df0 msgr2=0x7feaa80caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.228+0000 7feaa6a00640 1 --2- 172.21.15.100:0/2834234316 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaa8155df0 0x7feaa80caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.228+0000 7feaa6a00640 1 -- 172.21.15.100:0/2834234316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaa8155a20 msgr2=0x7feaa8166fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.228+0000 7fea9e000640 1 --2- 172.21.15.100:0/2834234316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaa8155a20 0x7feaa8166fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.228+0000 7feaa6a00640 1 --2- 172.21.15.100:0/2834234316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaa8155a20 0x7feaa8166fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.228+0000 7feaa6a00640 1 -- 172.21.15.100:0/2834234316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea98009450 con 0x7feaa806d7f0 2024-08-17T02:46:17.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.228+0000 7fea9e000640 1 --2- 172.21.15.100:0/2834234316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaa8155a20 0x7feaa8166fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:17.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.228+0000 7feaa6a00640 1 --2- 172.21.15.100:0/2834234316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaa806d7f0 0x7feaa8139df0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fea98009210 tx=0x7fea98032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:17.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.228+0000 7fea9ea00640 1 -- 172.21.15.100:0/2834234316 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98000d10 con 0x7feaa806d7f0 2024-08-17T02:46:17.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.228+0000 7fea9ea00640 1 -- 172.21.15.100:0/2834234316 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea98031a40 con 0x7feaa806d7f0 2024-08-17T02:46:17.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.228+0000 7fea9ea00640 1 -- 172.21.15.100:0/2834234316 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98031e00 con 0x7feaa806d7f0 2024-08-17T02:46:17.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.228+0000 7feaada00640 1 -- 172.21.15.100:0/2834234316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa814b760 con 0x7feaa806d7f0 2024-08-17T02:46:17.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.228+0000 7feaada00640 1 -- 172.21.15.100:0/2834234316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa814bd00 con 0x7feaa806d7f0 2024-08-17T02:46:17.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.229+0000 7feaada00640 1 -- 172.21.15.100:0/2834234316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa8064db0 con 0x7feaa806d7f0 2024-08-17T02:46:17.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.230+0000 7fea9ea00640 1 -- 172.21.15.100:0/2834234316 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fea98039040 con 0x7feaa806d7f0 2024-08-17T02:46:17.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.231+0000 7fea9ea00640 1 --2- 172.21.15.100:0/2834234316 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fea84065150 0x7fea84067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.231+0000 7fea9ea00640 1 -- 172.21.15.100:0/2834234316 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea980a21c0 con 0x7feaa806d7f0 2024-08-17T02:46:17.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.231+0000 7fea9e000640 1 --2- 172.21.15.100:0/2834234316 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fea84065150 0x7fea84067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.232+0000 7fea9e000640 1 --2- 172.21.15.100:0/2834234316 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fea84065150 0x7fea84067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fea90006fd0 tx=0x7fea90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:17.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.235+0000 7fea9ea00640 1 -- 172.21.15.100:0/2834234316 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fea980701e0 con 0x7feaa806d7f0 2024-08-17T02:46:17.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.440+0000 7feaada00640 1 -- 172.21.15.100:0/2834234316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feaa8153010 con 0x7feaa806d7f0 2024-08-17T02:46:17.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.441+0000 7fea9ea00640 1 -- 172.21.15.100:0/2834234316 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fea98073800 con 0x7feaa806d7f0 2024-08-17T02:46:17.443 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:17.443 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3043714204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3043714204},{"type":"v1","addr":"172.21.15.100:6835","nonce":3043714204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/543049926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":543049926},{"type":"v1","addr":"172.21.15.100:6837","nonce":543049926}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2733092927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2733092927},{"type":"v1","addr":"172.21.15.123:6834","nonce":2733092927}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:45:41.237121+0000","modified":"2024-08-17T02:45:44.862501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/2872394530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2872394530},{"type":"v1","addr":"172.21.15.123:6835","nonce":2872394530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:46:17.443 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-08-17T02:46:17.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.443+0000 7feaada00640 1 -- 172.21.15.100:0/2834234316 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fea84065150 msgr2=0x7fea84067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.443+0000 7feaada00640 1 --2- 172.21.15.100:0/2834234316 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fea84065150 0x7fea84067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fea90006fd0 tx=0x7fea90008040 comp rx=0 tx=0).stop 2024-08-17T02:46:17.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.443+0000 7feaada00640 1 -- 172.21.15.100:0/2834234316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaa806d7f0 msgr2=0x7feaa8139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.443+0000 7feaada00640 1 --2- 172.21.15.100:0/2834234316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaa806d7f0 0x7feaa8139df0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fea98009210 tx=0x7fea98032000 comp rx=0 tx=0).stop 2024-08-17T02:46:17.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.443+0000 7feaada00640 1 -- 172.21.15.100:0/2834234316 shutdown_connections 2024-08-17T02:46:17.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.443+0000 7feaada00640 1 --2- 172.21.15.100:0/2834234316 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fea84065150 0x7fea84067600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.443+0000 7feaada00640 1 --2- 172.21.15.100:0/2834234316 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaa8155df0 0x7feaa80caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.443+0000 7feaada00640 1 --2- 172.21.15.100:0/2834234316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaa8155a20 0x7feaa8166fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.443+0000 7feaada00640 1 --2- 172.21.15.100:0/2834234316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaa806d7f0 0x7feaa8139df0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.443+0000 7feaada00640 1 -- 172.21.15.100:0/2834234316 >> 172.21.15.100:0/2834234316 conn(0x7feaa80cb9b0 msgr2=0x7feaa8154430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:17.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.443+0000 7feaada00640 1 -- 172.21.15.100:0/2834234316 shutdown_connections 2024-08-17T02:46:17.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.443+0000 7feaada00640 1 -- 172.21.15.100:0/2834234316 wait complete. 2024-08-17T02:46:17.459 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:17.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.606+0000 7f1c04800640 1 Processor -- start 2024-08-17T02:46:17.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.606+0000 7f1c04800640 1 -- start start 2024-08-17T02:46:17.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.607+0000 7f1c04800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bfc15c230 0x7f1bfc06be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.607+0000 7f1c04800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1bfc0aa8f0 0x7f1bfc066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.607+0000 7f1c04800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bfc06b9d0 con 0x7f1bfc15c600 2024-08-17T02:46:17.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.607+0000 7f1c04800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bfc06ebf0 con 0x7f1bfc0aa8f0 2024-08-17T02:46:17.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.607+0000 7f1c04800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc0aad80 con 0x7f1bfc15c230 2024-08-17T02:46:17.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.608+0000 7f1c01e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bfc15c230 0x7f1bfc06be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.608+0000 7f1c01e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bfc15c230 0x7f1bfc06be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:53600/0 (socket says 172.21.15.100:53600) 2024-08-17T02:46:17.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.608+0000 7f1c01e00640 1 -- 172.21.15.100:0/2156459802 learned_addr learned my addr 172.21.15.100:0/2156459802 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:17.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.608+0000 7f1c02800640 1 --2- 172.21.15.100:0/2156459802 >> v2:172.21.15.123:3300/0 conn(0x7f1bfc0aa8f0 0x7f1bfc066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.608+0000 7f1c01e00640 1 -- 172.21.15.100:0/2156459802 >> v2:172.21.15.123:3300/0 conn(0x7f1bfc0aa8f0 msgr2=0x7f1bfc066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:17.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.608+0000 7f1c01e00640 1 --2- 172.21.15.100:0/2156459802 >> v2:172.21.15.123:3300/0 conn(0x7f1bfc0aa8f0 0x7f1bfc066cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.608+0000 7f1c01e00640 1 -- 172.21.15.100:0/2156459802 >> v1:172.21.15.123:6789/0 conn(0x7f1bfc15c600 legacy=0x7f1bfc06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.608+0000 7f1c01e00640 1 -- 172.21.15.100:0/2156459802 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc0ab060 con 0x7f1bfc15c230 2024-08-17T02:46:17.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.609+0000 7f1c01e00640 1 --2- 172.21.15.100:0/2156459802 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bfc15c230 0x7f1bfc06be60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0009910 tx=0x7f1bf00091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57432cf6996e82dc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:17.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.610+0000 7f1c00a00640 1 -- 172.21.15.100:0/2156459802 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf002ae40 con 0x7f1bfc15c230 2024-08-17T02:46:17.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.610+0000 7f1c00a00640 1 -- 172.21.15.100:0/2156459802 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf0032440 con 0x7f1bfc15c230 2024-08-17T02:46:17.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.610+0000 7f1c00a00640 1 -- 172.21.15.100:0/2156459802 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0032820 con 0x7f1bfc15c230 2024-08-17T02:46:17.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.610+0000 7f1c04800640 1 -- 172.21.15.100:0/2156459802 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bfc15c230 msgr2=0x7f1bfc06be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.610+0000 7f1c04800640 1 --2- 172.21.15.100:0/2156459802 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bfc15c230 0x7f1bfc06be60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0009910 tx=0x7f1bf00091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.610+0000 7f1c04800640 1 -- 172.21.15.100:0/2156459802 shutdown_connections 2024-08-17T02:46:17.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.610+0000 7f1c04800640 1 --2- 172.21.15.100:0/2156459802 >> v2:172.21.15.123:3300/0 conn(0x7f1bfc0aa8f0 0x7f1bfc066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.610+0000 7f1c04800640 1 --2- 172.21.15.100:0/2156459802 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bfc15c230 0x7f1bfc06be60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.610+0000 7f1c04800640 1 -- 172.21.15.100:0/2156459802 >> 172.21.15.100:0/2156459802 conn(0x7f1bfc06d8f0 msgr2=0x7f1bfc06dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:17.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.610+0000 7f1c04800640 1 -- 172.21.15.100:0/2156459802 shutdown_connections 2024-08-17T02:46:17.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.610+0000 7f1c04800640 1 -- 172.21.15.100:0/2156459802 wait complete. 2024-08-17T02:46:17.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.612+0000 7f1c04800640 1 Processor -- start 2024-08-17T02:46:17.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.612+0000 7f1c04800640 1 -- start start 2024-08-17T02:46:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.613+0000 7f1c04800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bfc0aa8f0 0x7f1bfc15ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.613+0000 7f1c04800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bfc15c230 0x7f1bfc156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.613+0000 7f1c04800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bfc15c600 0x7f1bfc15f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.613+0000 7f1c04800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc0c28e0 con 0x7f1bfc0aa8f0 2024-08-17T02:46:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.613+0000 7f1c04800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc0c9720 con 0x7f1bfc15c230 2024-08-17T02:46:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.613+0000 7f1c04800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc15d040 con 0x7f1bfc15c600 2024-08-17T02:46:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.613+0000 7f1c01e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bfc0aa8f0 0x7f1bfc15ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.613+0000 7f1c01e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bfc0aa8f0 0x7f1bfc15ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32836/0 (socket says 172.21.15.100:32836) 2024-08-17T02:46:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.613+0000 7f1c01e00640 1 -- 172.21.15.100:0/2532289140 learned_addr learned my addr 172.21.15.100:0/2532289140 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.613+0000 7f1c02800640 1 --2- 172.21.15.100:0/2532289140 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bfc15c600 0x7f1bfc15f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.613+0000 7f1c01400640 1 --2- 172.21.15.100:0/2532289140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bfc15c230 0x7f1bfc156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.613+0000 7f1c01e00640 1 -- 172.21.15.100:0/2532289140 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bfc15c600 msgr2=0x7f1bfc15f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.613+0000 7f1c01e00640 1 --2- 172.21.15.100:0/2532289140 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bfc15c600 0x7f1bfc15f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.613+0000 7f1c01e00640 1 -- 172.21.15.100:0/2532289140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bfc15c230 msgr2=0x7f1bfc156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.613+0000 7f1c01e00640 1 --2- 172.21.15.100:0/2532289140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bfc15c230 0x7f1bfc156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.613+0000 7f1c01e00640 1 -- 172.21.15.100:0/2532289140 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf0009450 con 0x7f1bfc0aa8f0 2024-08-17T02:46:17.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.614+0000 7f1c01e00640 1 --2- 172.21.15.100:0/2532289140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bfc0aa8f0 0x7f1bfc15ca60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0009970 tx=0x7f1bf0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:17.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.614+0000 7f1bf5600640 1 -- 172.21.15.100:0/2532289140 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0031bb0 con 0x7f1bfc0aa8f0 2024-08-17T02:46:17.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.614+0000 7f1bf5600640 1 -- 172.21.15.100:0/2532289140 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf0031d30 con 0x7f1bfc0aa8f0 2024-08-17T02:46:17.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.614+0000 7f1c04800640 1 -- 172.21.15.100:0/2532289140 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bfc15e400 con 0x7f1bfc0aa8f0 2024-08-17T02:46:17.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.614+0000 7f1bf5600640 1 -- 172.21.15.100:0/2532289140 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0031ea0 con 0x7f1bfc0aa8f0 2024-08-17T02:46:17.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.614+0000 7f1c04800640 1 -- 172.21.15.100:0/2532289140 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bfc15e1a0 con 0x7f1bfc0aa8f0 2024-08-17T02:46:17.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.615+0000 7f1c04800640 1 -- 172.21.15.100:0/2532289140 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bfc156f40 con 0x7f1bfc0aa8f0 2024-08-17T02:46:17.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.616+0000 7f1bf5600640 1 -- 172.21.15.100:0/2532289140 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1bf0039040 con 0x7f1bfc0aa8f0 2024-08-17T02:46:17.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.617+0000 7f1bf5600640 1 --2- 172.21.15.100:0/2532289140 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1be0065150 0x7f1be0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.617+0000 7f1bf5600640 1 -- 172.21.15.100:0/2532289140 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1bf002ae40 con 0x7f1bfc0aa8f0 2024-08-17T02:46:17.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.617+0000 7f1c01400640 1 --2- 172.21.15.100:0/2532289140 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1be0065150 0x7f1be0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.618+0000 7f1c01400640 1 --2- 172.21.15.100:0/2532289140 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1be0065150 0x7f1be0067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0cc1b0 tx=0x7f1bec007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:17.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.621+0000 7f1bf5600640 1 -- 172.21.15.100:0/2532289140 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1bf0070700 con 0x7f1bfc0aa8f0 2024-08-17T02:46:17.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.795+0000 7f1c04800640 1 -- 172.21.15.100:0/2532289140 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bfc064db0 con 0x7f1bfc0aa8f0 2024-08-17T02:46:17.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.796+0000 7f1bf5600640 1 -- 172.21.15.100:0/2532289140 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f1bf0073d20 con 0x7f1bfc0aa8f0 2024-08-17T02:46:17.798 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:17.799 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:42.845503+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:45:39.036964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:45:40.232954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:17.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.798+0000 7f1c04800640 1 -- 172.21.15.100:0/2532289140 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1be0065150 msgr2=0x7f1be0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.798+0000 7f1c04800640 1 --2- 172.21.15.100:0/2532289140 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1be0065150 0x7f1be0067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0cc1b0 tx=0x7f1bec007e30 comp rx=0 tx=0).stop 2024-08-17T02:46:17.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.798+0000 7f1c04800640 1 -- 172.21.15.100:0/2532289140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bfc0aa8f0 msgr2=0x7f1bfc15ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.798+0000 7f1c04800640 1 --2- 172.21.15.100:0/2532289140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bfc0aa8f0 0x7f1bfc15ca60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0009970 tx=0x7f1bf0032000 comp rx=0 tx=0).stop 2024-08-17T02:46:17.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.799+0000 7f1c04800640 1 -- 172.21.15.100:0/2532289140 shutdown_connections 2024-08-17T02:46:17.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.799+0000 7f1c04800640 1 --2- 172.21.15.100:0/2532289140 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1be0065150 0x7f1be0067600 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.799+0000 7f1c04800640 1 --2- 172.21.15.100:0/2532289140 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bfc15c600 0x7f1bfc15f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.799+0000 7f1c04800640 1 --2- 172.21.15.100:0/2532289140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bfc15c230 0x7f1bfc156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.799+0000 7f1c04800640 1 --2- 172.21.15.100:0/2532289140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bfc0aa8f0 0x7f1bfc15ca60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.799+0000 7f1c04800640 1 -- 172.21.15.100:0/2532289140 >> 172.21.15.100:0/2532289140 conn(0x7f1bfc06d8f0 msgr2=0x7f1bfc0ae560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:17.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.799+0000 7f1c04800640 1 -- 172.21.15.100:0/2532289140 shutdown_connections 2024-08-17T02:46:17.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.799+0000 7f1c04800640 1 -- 172.21.15.100:0/2532289140 wait complete. 2024-08-17T02:46:17.816 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:46:17.817 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:46:17.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.962+0000 7f3f15a00640 1 Processor -- start 2024-08-17T02:46:17.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.962+0000 7f3f15a00640 1 -- start start 2024-08-17T02:46:17.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.964+0000 7f3f15a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3f101401b0 0x7f3f100caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.964+0000 7f3f15a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f10140580 0x7f3f100b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.964+0000 7f3f15a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f100b16d0 con 0x7f3f100b1270 2024-08-17T02:46:17.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.964+0000 7f3f15a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f100cb450 con 0x7f3f101401b0 2024-08-17T02:46:17.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.964+0000 7f3f15a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f100caa80 con 0x7f3f10140580 2024-08-17T02:46:17.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.964+0000 7f3f0f400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3f100b1270 0x7f3f100c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49488/0 (socket says 172.21.15.100:49488) 2024-08-17T02:46:17.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.964+0000 7f3f0f400640 1 -- 172.21.15.100:0/4073796580 learned_addr learned my addr 172.21.15.100:0/4073796580 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:17.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.964+0000 7f3f0e000640 1 --2- 172.21.15.100:0/4073796580 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f10140580 0x7f3f100b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.964+0000 7f3f0ea00640 1 --2- 172.21.15.100:0/4073796580 >> v2:172.21.15.123:3300/0 conn(0x7f3f101401b0 0x7f3f100caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.965+0000 7f3f0d600640 1 -- 172.21.15.100:0/4073796580 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783926478 0 0) 0x7f3f08001490 con 0x7f3f100b1270 2024-08-17T02:46:17.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.965+0000 7f3f0d600640 1 -- 172.21.15.100:0/4073796580 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ef40034e0 con 0x7f3f100b1270 2024-08-17T02:46:17.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.965+0000 7f3f0d600640 1 -- 172.21.15.100:0/4073796580 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 419521617 0 0) 0x7f3ef40034e0 con 0x7f3f100b1270 2024-08-17T02:46:17.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.965+0000 7f3f0d600640 1 -- 172.21.15.100:0/4073796580 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f10140580 msgr2=0x7f3f100b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:17.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.965+0000 7f3f0d600640 1 --2- 172.21.15.100:0/4073796580 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f10140580 0x7f3f100b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.965+0000 7f3f0d600640 1 -- 172.21.15.100:0/4073796580 >> v2:172.21.15.123:3300/0 conn(0x7f3f101401b0 msgr2=0x7f3f100caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:17.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.965+0000 7f3f0d600640 1 --2- 172.21.15.100:0/4073796580 >> v2:172.21.15.123:3300/0 conn(0x7f3f101401b0 0x7f3f100caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.965+0000 7f3f0d600640 1 -- 172.21.15.100:0/4073796580 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f100c9e70 con 0x7f3f100b1270 2024-08-17T02:46:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.965+0000 7f3f0d600640 1 -- 172.21.15.100:0/4073796580 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1817143124 0 0) 0x7f3f08001980 con 0x7f3f100b1270 2024-08-17T02:46:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.965+0000 7f3f0d600640 1 -- 172.21.15.100:0/4073796580 >> v1:172.21.15.100:6789/0 conn(0x7f3f100b1270 legacy=0x7f3f100c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.965+0000 7f3f0d600640 1 --2- 172.21.15.100:0/4073796580 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f10140580 0x7f3ef40039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.965+0000 7f3f0d600640 1 --2- 172.21.15.100:0/4073796580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ef4003f50 0x7f3ef4004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.965+0000 7f3f0d600640 1 --2- 172.21.15.100:0/4073796580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef4004cc0 0x7f3ef4005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.965+0000 7f3f0d600640 1 -- 172.21.15.100:0/4073796580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f100cb450 con 0x7f3ef4004cc0 2024-08-17T02:46:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.965+0000 7f3f0d600640 1 -- 172.21.15.100:0/4073796580 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f100caa80 con 0x7f3ef4003f50 2024-08-17T02:46:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.965+0000 7f3f0d600640 1 -- 172.21.15.100:0/4073796580 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef400ba00 con 0x7f3f10140580 2024-08-17T02:46:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.965+0000 7f3f0f400640 1 --2- 172.21.15.100:0/4073796580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef4004cc0 0x7f3ef4005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.965+0000 7f3f0ea00640 1 --2- 172.21.15.100:0/4073796580 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f10140580 0x7f3ef40039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.966+0000 7f3f0e000640 1 --2- 172.21.15.100:0/4073796580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ef4003f50 0x7f3ef4004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.966+0000 7f3f0f400640 1 -- 172.21.15.100:0/4073796580 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f10140580 msgr2=0x7f3ef40039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.966+0000 7f3f0f400640 1 --2- 172.21.15.100:0/4073796580 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f10140580 0x7f3ef40039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.966+0000 7f3f0f400640 1 -- 172.21.15.100:0/4073796580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ef4003f50 msgr2=0x7f3ef4004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:17.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.966+0000 7f3f0f400640 1 --2- 172.21.15.100:0/4073796580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ef4003f50 0x7f3ef4004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.966+0000 7f3f0f400640 1 -- 172.21.15.100:0/4073796580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef40034e0 con 0x7f3ef4004cc0 2024-08-17T02:46:17.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.967+0000 7f3f0f400640 1 --2- 172.21.15.100:0/4073796580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef4004cc0 0x7f3ef4005130 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800ab00 tx=0x7f3f0800a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43ef5f9d215d4f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:17.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.967+0000 7f3f0d600640 1 -- 172.21.15.100:0/4073796580 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0802b6a0 con 0x7f3ef4004cc0 2024-08-17T02:46:17.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.967+0000 7f3f0d600640 1 -- 172.21.15.100:0/4073796580 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0802b820 con 0x7f3ef4004cc0 2024-08-17T02:46:17.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.967+0000 7f3f0d600640 1 -- 172.21.15.100:0/4073796580 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0802bc60 con 0x7f3ef4004cc0 2024-08-17T02:46:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.967+0000 7f3f15a00640 1 -- 172.21.15.100:0/4073796580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef4004cc0 msgr2=0x7f3ef4005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.967+0000 7f3f15a00640 1 --2- 172.21.15.100:0/4073796580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef4004cc0 0x7f3ef4005130 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800ab00 tx=0x7f3f0800a1a0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.967+0000 7f3f0f400640 1 -- 172.21.15.100:0/4073796580 reap_dead start 2024-08-17T02:46:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.968+0000 7f3f15a00640 1 -- 172.21.15.100:0/4073796580 shutdown_connections 2024-08-17T02:46:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.968+0000 7f3f15a00640 1 -- 172.21.15.100:0/4073796580 >> 172.21.15.100:0/4073796580 conn(0x7f3f100cb9b0 msgr2=0x7f3f100cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.968+0000 7f3f15a00640 1 -- 172.21.15.100:0/4073796580 shutdown_connections 2024-08-17T02:46:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.968+0000 7f3f15a00640 1 -- 172.21.15.100:0/4073796580 wait complete. 2024-08-17T02:46:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.969+0000 7f3f15a00640 1 Processor -- start 2024-08-17T02:46:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.969+0000 7f3f15a00640 1 -- start start 2024-08-17T02:46:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.970+0000 7f3f15a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ef4004cc0 0x7f3f100c09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.970+0000 7f3f15a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f1015aab0 0x7f3f1013e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.970+0000 7f3f15a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f100c4ef0 0x7f3f100695a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.970+0000 7f3f15a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f100c11f0 con 0x7f3f100c4ef0 2024-08-17T02:46:17.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.970+0000 7f3f15a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f100c14d0 con 0x7f3ef4004cc0 2024-08-17T02:46:17.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.970+0000 7f3f15a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f100c17b0 con 0x7f3f1015aab0 2024-08-17T02:46:17.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.970+0000 7f3f0f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f100c4ef0 0x7f3f100695a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.970+0000 7f3f0f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f100c4ef0 0x7f3f100695a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32852/0 (socket says 172.21.15.100:32852) 2024-08-17T02:46:17.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.970+0000 7f3f0f400640 1 -- 172.21.15.100:0/530432115 learned_addr learned my addr 172.21.15.100:0/530432115 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:17.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.970+0000 7f3f0ea00640 1 --2- 172.21.15.100:0/530432115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ef4004cc0 0x7f3f100c09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.970+0000 7f3f0e000640 1 --2- 172.21.15.100:0/530432115 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f1015aab0 0x7f3f1013e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.971+0000 7f3f0f400640 1 -- 172.21.15.100:0/530432115 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f1015aab0 msgr2=0x7f3f1013e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.971+0000 7f3f0f400640 1 --2- 172.21.15.100:0/530432115 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f1015aab0 0x7f3f1013e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.971+0000 7f3f0f400640 1 -- 172.21.15.100:0/530432115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ef4004cc0 msgr2=0x7f3f100c09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.971+0000 7f3f0f400640 1 --2- 172.21.15.100:0/530432115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ef4004cc0 0x7f3f100c09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.971+0000 7f3f0f400640 1 -- 172.21.15.100:0/530432115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f100c1a90 con 0x7f3f100c4ef0 2024-08-17T02:46:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.971+0000 7f3f0f400640 1 --2- 172.21.15.100:0/530432115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f100c4ef0 0x7f3f100695a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800a0b0 tx=0x7f3f08031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.971+0000 7f3f06000640 1 -- 172.21.15.100:0/530432115 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0803c070 con 0x7f3f100c4ef0 2024-08-17T02:46:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.971+0000 7f3f06000640 1 -- 172.21.15.100:0/530432115 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f08007300 con 0x7f3f100c4ef0 2024-08-17T02:46:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.971+0000 7f3f06000640 1 -- 172.21.15.100:0/530432115 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f080076a0 con 0x7f3f100c4ef0 2024-08-17T02:46:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.971+0000 7f3f15a00640 1 -- 172.21.15.100:0/530432115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f100c1d70 con 0x7f3f100c4ef0 2024-08-17T02:46:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.971+0000 7f3f15a00640 1 -- 172.21.15.100:0/530432115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1013eba0 con 0x7f3f100c4ef0 2024-08-17T02:46:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.973+0000 7f3f15a00640 1 -- 172.21.15.100:0/530432115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f100c1f60 con 0x7f3f100c4ef0 2024-08-17T02:46:17.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.973+0000 7f3f06000640 1 -- 172.21.15.100:0/530432115 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3f08031070 con 0x7f3f100c4ef0 2024-08-17T02:46:17.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.974+0000 7f3f06000640 1 --2- 172.21.15.100:0/530432115 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3ef0065180 0x7f3ef0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.974+0000 7f3f06000640 1 -- 172.21.15.100:0/530432115 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f080a17e0 con 0x7f3f100c4ef0 2024-08-17T02:46:17.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.974+0000 7f3f0ea00640 1 --2- 172.21.15.100:0/530432115 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3ef0065180 0x7f3ef0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.975+0000 7f3f0ea00640 1 --2- 172.21.15.100:0/530432115 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3ef0065180 0x7f3ef0067630 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3f00006e70 tx=0x7f3f000090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:17.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:17.978+0000 7f3f06000640 1 -- 172.21.15.100:0/530432115 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3f0806f950 con 0x7f3f100c4ef0 2024-08-17T02:46:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.186+0000 7f3f15a00640 1 -- 172.21.15.100:0/530432115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f100b16d0 con 0x7f3f100c4ef0 2024-08-17T02:46:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.187+0000 7f3f06000640 1 -- 172.21.15.100:0/530432115 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f3f100b16d0 con 0x7f3f100c4ef0 2024-08-17T02:46:18.189 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:18.189 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3043714204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3043714204},{"type":"v1","addr":"172.21.15.100:6835","nonce":3043714204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/543049926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":543049926},{"type":"v1","addr":"172.21.15.100:6837","nonce":543049926}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2733092927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2733092927},{"type":"v1","addr":"172.21.15.123:6834","nonce":2733092927}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:45:41.237121+0000","modified":"2024-08-17T02:45:44.862501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/2872394530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2872394530},{"type":"v1","addr":"172.21.15.123:6835","nonce":2872394530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:46:18.189 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-08-17T02:46:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.189+0000 7f3f15a00640 1 -- 172.21.15.100:0/530432115 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3ef0065180 msgr2=0x7f3ef0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.189+0000 7f3f15a00640 1 --2- 172.21.15.100:0/530432115 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3ef0065180 0x7f3ef0067630 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3f00006e70 tx=0x7f3f000090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.189+0000 7f3f15a00640 1 -- 172.21.15.100:0/530432115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f100c4ef0 msgr2=0x7f3f100695a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.189+0000 7f3f15a00640 1 --2- 172.21.15.100:0/530432115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f100c4ef0 0x7f3f100695a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800a0b0 tx=0x7f3f08031000 comp rx=0 tx=0).stop 2024-08-17T02:46:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.189+0000 7f3f15a00640 1 -- 172.21.15.100:0/530432115 shutdown_connections 2024-08-17T02:46:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.189+0000 7f3f15a00640 1 --2- 172.21.15.100:0/530432115 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3ef0065180 0x7f3ef0067630 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.189+0000 7f3f15a00640 1 --2- 172.21.15.100:0/530432115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f100c4ef0 0x7f3f100695a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.189+0000 7f3f15a00640 1 --2- 172.21.15.100:0/530432115 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f1015aab0 0x7f3f1013e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.189+0000 7f3f15a00640 1 --2- 172.21.15.100:0/530432115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ef4004cc0 0x7f3f100c09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.189+0000 7f3f15a00640 1 -- 172.21.15.100:0/530432115 >> 172.21.15.100:0/530432115 conn(0x7f3f100cb9b0 msgr2=0x7f3f100aec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:18.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.189+0000 7f3f15a00640 1 -- 172.21.15.100:0/530432115 shutdown_connections 2024-08-17T02:46:18.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.189+0000 7f3f15a00640 1 -- 172.21.15.100:0/530432115 wait complete. 2024-08-17T02:46:18.205 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:46:18.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.351+0000 7f3eba400640 1 Processor -- start 2024-08-17T02:46:18.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.351+0000 7f3eba400640 1 -- start start 2024-08-17T02:46:18.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.352+0000 7f3eba400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3eb4159ca0 0x7f3eb40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.352+0000 7f3eba400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3eb40ca8a0 0x7f3eb40cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.352+0000 7f3eba400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3eb40ccad0 0x7f3eb40cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.352+0000 7f3eba400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb40cd6e0 con 0x7f3eb40ca8a0 2024-08-17T02:46:18.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.352+0000 7f3eba400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb40ccf70 con 0x7f3eb40ccad0 2024-08-17T02:46:18.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.352+0000 7f3eba400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40cadc0 con 0x7f3eb4159ca0 2024-08-17T02:46:18.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.352+0000 7f3eb3e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3eb40ca8a0 0x7f3eb40cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.352+0000 7f3eb3e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3eb40ca8a0 0x7f3eb40cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32866/0 (socket says 172.21.15.100:32866) 2024-08-17T02:46:18.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.352+0000 7f3eb3e00640 1 -- 172.21.15.100:0/1434754365 learned_addr learned my addr 172.21.15.100:0/1434754365 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:18.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.353+0000 7f3eb9000640 1 --2- 172.21.15.100:0/1434754365 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3eb4159ca0 0x7f3eb40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.353+0000 7f3eb9a00640 1 --2- 172.21.15.100:0/1434754365 >> v2:172.21.15.123:3300/0 conn(0x7f3eb40ccad0 0x7f3eb40cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.353+0000 7f3eb3e00640 1 -- 172.21.15.100:0/1434754365 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3eb4159ca0 msgr2=0x7f3eb40ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:18.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.353+0000 7f3eb3e00640 1 --2- 172.21.15.100:0/1434754365 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3eb4159ca0 0x7f3eb40ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.353+0000 7f3eb3e00640 1 -- 172.21.15.100:0/1434754365 >> v2:172.21.15.123:3300/0 conn(0x7f3eb40ccad0 msgr2=0x7f3eb40cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:18.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.353+0000 7f3eb3e00640 1 --2- 172.21.15.100:0/1434754365 >> v2:172.21.15.123:3300/0 conn(0x7f3eb40ccad0 0x7f3eb40cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.353+0000 7f3eb3e00640 1 -- 172.21.15.100:0/1434754365 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb40cb060 con 0x7f3eb40ca8a0 2024-08-17T02:46:18.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.354+0000 7f3eb3e00640 1 --2- 172.21.15.100:0/1434754365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3eb40ca8a0 0x7f3eb40cc590 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40b5c60 tx=0x7f3ea00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e57555bf5ed215e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:18.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.354+0000 7f3eb3400640 1 -- 172.21.15.100:0/1434754365 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea002add0 con 0x7f3eb40ca8a0 2024-08-17T02:46:18.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.354+0000 7f3eb3400640 1 -- 172.21.15.100:0/1434754365 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea0032440 con 0x7f3eb40ca8a0 2024-08-17T02:46:18.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.354+0000 7f3eb3400640 1 -- 172.21.15.100:0/1434754365 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0032820 con 0x7f3eb40ca8a0 2024-08-17T02:46:18.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.354+0000 7f3eba400640 1 -- 172.21.15.100:0/1434754365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3eb40ca8a0 msgr2=0x7f3eb40cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.355+0000 7f3eba400640 1 --2- 172.21.15.100:0/1434754365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3eb40ca8a0 0x7f3eb40cc590 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40b5c60 tx=0x7f3ea00091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.355+0000 7f3eba400640 1 -- 172.21.15.100:0/1434754365 shutdown_connections 2024-08-17T02:46:18.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.355+0000 7f3eba400640 1 --2- 172.21.15.100:0/1434754365 >> v2:172.21.15.123:3300/0 conn(0x7f3eb40ccad0 0x7f3eb40cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.355+0000 7f3eba400640 1 --2- 172.21.15.100:0/1434754365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3eb40ca8a0 0x7f3eb40cc590 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.355+0000 7f3eba400640 1 --2- 172.21.15.100:0/1434754365 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3eb4159ca0 0x7f3eb40ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.355+0000 7f3eba400640 1 -- 172.21.15.100:0/1434754365 >> 172.21.15.100:0/1434754365 conn(0x7f3eb4098e00 msgr2=0x7f3eb406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:18.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.355+0000 7f3eba400640 1 -- 172.21.15.100:0/1434754365 shutdown_connections 2024-08-17T02:46:18.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.355+0000 7f3eba400640 1 -- 172.21.15.100:0/1434754365 wait complete. 2024-08-17T02:46:18.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.356+0000 7f3eba400640 1 Processor -- start 2024-08-17T02:46:18.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.356+0000 7f3eba400640 1 -- start start 2024-08-17T02:46:18.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.357+0000 7f3eba400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3eb40ca8a0 0x7f3eb4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.357+0000 7f3eba400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3eb40ccad0 0x7f3eb4150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.357+0000 7f3eba400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3eb4159ca0 0x7f3eb4150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.357+0000 7f3eba400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40c8d80 con 0x7f3eb40ca8a0 2024-08-17T02:46:18.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.357+0000 7f3eba400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb4150dd0 con 0x7f3eb4159ca0 2024-08-17T02:46:18.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.357+0000 7f3eba400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb41510b0 con 0x7f3eb40ccad0 2024-08-17T02:46:18.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.357+0000 7f3eb9000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3eb40ca8a0 0x7f3eb4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.357+0000 7f3eb9000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3eb40ca8a0 0x7f3eb4068760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32868/0 (socket says 172.21.15.100:32868) 2024-08-17T02:46:18.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.357+0000 7f3eb9000640 1 -- 172.21.15.100:0/4181833668 learned_addr learned my addr 172.21.15.100:0/4181833668 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:18.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.357+0000 7f3eb3e00640 1 --2- 172.21.15.100:0/4181833668 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3eb40ccad0 0x7f3eb4150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.358+0000 7f3eb9a00640 1 --2- 172.21.15.100:0/4181833668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3eb4159ca0 0x7f3eb4150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.358+0000 7f3eb9000640 1 -- 172.21.15.100:0/4181833668 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3eb40ccad0 msgr2=0x7f3eb4150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.358+0000 7f3eb9000640 1 --2- 172.21.15.100:0/4181833668 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3eb40ccad0 0x7f3eb4150210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.358+0000 7f3eb9000640 1 -- 172.21.15.100:0/4181833668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3eb4159ca0 msgr2=0x7f3eb4150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.358+0000 7f3eb9000640 1 --2- 172.21.15.100:0/4181833668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3eb4159ca0 0x7f3eb4150750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.358+0000 7f3eb9000640 1 -- 172.21.15.100:0/4181833668 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea0009450 con 0x7f3eb40ca8a0 2024-08-17T02:46:18.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.358+0000 7f3eb9000640 1 --2- 172.21.15.100:0/4181833668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3eb40ca8a0 0x7f3eb4068760 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800d890 tx=0x7f3ea8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:18.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.358+0000 7f3ea7e00640 1 -- 172.21.15.100:0/4181833668 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea800de20 con 0x7f3eb40ca8a0 2024-08-17T02:46:18.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.358+0000 7f3ea7e00640 1 -- 172.21.15.100:0/4181833668 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea80098b0 con 0x7f3eb40ca8a0 2024-08-17T02:46:18.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.358+0000 7f3ea7e00640 1 -- 172.21.15.100:0/4181833668 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8009c50 con 0x7f3eb40ca8a0 2024-08-17T02:46:18.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.358+0000 7f3eba400640 1 -- 172.21.15.100:0/4181833668 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb4151390 con 0x7f3eb40ca8a0 2024-08-17T02:46:18.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.359+0000 7f3eba400640 1 -- 172.21.15.100:0/4181833668 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb4151950 con 0x7f3eb40ca8a0 2024-08-17T02:46:18.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.360+0000 7f3eba400640 1 -- 172.21.15.100:0/4181833668 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb40691e0 con 0x7f3eb40ca8a0 2024-08-17T02:46:18.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.360+0000 7f3ea7e00640 1 -- 172.21.15.100:0/4181833668 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3ea8014620 con 0x7f3eb40ca8a0 2024-08-17T02:46:18.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.361+0000 7f3ea7e00640 1 --2- 172.21.15.100:0/4181833668 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3e94065150 0x7f3e94067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.361+0000 7f3ea7e00640 1 -- 172.21.15.100:0/4181833668 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3ea8082be0 con 0x7f3eb40ca8a0 2024-08-17T02:46:18.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.361+0000 7f3eb3e00640 1 --2- 172.21.15.100:0/4181833668 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3e94065150 0x7f3e94067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.362+0000 7f3eb3e00640 1 --2- 172.21.15.100:0/4181833668 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3e94065150 0x7f3e94067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0034000 tx=0x7f3ea0032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:18.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.365+0000 7f3ea7e00640 1 -- 172.21.15.100:0/4181833668 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3eb40691e0 con 0x7f3eb40ca8a0 2024-08-17T02:46:18.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.572+0000 7f3eba400640 1 -- 172.21.15.100:0/4181833668 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3eb41566b0 con 0x7f3eb40ca8a0 2024-08-17T02:46:18.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.573+0000 7f3ea7e00640 1 -- 172.21.15.100:0/4181833668 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f3eb41566b0 con 0x7f3eb40ca8a0 2024-08-17T02:46:18.575 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:18.575 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3043714204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3043714204},{"type":"v1","addr":"172.21.15.100:6835","nonce":3043714204}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/543049926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":543049926},{"type":"v1","addr":"172.21.15.100:6837","nonce":543049926}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2733092927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2733092927},{"type":"v1","addr":"172.21.15.123:6834","nonce":2733092927}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:45:41.237121+0000","modified":"2024-08-17T02:45:44.862501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/2872394530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2872394530},{"type":"v1","addr":"172.21.15.123:6835","nonce":2872394530}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:46:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-08-17T02:46:18.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.575+0000 7f3eba400640 1 -- 172.21.15.100:0/4181833668 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3e94065150 msgr2=0x7f3e94067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.575+0000 7f3eba400640 1 --2- 172.21.15.100:0/4181833668 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3e94065150 0x7f3e94067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0034000 tx=0x7f3ea0032000 comp rx=0 tx=0).stop 2024-08-17T02:46:18.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.575+0000 7f3eba400640 1 -- 172.21.15.100:0/4181833668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3eb40ca8a0 msgr2=0x7f3eb4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.575+0000 7f3eba400640 1 --2- 172.21.15.100:0/4181833668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3eb40ca8a0 0x7f3eb4068760 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800d890 tx=0x7f3ea8008040 comp rx=0 tx=0).stop 2024-08-17T02:46:18.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.575+0000 7f3eba400640 1 -- 172.21.15.100:0/4181833668 shutdown_connections 2024-08-17T02:46:18.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.575+0000 7f3eba400640 1 --2- 172.21.15.100:0/4181833668 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3e94065150 0x7f3e94067600 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.575+0000 7f3eba400640 1 --2- 172.21.15.100:0/4181833668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3eb4159ca0 0x7f3eb4150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.575+0000 7f3eba400640 1 --2- 172.21.15.100:0/4181833668 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3eb40ccad0 0x7f3eb4150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.575+0000 7f3eba400640 1 --2- 172.21.15.100:0/4181833668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3eb40ca8a0 0x7f3eb4068760 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.575+0000 7f3eba400640 1 -- 172.21.15.100:0/4181833668 >> 172.21.15.100:0/4181833668 conn(0x7f3eb4098e00 msgr2=0x7f3eb4158540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:18.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.575+0000 7f3eba400640 1 -- 172.21.15.100:0/4181833668 shutdown_connections 2024-08-17T02:46:18.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.575+0000 7f3eba400640 1 -- 172.21.15.100:0/4181833668 wait complete. 2024-08-17T02:46:18.592 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:18.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.739+0000 7f9003a00640 1 Processor -- start 2024-08-17T02:46:18.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.739+0000 7f9003a00640 1 -- start start 2024-08-17T02:46:18.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.740+0000 7f9003a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8ffc158cb0 0x7f8ffc0af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.740+0000 7f9003a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ffc0abc80 con 0x7f8ffc0ac820 2024-08-17T02:46:18.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.740+0000 7f9003a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ffc0ab070 con 0x7f8ffc0aa910 2024-08-17T02:46:18.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.740+0000 7f9003a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ffc0ab350 con 0x7f8ffc158cb0 2024-08-17T02:46:18.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.740+0000 7f9001a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f8ffc0ac820 0x7f8ffc159080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49490/0 (socket says 172.21.15.100:49490) 2024-08-17T02:46:18.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.740+0000 7f9001a00640 1 -- 172.21.15.100:0/2718272540 learned_addr learned my addr 172.21.15.100:0/2718272540 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:18.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.741+0000 7f9001000640 1 --2- 172.21.15.100:0/2718272540 >> v2:172.21.15.123:3300/0 conn(0x7f8ffc158cb0 0x7f8ffc0af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.741+0000 7f8ffb400640 1 -- 172.21.15.100:0/2718272540 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527889374 0 0) 0x7f8ffc0abc80 con 0x7f8ffc0ac820 2024-08-17T02:46:18.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.741+0000 7f8ffb400640 1 -- 172.21.15.100:0/2718272540 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fe40034e0 con 0x7f8ffc0ac820 2024-08-17T02:46:18.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.741+0000 7f9001000640 1 -- 172.21.15.100:0/2718272540 >> v1:172.21.15.123:6789/0 conn(0x7f8ffc0aa910 legacy=0x7f8ffc0ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.741+0000 7f9001000640 1 -- 172.21.15.100:0/2718272540 >> v1:172.21.15.100:6789/0 conn(0x7f8ffc0ac820 legacy=0x7f8ffc159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.741+0000 7f9001000640 1 -- 172.21.15.100:0/2718272540 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc0ab630 con 0x7f8ffc158cb0 2024-08-17T02:46:18.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.742+0000 7f9001000640 1 --2- 172.21.15.100:0/2718272540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ffc158cb0 0x7f8ffc0af6d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009850 tx=0x7f8ff00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bb15e5ac48f3bf5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:18.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.742+0000 7f8ffb400640 1 -- 172.21.15.100:0/2718272540 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff002ae20 con 0x7f8ffc158cb0 2024-08-17T02:46:18.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.743+0000 7f8ffb400640 1 -- 172.21.15.100:0/2718272540 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff0032440 con 0x7f8ffc158cb0 2024-08-17T02:46:18.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.743+0000 7f8ffb400640 1 -- 172.21.15.100:0/2718272540 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff00327e0 con 0x7f8ffc158cb0 2024-08-17T02:46:18.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.743+0000 7f9003a00640 1 -- 172.21.15.100:0/2718272540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ffc158cb0 msgr2=0x7f8ffc0af6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.743+0000 7f9003a00640 1 --2- 172.21.15.100:0/2718272540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ffc158cb0 0x7f8ffc0af6d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009850 tx=0x7f8ff00090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.743+0000 7f9003a00640 1 -- 172.21.15.100:0/2718272540 shutdown_connections 2024-08-17T02:46:18.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.743+0000 7f9003a00640 1 --2- 172.21.15.100:0/2718272540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ffc158cb0 0x7f8ffc0af6d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.743+0000 7f9003a00640 1 -- 172.21.15.100:0/2718272540 >> 172.21.15.100:0/2718272540 conn(0x7f8ffc096a70 msgr2=0x7f8ffc096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:18.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.743+0000 7f9003a00640 1 -- 172.21.15.100:0/2718272540 shutdown_connections 2024-08-17T02:46:18.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.743+0000 7f9003a00640 1 -- 172.21.15.100:0/2718272540 wait complete. 2024-08-17T02:46:18.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.745+0000 7f9003a00640 1 Processor -- start 2024-08-17T02:46:18.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.745+0000 7f9003a00640 1 -- start start 2024-08-17T02:46:18.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.745+0000 7f9003a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ffc0aa910 0x7f8ffc0c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.745+0000 7f9003a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8ffc0ac820 0x7f8ffc168e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.745+0000 7f9003a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ffc158cb0 0x7f8ffc154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.745+0000 7f9003a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc0c9a80 con 0x7f8ffc0aa910 2024-08-17T02:46:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.745+0000 7f9003a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc0c76e0 con 0x7f8ffc158cb0 2024-08-17T02:46:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.745+0000 7f9003a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc09a200 con 0x7f8ffc0ac820 2024-08-17T02:46:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.746+0000 7f9001000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ffc0aa910 0x7f8ffc0c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.746+0000 7f9001000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ffc0aa910 0x7f8ffc0c9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32878/0 (socket says 172.21.15.100:32878) 2024-08-17T02:46:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.746+0000 7f9001000640 1 -- 172.21.15.100:0/2290358998 learned_addr learned my addr 172.21.15.100:0/2290358998 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.746+0000 7f9001a00640 1 --2- 172.21.15.100:0/2290358998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ffc158cb0 0x7f8ffc154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.746+0000 7f8ffbe00640 1 --2- 172.21.15.100:0/2290358998 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8ffc0ac820 0x7f8ffc168e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.746+0000 7f9001000640 1 -- 172.21.15.100:0/2290358998 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8ffc0ac820 msgr2=0x7f8ffc168e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.746+0000 7f9001000640 1 --2- 172.21.15.100:0/2290358998 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8ffc0ac820 0x7f8ffc168e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.746+0000 7f9001000640 1 -- 172.21.15.100:0/2290358998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ffc158cb0 msgr2=0x7f8ffc154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.746+0000 7f9001000640 1 --2- 172.21.15.100:0/2290358998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ffc158cb0 0x7f8ffc154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.746+0000 7f9001000640 1 -- 172.21.15.100:0/2290358998 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff0009390 con 0x7f8ffc0aa910 2024-08-17T02:46:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.747+0000 7f9001000640 1 --2- 172.21.15.100:0/2290358998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ffc0aa910 0x7f8ffc0c9540 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009360 tx=0x7f8ff0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.747+0000 7f8fefe00640 1 -- 172.21.15.100:0/2290358998 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0000d10 con 0x7f8ffc0aa910 2024-08-17T02:46:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.747+0000 7f8fefe00640 1 -- 172.21.15.100:0/2290358998 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff0031e00 con 0x7f8ffc0aa910 2024-08-17T02:46:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.747+0000 7f8fefe00640 1 -- 172.21.15.100:0/2290358998 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff003d670 con 0x7f8ffc0aa910 2024-08-17T02:46:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.747+0000 7f9003a00640 1 -- 172.21.15.100:0/2290358998 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ffc0c6db0 con 0x7f8ffc0aa910 2024-08-17T02:46:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.747+0000 7f9003a00640 1 -- 172.21.15.100:0/2290358998 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ffc0c7370 con 0x7f8ffc0aa910 2024-08-17T02:46:18.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.748+0000 7f9003a00640 1 -- 172.21.15.100:0/2290358998 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ffc064db0 con 0x7f8ffc0aa910 2024-08-17T02:46:18.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.749+0000 7f8fefe00640 1 -- 172.21.15.100:0/2290358998 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8ff0039040 con 0x7f8ffc0aa910 2024-08-17T02:46:18.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.750+0000 7f8fefe00640 1 --2- 172.21.15.100:0/2290358998 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8fdc065150 0x7f8fdc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.750+0000 7f8fefe00640 1 -- 172.21.15.100:0/2290358998 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ff00a24c0 con 0x7f8ffc0aa910 2024-08-17T02:46:18.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.750+0000 7f8ffbe00640 1 --2- 172.21.15.100:0/2290358998 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8fdc065150 0x7f8fdc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.751+0000 7f8ffbe00640 1 --2- 172.21.15.100:0/2290358998 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8fdc065150 0x7f8fdc067600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc09b970 tx=0x7f8fe8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:18.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.754+0000 7f8fefe00640 1 -- 172.21.15.100:0/2290358998 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8ff00704e0 con 0x7f8ffc0aa910 2024-08-17T02:46:18.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.928+0000 7f9003a00640 1 -- 172.21.15.100:0/2290358998 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ffc06c740 con 0x7f8ffc0aa910 2024-08-17T02:46:18.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.929+0000 7f8fefe00640 1 -- 172.21.15.100:0/2290358998 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f8ff0073b00 con 0x7f8ffc0aa910 2024-08-17T02:46:18.930 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:18.930 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:45:42.845503+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:45:39.036964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:45:40.232954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:18.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.931+0000 7f9003a00640 1 -- 172.21.15.100:0/2290358998 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8fdc065150 msgr2=0x7f8fdc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.931+0000 7f9003a00640 1 --2- 172.21.15.100:0/2290358998 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8fdc065150 0x7f8fdc067600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc09b970 tx=0x7f8fe8009040 comp rx=0 tx=0).stop 2024-08-17T02:46:18.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.931+0000 7f9003a00640 1 -- 172.21.15.100:0/2290358998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ffc0aa910 msgr2=0x7f8ffc0c9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.931+0000 7f9003a00640 1 --2- 172.21.15.100:0/2290358998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ffc0aa910 0x7f8ffc0c9540 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009360 tx=0x7f8ff0032000 comp rx=0 tx=0).stop 2024-08-17T02:46:18.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.931+0000 7f9003a00640 1 -- 172.21.15.100:0/2290358998 shutdown_connections 2024-08-17T02:46:18.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.931+0000 7f9003a00640 1 --2- 172.21.15.100:0/2290358998 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8fdc065150 0x7f8fdc067600 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.931+0000 7f9003a00640 1 --2- 172.21.15.100:0/2290358998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ffc158cb0 0x7f8ffc154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.931+0000 7f9003a00640 1 --2- 172.21.15.100:0/2290358998 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8ffc0ac820 0x7f8ffc168e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.931+0000 7f9003a00640 1 --2- 172.21.15.100:0/2290358998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ffc0aa910 0x7f8ffc0c9540 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.931+0000 7f9003a00640 1 -- 172.21.15.100:0/2290358998 >> 172.21.15.100:0/2290358998 conn(0x7f8ffc096a70 msgr2=0x7f8ffc06bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:18.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.931+0000 7f9003a00640 1 -- 172.21.15.100:0/2290358998 shutdown_connections 2024-08-17T02:46:18.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:18.931+0000 7f9003a00640 1 -- 172.21.15.100:0/2290358998 wait complete. 2024-08-17T02:46:18.948 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:46:19.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.096+0000 7ff80be00640 1 Processor -- start 2024-08-17T02:46:19.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.096+0000 7ff80be00640 1 -- start start 2024-08-17T02:46:19.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.096+0000 7ff80be00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff804155a20 0x7ff8040adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.096+0000 7ff80be00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff804156670 con 0x7ff80406df00 2024-08-17T02:46:19.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.096+0000 7ff80be00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff80406e5e0 con 0x7ff804155df0 2024-08-17T02:46:19.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.096+0000 7ff80be00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8040b0350 con 0x7ff804155a20 2024-08-17T02:46:19.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.097+0000 7ff809e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff80406df00 0x7ff804156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49498/0 (socket says 172.21.15.100:49498) 2024-08-17T02:46:19.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.097+0000 7ff809e00640 1 -- 172.21.15.100:0/3152581313 learned_addr learned my addr 172.21.15.100:0/3152581313 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:19.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.097+0000 7ff809400640 1 --2- 172.21.15.100:0/3152581313 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff804155a20 0x7ff8040adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.097+0000 7ff803e00640 1 -- 172.21.15.100:0/3152581313 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3532489561 0 0) 0x7ff804156670 con 0x7ff80406df00 2024-08-17T02:46:19.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.097+0000 7ff803e00640 1 -- 172.21.15.100:0/3152581313 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7ec0034e0 con 0x7ff80406df00 2024-08-17T02:46:19.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.097+0000 7ff803e00640 1 -- 172.21.15.100:0/3152581313 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751111253 0 0) 0x7ff80406e5e0 con 0x7ff804155df0 2024-08-17T02:46:19.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.097+0000 7ff803e00640 1 -- 172.21.15.100:0/3152581313 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff804156670 con 0x7ff804155df0 2024-08-17T02:46:19.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.097+0000 7ff809400640 1 -- 172.21.15.100:0/3152581313 >> v1:172.21.15.123:6789/0 conn(0x7ff804155df0 legacy=0x7ff80406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.097+0000 7ff809400640 1 -- 172.21.15.100:0/3152581313 >> v1:172.21.15.100:6789/0 conn(0x7ff80406df00 legacy=0x7ff804156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.097+0000 7ff809400640 1 -- 172.21.15.100:0/3152581313 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80406e8c0 con 0x7ff804155a20 2024-08-17T02:46:19.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.098+0000 7ff809400640 1 --2- 172.21.15.100:0/3152581313 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff804155a20 0x7ff8040adf10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8009880 tx=0x7ff7f80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25d0a92734e0845c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.099+0000 7ff803e00640 1 -- 172.21.15.100:0/3152581313 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f802ae10 con 0x7ff804155a20 2024-08-17T02:46:19.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.099+0000 7ff803e00640 1 -- 172.21.15.100:0/3152581313 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f8032440 con 0x7ff804155a20 2024-08-17T02:46:19.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.099+0000 7ff803e00640 1 -- 172.21.15.100:0/3152581313 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f80327e0 con 0x7ff804155a20 2024-08-17T02:46:19.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.099+0000 7ff80be00640 1 -- 172.21.15.100:0/3152581313 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff804155a20 msgr2=0x7ff8040adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.099+0000 7ff80be00640 1 --2- 172.21.15.100:0/3152581313 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff804155a20 0x7ff8040adf10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8009880 tx=0x7ff7f80090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.099+0000 7ff80be00640 1 -- 172.21.15.100:0/3152581313 shutdown_connections 2024-08-17T02:46:19.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.099+0000 7ff80be00640 1 --2- 172.21.15.100:0/3152581313 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff804155a20 0x7ff8040adf10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.099+0000 7ff80be00640 1 -- 172.21.15.100:0/3152581313 >> 172.21.15.100:0/3152581313 conn(0x7ff8040cb9b0 msgr2=0x7ff8040cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:19.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.099+0000 7ff80be00640 1 -- 172.21.15.100:0/3152581313 shutdown_connections 2024-08-17T02:46:19.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.099+0000 7ff80be00640 1 -- 172.21.15.100:0/3152581313 wait complete. 2024-08-17T02:46:19.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.101+0000 7ff80be00640 1 Processor -- start 2024-08-17T02:46:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.101+0000 7ff80be00640 1 -- start start 2024-08-17T02:46:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.102+0000 7ff80be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff80406df00 0x7ff80414f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.102+0000 7ff80be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff804155a20 0x7ff804169320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.102+0000 7ff80be00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff804155df0 0x7ff8040c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.102+0000 7ff80be00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8040acfb0 con 0x7ff80406df00 2024-08-17T02:46:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.102+0000 7ff80be00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8040c1f50 con 0x7ff804155a20 2024-08-17T02:46:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.102+0000 7ff80be00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8040aa9e0 con 0x7ff804155df0 2024-08-17T02:46:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.102+0000 7ff809400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff80406df00 0x7ff80414f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.102+0000 7ff809400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff80406df00 0x7ff80414f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32894/0 (socket says 172.21.15.100:32894) 2024-08-17T02:46:19.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.102+0000 7ff809400640 1 -- 172.21.15.100:0/904790826 learned_addr learned my addr 172.21.15.100:0/904790826 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:19.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.102+0000 7ff808a00640 1 --2- 172.21.15.100:0/904790826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff804155a20 0x7ff804169320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.102+0000 7ff809e00640 1 --2- 172.21.15.100:0/904790826 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff804155df0 0x7ff8040c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.102+0000 7ff809400640 1 -- 172.21.15.100:0/904790826 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff804155df0 msgr2=0x7ff8040c2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.102+0000 7ff809400640 1 --2- 172.21.15.100:0/904790826 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff804155df0 0x7ff8040c2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.102+0000 7ff809400640 1 -- 172.21.15.100:0/904790826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff804155a20 msgr2=0x7ff804169320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.102+0000 7ff809400640 1 --2- 172.21.15.100:0/904790826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff804155a20 0x7ff804169320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.102+0000 7ff809400640 1 -- 172.21.15.100:0/904790826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f8009390 con 0x7ff80406df00 2024-08-17T02:46:19.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.102+0000 7ff808a00640 1 --2- 172.21.15.100:0/904790826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff804155a20 0x7ff804169320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:19.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.102+0000 7ff809e00640 1 --2- 172.21.15.100:0/904790826 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff804155df0 0x7ff8040c2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:19.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.103+0000 7ff809400640 1 --2- 172.21.15.100:0/904790826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff80406df00 0x7ff80414f700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8009880 tx=0x7ff7f8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.103+0000 7ff800c00640 1 -- 172.21.15.100:0/904790826 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8000c40 con 0x7ff80406df00 2024-08-17T02:46:19.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.103+0000 7ff800c00640 1 -- 172.21.15.100:0/904790826 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f8031a60 con 0x7ff80406df00 2024-08-17T02:46:19.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.103+0000 7ff80be00640 1 -- 172.21.15.100:0/904790826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8040aacc0 con 0x7ff80406df00 2024-08-17T02:46:19.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.103+0000 7ff800c00640 1 -- 172.21.15.100:0/904790826 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8031e20 con 0x7ff80406df00 2024-08-17T02:46:19.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.103+0000 7ff80be00640 1 -- 172.21.15.100:0/904790826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8040ab280 con 0x7ff80406df00 2024-08-17T02:46:19.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.104+0000 7ff80be00640 1 -- 172.21.15.100:0/904790826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff804064db0 con 0x7ff80406df00 2024-08-17T02:46:19.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.105+0000 7ff800c00640 1 -- 172.21.15.100:0/904790826 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff7f8039040 con 0x7ff80406df00 2024-08-17T02:46:19.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.106+0000 7ff800c00640 1 --2- 172.21.15.100:0/904790826 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff7e4065150 0x7ff7e4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.106+0000 7ff800c00640 1 -- 172.21.15.100:0/904790826 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff7f80a1f50 con 0x7ff80406df00 2024-08-17T02:46:19.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.106+0000 7ff808a00640 1 --2- 172.21.15.100:0/904790826 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff7e4065150 0x7ff7e4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.107+0000 7ff808a00640 1 --2- 172.21.15.100:0/904790826 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff7e4065150 0x7ff7e4067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff8041579c0 tx=0x7ff7f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.110+0000 7ff800c00640 1 -- 172.21.15.100:0/904790826 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff7f806ff70 con 0x7ff80406df00 2024-08-17T02:46:19.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.320+0000 7ff80be00640 1 -- 172.21.15.100:0/904790826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff804152cd0 con 0x7ff80406df00 2024-08-17T02:46:19.322 INFO:tasks.ceph.mon.a.smithi100.stderr:2024-08-17T02:46:19.321+0000 7f3a9f600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:46:19.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.325+0000 7ff800c00640 1 -- 172.21.15.100:0/904790826 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff7f8073590 con 0x7ff80406df00 2024-08-17T02:46:19.327 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:46:19.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.327+0000 7ff80be00640 1 -- 172.21.15.100:0/904790826 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff7e4065150 msgr2=0x7ff7e4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.327+0000 7ff80be00640 1 --2- 172.21.15.100:0/904790826 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff7e4065150 0x7ff7e4067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff8041579c0 tx=0x7ff7f0009040 comp rx=0 tx=0).stop 2024-08-17T02:46:19.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.327+0000 7ff80be00640 1 -- 172.21.15.100:0/904790826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff80406df00 msgr2=0x7ff80414f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.327+0000 7ff80be00640 1 --2- 172.21.15.100:0/904790826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff80406df00 0x7ff80414f700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8009880 tx=0x7ff7f8032000 comp rx=0 tx=0).stop 2024-08-17T02:46:19.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.327+0000 7ff80be00640 1 -- 172.21.15.100:0/904790826 shutdown_connections 2024-08-17T02:46:19.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.327+0000 7ff80be00640 1 --2- 172.21.15.100:0/904790826 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff7e4065150 0x7ff7e4067600 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.327+0000 7ff80be00640 1 --2- 172.21.15.100:0/904790826 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff804155df0 0x7ff8040c2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.327+0000 7ff80be00640 1 --2- 172.21.15.100:0/904790826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff804155a20 0x7ff804169320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.327+0000 7ff80be00640 1 --2- 172.21.15.100:0/904790826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff80406df00 0x7ff80414f700 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.327+0000 7ff80be00640 1 -- 172.21.15.100:0/904790826 >> 172.21.15.100:0/904790826 conn(0x7ff8040cb9b0 msgr2=0x7ff8040adcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:19.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.328+0000 7ff80be00640 1 -- 172.21.15.100:0/904790826 shutdown_connections 2024-08-17T02:46:19.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.328+0000 7ff80be00640 1 -- 172.21.15.100:0/904790826 wait complete. 2024-08-17T02:46:19.333 INFO:tasks.ceph.mds.b.smithi123.stderr: -1927> 2024-08-17T02:45:45.358+0000 7f958d200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:46:19.345 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:46:19.374 INFO:tasks.ceph.mds.b.smithi123.stdout:starting mds.b at 2024-08-17T02:46:19.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.494+0000 7fd6e9e00640 1 Processor -- start 2024-08-17T02:46:19.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.494+0000 7fd6e9e00640 1 -- start start 2024-08-17T02:46:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.494+0000 7fd6e9e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6e40af2e0 0x7fd6e40b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.494+0000 7fd6e9e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6e40af6b0 0x7fd6e406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.494+0000 7fd6e9e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e4156770 con 0x7fd6e406dcf0 2024-08-17T02:46:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.494+0000 7fd6e9e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e406e110 con 0x7fd6e40af6b0 2024-08-17T02:46:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.494+0000 7fd6e9e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e4155b60 con 0x7fd6e40af2e0 2024-08-17T02:46:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.494+0000 7fd6e3400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd6e406dcf0 0x7fd6e4158d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49506/0 (socket says 172.21.15.100:49506) 2024-08-17T02:46:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.494+0000 7fd6e3400640 1 -- 172.21.15.100:0/2373748023 learned_addr learned my addr 172.21.15.100:0/2373748023 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.494+0000 7fd6dbe00640 1 --2- 172.21.15.100:0/2373748023 >> v2:172.21.15.100:3300/0 conn(0x7fd6e40af6b0 0x7fd6e406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.494+0000 7fd6e2a00640 1 --2- 172.21.15.100:0/2373748023 >> v2:172.21.15.123:3300/0 conn(0x7fd6e40af2e0 0x7fd6e40b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.495+0000 7fd6e2000640 1 -- 172.21.15.100:0/2373748023 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573206759 0 0) 0x7fd6e4156770 con 0x7fd6e406dcf0 2024-08-17T02:46:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.495+0000 7fd6e2000640 1 -- 172.21.15.100:0/2373748023 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6c80034e0 con 0x7fd6e406dcf0 2024-08-17T02:46:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.495+0000 7fd6e2a00640 1 -- 172.21.15.100:0/2373748023 >> v2:172.21.15.100:3300/0 conn(0x7fd6e40af6b0 msgr2=0x7fd6e406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:19.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.495+0000 7fd6e2a00640 1 --2- 172.21.15.100:0/2373748023 >> v2:172.21.15.100:3300/0 conn(0x7fd6e40af6b0 0x7fd6e406d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.495+0000 7fd6e2a00640 1 -- 172.21.15.100:0/2373748023 >> v1:172.21.15.100:6789/0 conn(0x7fd6e406dcf0 legacy=0x7fd6e4158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.495+0000 7fd6e2a00640 1 -- 172.21.15.100:0/2373748023 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e4155e40 con 0x7fd6e40af2e0 2024-08-17T02:46:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.495+0000 7fd6dbe00640 1 --2- 172.21.15.100:0/2373748023 >> v2:172.21.15.100:3300/0 conn(0x7fd6e40af6b0 0x7fd6e406d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:19.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.496+0000 7fd6e2a00640 1 --2- 172.21.15.100:0/2373748023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6e40af2e0 0x7fd6e40b1240 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4070c10 tx=0x7fd6d40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6422be5ab975049e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.496+0000 7fd6e2000640 1 -- 172.21.15.100:0/2373748023 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d402ad20 con 0x7fd6e40af2e0 2024-08-17T02:46:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.496+0000 7fd6e2000640 1 -- 172.21.15.100:0/2373748023 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d402ae80 con 0x7fd6e40af2e0 2024-08-17T02:46:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.496+0000 7fd6e2000640 1 -- 172.21.15.100:0/2373748023 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4032670 con 0x7fd6e40af2e0 2024-08-17T02:46:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.497+0000 7fd6e9e00640 1 -- 172.21.15.100:0/2373748023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6e40af2e0 msgr2=0x7fd6e40b1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.497+0000 7fd6e9e00640 1 --2- 172.21.15.100:0/2373748023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6e40af2e0 0x7fd6e40b1240 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4070c10 tx=0x7fd6d40090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.497+0000 7fd6e9e00640 1 -- 172.21.15.100:0/2373748023 shutdown_connections 2024-08-17T02:46:19.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.497+0000 7fd6e9e00640 1 --2- 172.21.15.100:0/2373748023 >> v2:172.21.15.100:3300/0 conn(0x7fd6e40af6b0 0x7fd6e406d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.497+0000 7fd6e9e00640 1 --2- 172.21.15.100:0/2373748023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6e40af2e0 0x7fd6e40b1240 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.497+0000 7fd6e9e00640 1 -- 172.21.15.100:0/2373748023 >> 172.21.15.100:0/2373748023 conn(0x7fd6e4067750 msgr2=0x7fd6e40cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:19.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.497+0000 7fd6e9e00640 1 -- 172.21.15.100:0/2373748023 shutdown_connections 2024-08-17T02:46:19.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.497+0000 7fd6e9e00640 1 -- 172.21.15.100:0/2373748023 wait complete. 2024-08-17T02:46:19.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.498+0000 7fd6e9e00640 1 Processor -- start 2024-08-17T02:46:19.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.498+0000 7fd6e9e00640 1 -- start start 2024-08-17T02:46:19.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.499+0000 7fd6e9e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6e406dcf0 0x7fd6e4154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.499+0000 7fd6e9e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6e40af2e0 0x7fd6e41658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.499+0000 7fd6e9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6e40af6b0 0x7fd6e4165f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.499+0000 7fd6e9e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e4165de0 con 0x7fd6e40af6b0 2024-08-17T02:46:19.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.499+0000 7fd6e9e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e4152600 con 0x7fd6e40af2e0 2024-08-17T02:46:19.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.499+0000 7fd6e9e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e4155120 con 0x7fd6e406dcf0 2024-08-17T02:46:19.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.499+0000 7fd6e3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6e40af6b0 0x7fd6e4165f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.499+0000 7fd6e3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6e40af6b0 0x7fd6e4165f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32922/0 (socket says 172.21.15.100:32922) 2024-08-17T02:46:19.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.499+0000 7fd6e3400640 1 -- 172.21.15.100:0/2614620397 learned_addr learned my addr 172.21.15.100:0/2614620397 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:19.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.500+0000 7fd6dbe00640 1 --2- 172.21.15.100:0/2614620397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6e40af2e0 0x7fd6e41658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.500+0000 7fd6e2a00640 1 --2- 172.21.15.100:0/2614620397 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6e406dcf0 0x7fd6e4154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.500+0000 7fd6e3400640 1 -- 172.21.15.100:0/2614620397 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6e406dcf0 msgr2=0x7fd6e4154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.500+0000 7fd6e3400640 1 --2- 172.21.15.100:0/2614620397 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6e406dcf0 0x7fd6e4154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.500+0000 7fd6e3400640 1 -- 172.21.15.100:0/2614620397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6e40af2e0 msgr2=0x7fd6e41658a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.500+0000 7fd6e3400640 1 --2- 172.21.15.100:0/2614620397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6e40af2e0 0x7fd6e41658a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.500+0000 7fd6e3400640 1 -- 172.21.15.100:0/2614620397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc00a530 con 0x7fd6e40af6b0 2024-08-17T02:46:19.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.500+0000 7fd6e3400640 1 --2- 172.21.15.100:0/2614620397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6e40af6b0 0x7fd6e4165f40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc001460 tx=0x7fd6dc001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.500+0000 7fd6da000640 1 -- 172.21.15.100:0/2614620397 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc00ce90 con 0x7fd6e40af6b0 2024-08-17T02:46:19.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.500+0000 7fd6da000640 1 -- 172.21.15.100:0/2614620397 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc00a850 con 0x7fd6e40af6b0 2024-08-17T02:46:19.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.500+0000 7fd6e9e00640 1 -- 172.21.15.100:0/2614620397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d4009390 con 0x7fd6e40af6b0 2024-08-17T02:46:19.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.500+0000 7fd6da000640 1 -- 172.21.15.100:0/2614620397 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc00ac10 con 0x7fd6e40af6b0 2024-08-17T02:46:19.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.501+0000 7fd6e9e00640 1 -- 172.21.15.100:0/2614620397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e4151fb0 con 0x7fd6e40af6b0 2024-08-17T02:46:19.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.501+0000 7fd6e9e00640 1 -- 172.21.15.100:0/2614620397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e4071050 con 0x7fd6e40af6b0 2024-08-17T02:46:19.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.502+0000 7fd6da000640 1 -- 172.21.15.100:0/2614620397 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd6dc007300 con 0x7fd6e40af6b0 2024-08-17T02:46:19.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.503+0000 7fd6da000640 1 --2- 172.21.15.100:0/2614620397 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd6c0065150 0x7fd6c0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.503+0000 7fd6da000640 1 -- 172.21.15.100:0/2614620397 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fd6dc082630 con 0x7fd6e40af6b0 2024-08-17T02:46:19.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.503+0000 7fd6e2a00640 1 --2- 172.21.15.100:0/2614620397 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd6c0065150 0x7fd6c0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.504+0000 7fd6e2a00640 1 --2- 172.21.15.100:0/2614620397 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd6c0065150 0x7fd6c0067600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4034000 tx=0x7fd6d4032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.507+0000 7fd6da000640 1 -- 172.21.15.100:0/2614620397 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd6dc050620 con 0x7fd6e40af6b0 2024-08-17T02:46:19.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:19.719+0000 7fd6e9e00640 1 -- 172.21.15.100:0/2614620397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd6e40640d0 con 0x7fd6e40af6b0 2024-08-17T02:46:20.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.327+0000 7fd6da000640 1 -- 172.21.15.100:0/2614620397 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd6dc053c40 con 0x7fd6e40af6b0 2024-08-17T02:46:20.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.330+0000 7fd6e9e00640 1 -- 172.21.15.100:0/2614620397 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd6c0065150 msgr2=0x7fd6c0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.330+0000 7fd6e9e00640 1 --2- 172.21.15.100:0/2614620397 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd6c0065150 0x7fd6c0067600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4034000 tx=0x7fd6d4032000 comp rx=0 tx=0).stop 2024-08-17T02:46:20.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.330+0000 7fd6e9e00640 1 -- 172.21.15.100:0/2614620397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6e40af6b0 msgr2=0x7fd6e4165f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.330+0000 7fd6e9e00640 1 --2- 172.21.15.100:0/2614620397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6e40af6b0 0x7fd6e4165f40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc001460 tx=0x7fd6dc001ae0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.330+0000 7fd6e9e00640 1 -- 172.21.15.100:0/2614620397 shutdown_connections 2024-08-17T02:46:20.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.330+0000 7fd6e9e00640 1 --2- 172.21.15.100:0/2614620397 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd6c0065150 0x7fd6c0067600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.330+0000 7fd6e9e00640 1 --2- 172.21.15.100:0/2614620397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6e40af6b0 0x7fd6e4165f40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.330+0000 7fd6e9e00640 1 --2- 172.21.15.100:0/2614620397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6e40af2e0 0x7fd6e41658a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.330+0000 7fd6e9e00640 1 --2- 172.21.15.100:0/2614620397 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6e406dcf0 0x7fd6e4154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.330+0000 7fd6e9e00640 1 -- 172.21.15.100:0/2614620397 >> 172.21.15.100:0/2614620397 conn(0x7fd6e4067750 msgr2=0x7fd6e4150210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.330+0000 7fd6e9e00640 1 -- 172.21.15.100:0/2614620397 shutdown_connections 2024-08-17T02:46:20.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.330+0000 7fd6e9e00640 1 -- 172.21.15.100:0/2614620397 wait complete. 2024-08-17T02:46:20.347 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:46:20.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.497+0000 7f102b200640 1 Processor -- start 2024-08-17T02:46:20.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.497+0000 7f102b200640 1 -- start start 2024-08-17T02:46:20.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.499+0000 7f102b200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f102c155880 0x7f102c0ae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.499+0000 7f102b200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f102c0aeb70 0x7f102c0af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.499+0000 7f102b200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f102c155c50 0x7f102c0af630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.499+0000 7f102b200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f102c157840 con 0x7f102c155c50 2024-08-17T02:46:20.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.499+0000 7f102b200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f102c156c30 con 0x7f102c155880 2024-08-17T02:46:20.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.499+0000 7f102b200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102c156f10 con 0x7f102c0aeb70 2024-08-17T02:46:20.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.499+0000 7f102a800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f102c155c50 0x7f102c0af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.499+0000 7f102a800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f102c155c50 0x7f102c0af630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32932/0 (socket says 172.21.15.100:32932) 2024-08-17T02:46:20.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.499+0000 7f102a800640 1 -- 172.21.15.100:0/1645226499 learned_addr learned my addr 172.21.15.100:0/1645226499 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:20.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.499+0000 7f1021400640 1 --2- 172.21.15.100:0/1645226499 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f102c0aeb70 0x7f102c0af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.499+0000 7f1029e00640 1 --2- 172.21.15.100:0/1645226499 >> v2:172.21.15.123:3300/0 conn(0x7f102c155880 0x7f102c0ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.499+0000 7f102a800640 1 -- 172.21.15.100:0/1645226499 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f102c0aeb70 msgr2=0x7f102c0af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:20.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.499+0000 7f102a800640 1 --2- 172.21.15.100:0/1645226499 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f102c0aeb70 0x7f102c0af0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.500+0000 7f102a800640 1 -- 172.21.15.100:0/1645226499 >> v2:172.21.15.123:3300/0 conn(0x7f102c155880 msgr2=0x7f102c0ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:20.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.500+0000 7f102a800640 1 --2- 172.21.15.100:0/1645226499 >> v2:172.21.15.123:3300/0 conn(0x7f102c155880 0x7f102c0ae630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.500+0000 7f102a800640 1 -- 172.21.15.100:0/1645226499 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c1571f0 con 0x7f102c155c50 2024-08-17T02:46:20.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.500+0000 7f1029e00640 1 --2- 172.21.15.100:0/1645226499 >> v2:172.21.15.123:3300/0 conn(0x7f102c155880 0x7f102c0ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:20.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.500+0000 7f102a800640 1 --2- 172.21.15.100:0/1645226499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f102c155c50 0x7f102c0af630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f102c063570 tx=0x7f1024009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e9674ccd555406 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.501+0000 7f1029400640 1 -- 172.21.15.100:0/1645226499 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102402d540 con 0x7f102c155c50 2024-08-17T02:46:20.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.501+0000 7f1029400640 1 -- 172.21.15.100:0/1645226499 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102402d6a0 con 0x7f102c155c50 2024-08-17T02:46:20.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.501+0000 7f1029400640 1 -- 172.21.15.100:0/1645226499 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102402da80 con 0x7f102c155c50 2024-08-17T02:46:20.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.501+0000 7f102b200640 1 -- 172.21.15.100:0/1645226499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f102c155c50 msgr2=0x7f102c0af630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.501+0000 7f102b200640 1 --2- 172.21.15.100:0/1645226499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f102c155c50 0x7f102c0af630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f102c063570 tx=0x7f1024009840 comp rx=0 tx=0).stop 2024-08-17T02:46:20.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.501+0000 7f102b200640 1 -- 172.21.15.100:0/1645226499 shutdown_connections 2024-08-17T02:46:20.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.501+0000 7f102b200640 1 --2- 172.21.15.100:0/1645226499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f102c155c50 0x7f102c0af630 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.501+0000 7f102b200640 1 --2- 172.21.15.100:0/1645226499 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f102c0aeb70 0x7f102c0af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.501+0000 7f102b200640 1 --2- 172.21.15.100:0/1645226499 >> v2:172.21.15.123:3300/0 conn(0x7f102c155880 0x7f102c0ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.501+0000 7f102b200640 1 -- 172.21.15.100:0/1645226499 >> 172.21.15.100:0/1645226499 conn(0x7f102c067750 msgr2=0x7f102c0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.502+0000 7f102b200640 1 -- 172.21.15.100:0/1645226499 shutdown_connections 2024-08-17T02:46:20.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.502+0000 7f102b200640 1 -- 172.21.15.100:0/1645226499 wait complete. 2024-08-17T02:46:20.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.503+0000 7f102b200640 1 Processor -- start 2024-08-17T02:46:20.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.503+0000 7f102b200640 1 -- start start 2024-08-17T02:46:20.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.504+0000 7f102b200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f102c0aeb70 0x7f102c0ab660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.504+0000 7f102b200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f102c155880 0x7f102c153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.504+0000 7f102b200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f102c155c50 0x7f102c0ad240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.504+0000 7f102b200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c0a98e0 con 0x7f102c155880 2024-08-17T02:46:20.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.504+0000 7f102b200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c0a9af0 con 0x7f102c0aeb70 2024-08-17T02:46:20.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.504+0000 7f102b200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102c0a9dd0 con 0x7f102c155c50 2024-08-17T02:46:20.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.504+0000 7f1021400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f102c155880 0x7f102c153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.504+0000 7f1021400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f102c155880 0x7f102c153960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32936/0 (socket says 172.21.15.100:32936) 2024-08-17T02:46:20.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.504+0000 7f1021400640 1 -- 172.21.15.100:0/2325026659 learned_addr learned my addr 172.21.15.100:0/2325026659 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:20.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.504+0000 7f1021400640 1 -- 172.21.15.100:0/2325026659 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f102c155c50 msgr2=0x7f102c0ad240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.504+0000 7f1029e00640 1 --2- 172.21.15.100:0/2325026659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f102c0aeb70 0x7f102c0ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.504+0000 7f102a800640 1 --2- 172.21.15.100:0/2325026659 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f102c155c50 0x7f102c0ad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.505+0000 7f1021400640 1 --2- 172.21.15.100:0/2325026659 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f102c155c50 0x7f102c0ad240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.505+0000 7f1021400640 1 -- 172.21.15.100:0/2325026659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f102c0aeb70 msgr2=0x7f102c0ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.505+0000 7f1021400640 1 --2- 172.21.15.100:0/2325026659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f102c0aeb70 0x7f102c0ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.505+0000 7f1021400640 1 -- 172.21.15.100:0/2325026659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1024009ae0 con 0x7f102c155880 2024-08-17T02:46:20.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.505+0000 7f1029e00640 1 --2- 172.21.15.100:0/2325026659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f102c0aeb70 0x7f102c0ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:20.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.505+0000 7f102a800640 1 --2- 172.21.15.100:0/2325026659 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f102c155c50 0x7f102c0ad240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:20.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.505+0000 7f1021400640 1 --2- 172.21.15.100:0/2325026659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f102c155880 0x7f102c153960 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f101400e8d0 tx=0x7f10140090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.505+0000 7f1022000640 1 -- 172.21.15.100:0/2325026659 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101400eec0 con 0x7f102c155880 2024-08-17T02:46:20.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.505+0000 7f1022000640 1 -- 172.21.15.100:0/2325026659 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101400c8e0 con 0x7f102c155880 2024-08-17T02:46:20.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.505+0000 7f1022000640 1 -- 172.21.15.100:0/2325026659 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101400cc60 con 0x7f102c155880 2024-08-17T02:46:20.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.505+0000 7f102b200640 1 -- 172.21.15.100:0/2325026659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102c0aa0b0 con 0x7f102c155880 2024-08-17T02:46:20.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.505+0000 7f102b200640 1 -- 172.21.15.100:0/2325026659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102c0aa670 con 0x7f102c155880 2024-08-17T02:46:20.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.506+0000 7f102b200640 1 -- 172.21.15.100:0/2325026659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f102c071050 con 0x7f102c155880 2024-08-17T02:46:20.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.507+0000 7f1022000640 1 -- 172.21.15.100:0/2325026659 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1014013680 con 0x7f102c155880 2024-08-17T02:46:20.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.508+0000 7f1022000640 1 --2- 172.21.15.100:0/2325026659 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1008065150 0x7f1008067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.508+0000 7f1022000640 1 -- 172.21.15.100:0/2325026659 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f1014082690 con 0x7f102c155880 2024-08-17T02:46:20.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.508+0000 7f1029e00640 1 --2- 172.21.15.100:0/2325026659 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1008065150 0x7f1008067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.509+0000 7f1029e00640 1 --2- 172.21.15.100:0/2325026659 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1008065150 0x7f1008067600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f101c006e70 tx=0x7f101c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.512+0000 7f1022000640 1 -- 172.21.15.100:0/2325026659 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1014050660 con 0x7f102c155880 2024-08-17T02:46:20.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:20.683+0000 7f102b200640 1 -- 172.21.15.100:0/2325026659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f102c0cbed0 con 0x7f102c155880 2024-08-17T02:46:21.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.653+0000 7f1022000640 1 -- 172.21.15.100:0/2325026659 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1014053c80 con 0x7f102c155880 2024-08-17T02:46:21.654 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:46:21.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.658+0000 7f102b200640 1 -- 172.21.15.100:0/2325026659 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1008065150 msgr2=0x7f1008067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:21.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.658+0000 7f102b200640 1 --2- 172.21.15.100:0/2325026659 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1008065150 0x7f1008067600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f101c006e70 tx=0x7f101c008040 comp rx=0 tx=0).stop 2024-08-17T02:46:21.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.658+0000 7f102b200640 1 -- 172.21.15.100:0/2325026659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f102c155880 msgr2=0x7f102c153960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:21.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.658+0000 7f102b200640 1 --2- 172.21.15.100:0/2325026659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f102c155880 0x7f102c153960 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f101400e8d0 tx=0x7f10140090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:21.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.658+0000 7f102b200640 1 -- 172.21.15.100:0/2325026659 shutdown_connections 2024-08-17T02:46:21.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.658+0000 7f102b200640 1 --2- 172.21.15.100:0/2325026659 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1008065150 0x7f1008067600 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:21.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.658+0000 7f102b200640 1 --2- 172.21.15.100:0/2325026659 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f102c155c50 0x7f102c0ad240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:21.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.658+0000 7f102b200640 1 --2- 172.21.15.100:0/2325026659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f102c155880 0x7f102c153960 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:21.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.658+0000 7f102b200640 1 --2- 172.21.15.100:0/2325026659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f102c0aeb70 0x7f102c0ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:21.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.658+0000 7f102b200640 1 -- 172.21.15.100:0/2325026659 >> 172.21.15.100:0/2325026659 conn(0x7f102c067750 msgr2=0x7f102c0aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:21.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.659+0000 7f102b200640 1 -- 172.21.15.100:0/2325026659 shutdown_connections 2024-08-17T02:46:21.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.659+0000 7f102b200640 1 -- 172.21.15.100:0/2325026659 wait complete. 2024-08-17T02:46:21.679 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:46:21.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.836+0000 7fed25a00640 1 Processor -- start 2024-08-17T02:46:21.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.836+0000 7fed25a00640 1 -- start start 2024-08-17T02:46:21.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.837+0000 7fed25a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fed200aa810 0x7fed200aabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:21.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.837+0000 7fed25a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed200ab120 0x7fed20068080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:21.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.837+0000 7fed25a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed200685c0 0x7fed20068a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:21.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.837+0000 7fed25a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed200ac4e0 con 0x7fed200aa810 2024-08-17T02:46:21.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.837+0000 7fed25a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed200ac780 con 0x7fed200685c0 2024-08-17T02:46:21.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.837+0000 7fed25a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed200aca60 con 0x7fed200ab120 2024-08-17T02:46:21.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.837+0000 7fed1ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fed200aa810 0x7fed200aabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:21.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.837+0000 7fed1ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fed200aa810 0x7fed200aabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32944/0 (socket says 172.21.15.100:32944) 2024-08-17T02:46:21.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.837+0000 7fed1ea00640 1 -- 172.21.15.100:0/491345258 learned_addr learned my addr 172.21.15.100:0/491345258 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:21.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.838+0000 7fed1e000640 1 --2- 172.21.15.100:0/491345258 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed200ab120 0x7fed20068080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:21.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.838+0000 7fed1f400640 1 --2- 172.21.15.100:0/491345258 >> v2:172.21.15.123:3300/0 conn(0x7fed200685c0 0x7fed20068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:21.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.838+0000 7fed1ea00640 1 -- 172.21.15.100:0/491345258 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed200ab120 msgr2=0x7fed20068080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:21.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.838+0000 7fed1ea00640 1 --2- 172.21.15.100:0/491345258 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed200ab120 0x7fed20068080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:21.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.838+0000 7fed1ea00640 1 -- 172.21.15.100:0/491345258 >> v2:172.21.15.123:3300/0 conn(0x7fed200685c0 msgr2=0x7fed20068a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:21.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.838+0000 7fed1ea00640 1 --2- 172.21.15.100:0/491345258 >> v2:172.21.15.123:3300/0 conn(0x7fed200685c0 0x7fed20068a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:21.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.838+0000 7fed1ea00640 1 -- 172.21.15.100:0/491345258 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed200acd40 con 0x7fed200aa810 2024-08-17T02:46:21.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.838+0000 7fed1e000640 1 --2- 172.21.15.100:0/491345258 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed200ab120 0x7fed20068080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:21.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.839+0000 7fed1ea00640 1 --2- 172.21.15.100:0/491345258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed200aa810 0x7fed200aabe0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fed20070870 tx=0x7fed100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f43bd7e938dd9f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:21.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.839+0000 7fed1d600640 1 -- 172.21.15.100:0/491345258 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1002add0 con 0x7fed200aa810 2024-08-17T02:46:21.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.839+0000 7fed1d600640 1 -- 172.21.15.100:0/491345258 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed10032440 con 0x7fed200aa810 2024-08-17T02:46:21.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.839+0000 7fed1d600640 1 -- 172.21.15.100:0/491345258 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed10032820 con 0x7fed200aa810 2024-08-17T02:46:21.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.840+0000 7fed25a00640 1 -- 172.21.15.100:0/491345258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed200aa810 msgr2=0x7fed200aabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:21.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.840+0000 7fed25a00640 1 --2- 172.21.15.100:0/491345258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed200aa810 0x7fed200aabe0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fed20070870 tx=0x7fed100091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:21.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.840+0000 7fed25a00640 1 -- 172.21.15.100:0/491345258 shutdown_connections 2024-08-17T02:46:21.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.840+0000 7fed25a00640 1 --2- 172.21.15.100:0/491345258 >> v2:172.21.15.123:3300/0 conn(0x7fed200685c0 0x7fed20068a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:21.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.840+0000 7fed25a00640 1 --2- 172.21.15.100:0/491345258 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed200ab120 0x7fed20068080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:21.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.840+0000 7fed25a00640 1 --2- 172.21.15.100:0/491345258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed200aa810 0x7fed200aabe0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:21.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.840+0000 7fed25a00640 1 -- 172.21.15.100:0/491345258 >> 172.21.15.100:0/491345258 conn(0x7fed20096a70 msgr2=0x7fed20096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:21.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.840+0000 7fed25a00640 1 -- 172.21.15.100:0/491345258 shutdown_connections 2024-08-17T02:46:21.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.840+0000 7fed25a00640 1 -- 172.21.15.100:0/491345258 wait complete. 2024-08-17T02:46:21.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.841+0000 7fed25a00640 1 Processor -- start 2024-08-17T02:46:21.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.841+0000 7fed25a00640 1 -- start start 2024-08-17T02:46:21.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.842+0000 7fed25a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed200685c0 0x7fed20098750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:21.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.842+0000 7fed25a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed200aa810 0x7fed2009b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:21.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.842+0000 7fed25a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed200ab120 0x7fed20153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.842+0000 7fed25a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed200991f0 con 0x7fed200685c0 2024-08-17T02:46:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.842+0000 7fed25a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed20098c90 con 0x7fed200ab120 2024-08-17T02:46:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.842+0000 7fed25a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed20098f10 con 0x7fed200aa810 2024-08-17T02:46:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.842+0000 7fed1ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed200685c0 0x7fed20098750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.842+0000 7fed1ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed200685c0 0x7fed20098750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32952/0 (socket says 172.21.15.100:32952) 2024-08-17T02:46:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.842+0000 7fed1ea00640 1 -- 172.21.15.100:0/3009950059 learned_addr learned my addr 172.21.15.100:0/3009950059 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.843+0000 7fed1ea00640 1 -- 172.21.15.100:0/3009950059 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed200aa810 msgr2=0x7fed2009b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.843+0000 7fed1ea00640 1 --2- 172.21.15.100:0/3009950059 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed200aa810 0x7fed2009b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.843+0000 7fed1ea00640 1 -- 172.21.15.100:0/3009950059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed200ab120 msgr2=0x7fed20153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.843+0000 7fed1f400640 1 --2- 172.21.15.100:0/3009950059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed200ab120 0x7fed20153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.843+0000 7fed1ea00640 1 --2- 172.21.15.100:0/3009950059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed200ab120 0x7fed20153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.843+0000 7fed1ea00640 1 -- 172.21.15.100:0/3009950059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed10009450 con 0x7fed200685c0 2024-08-17T02:46:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.843+0000 7fed1f400640 1 --2- 172.21.15.100:0/3009950059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed200ab120 0x7fed20153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:21.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.843+0000 7fed1ea00640 1 --2- 172.21.15.100:0/3009950059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed200685c0 0x7fed20098750 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fed10009940 tx=0x7fed10032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:21.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.843+0000 7fed16000640 1 -- 172.21.15.100:0/3009950059 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed10000d10 con 0x7fed200685c0 2024-08-17T02:46:21.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.843+0000 7fed16000640 1 -- 172.21.15.100:0/3009950059 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed10031a40 con 0x7fed200685c0 2024-08-17T02:46:21.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.844+0000 7fed16000640 1 -- 172.21.15.100:0/3009950059 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed10031e00 con 0x7fed200685c0 2024-08-17T02:46:21.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.844+0000 7fed25a00640 1 -- 172.21.15.100:0/3009950059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2009a8e0 con 0x7fed200685c0 2024-08-17T02:46:21.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.844+0000 7fed25a00640 1 -- 172.21.15.100:0/3009950059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2009aea0 con 0x7fed200685c0 2024-08-17T02:46:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.845+0000 7fed25a00640 1 -- 172.21.15.100:0/3009950059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2009a740 con 0x7fed200685c0 2024-08-17T02:46:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.846+0000 7fed16000640 1 -- 172.21.15.100:0/3009950059 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fed10039040 con 0x7fed200685c0 2024-08-17T02:46:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.846+0000 7fed16000640 1 --2- 172.21.15.100:0/3009950059 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fed00065150 0x7fed00067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.846+0000 7fed16000640 1 -- 172.21.15.100:0/3009950059 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fed100a2390 con 0x7fed200685c0 2024-08-17T02:46:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.847+0000 7fed1e000640 1 --2- 172.21.15.100:0/3009950059 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fed00065150 0x7fed00067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.847+0000 7fed1e000640 1 --2- 172.21.15.100:0/3009950059 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fed00065150 0x7fed00067600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fed0c006fd0 tx=0x7fed0c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:21.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:21.851+0000 7fed16000640 1 -- 172.21.15.100:0/3009950059 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fed2009a740 con 0x7fed200685c0 2024-08-17T02:46:22.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.026+0000 7fed25a00640 1 -- 172.21.15.100:0/3009950059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fed2009b0e0 con 0x7fed200685c0 2024-08-17T02:46:22.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.654+0000 7fed16000640 1 -- 172.21.15.100:0/3009950059 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fed2009b0e0 con 0x7fed200685c0 2024-08-17T02:46:22.656 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2024-08-17T02:46:22.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.659+0000 7fed25a00640 1 -- 172.21.15.100:0/3009950059 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fed00065150 msgr2=0x7fed00067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.659+0000 7fed25a00640 1 --2- 172.21.15.100:0/3009950059 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fed00065150 0x7fed00067600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fed0c006fd0 tx=0x7fed0c008040 comp rx=0 tx=0).stop 2024-08-17T02:46:22.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.659+0000 7fed25a00640 1 -- 172.21.15.100:0/3009950059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed200685c0 msgr2=0x7fed20098750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.659+0000 7fed25a00640 1 --2- 172.21.15.100:0/3009950059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed200685c0 0x7fed20098750 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fed10009940 tx=0x7fed10032000 comp rx=0 tx=0).stop 2024-08-17T02:46:22.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.660+0000 7fed25a00640 1 -- 172.21.15.100:0/3009950059 shutdown_connections 2024-08-17T02:46:22.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.660+0000 7fed25a00640 1 --2- 172.21.15.100:0/3009950059 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fed00065150 0x7fed00067600 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.660+0000 7fed25a00640 1 --2- 172.21.15.100:0/3009950059 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed200ab120 0x7fed20153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.660+0000 7fed25a00640 1 --2- 172.21.15.100:0/3009950059 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed200aa810 0x7fed2009b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.660+0000 7fed25a00640 1 --2- 172.21.15.100:0/3009950059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed200685c0 0x7fed20098750 secure :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fed10009940 tx=0x7fed10032000 comp rx=0 tx=0).stop 2024-08-17T02:46:22.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.660+0000 7fed25a00640 1 -- 172.21.15.100:0/3009950059 >> 172.21.15.100:0/3009950059 conn(0x7fed20096a70 msgr2=0x7fed2006b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:22.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.660+0000 7fed25a00640 1 -- 172.21.15.100:0/3009950059 shutdown_connections 2024-08-17T02:46:22.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.660+0000 7fed25a00640 1 -- 172.21.15.100:0/3009950059 wait complete. 2024-08-17T02:46:22.680 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:46:22.680 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-17T02:46:22.680 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:46:22.680 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:46:22.681 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:46:22.681 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-17T02:46:22.681 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:46:22.681 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:46:22.681 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:46:22.681 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-17T02:46:22.681 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:46:22.682 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:46:22.682 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:46:22.682 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-17T02:46:22.682 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:46:22.682 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:46:22.697 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:46:22.697 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:46:22.698 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:46:22.698 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:46:22.699 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:46:22.699 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:46:22.700 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:46:22.700 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:46:22.742 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:46:22.742 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:22.744 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:46:22.745 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:22.745 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:46:22.745 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:22.747 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:46:22.747 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:22.748 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-17T02:46:22.868 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2024-08-17T02:46:22.869 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-08-17T02:46:22.878 INFO:tasks.ceph.mds.b.smithi123.stdout:starting mds.b at 2024-08-17T02:46:22.878 INFO:tasks.ceph.mds.d.smithi123.stdout:starting mds.d at 2024-08-17T02:46:22.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.907+0000 7f4dfa800640 1 Processor -- start 2024-08-17T02:46:22.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.907+0000 7f4dfa800640 1 -- start start 2024-08-17T02:46:22.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.908+0000 7f4dfa800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4df40d08d0 0x7f4df40c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.908+0000 7f4dfa800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4df40cb340 0x7f4df41590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.908+0000 7f4dfa800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df40cb7c0 con 0x7f4df4158ce0 2024-08-17T02:46:22.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.908+0000 7f4dfa800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df40cf0c0 con 0x7f4df40cb340 2024-08-17T02:46:22.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.908+0000 7f4dfa800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df4089000 con 0x7f4df40d08d0 2024-08-17T02:46:22.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.908+0000 7f4df3e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4df40cb340 0x7f4df41590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.908+0000 7f4df3e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4df40cb340 0x7f4df41590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33000/0 (socket says 172.21.15.100:33000) 2024-08-17T02:46:22.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.908+0000 7f4df3e00640 1 -- 172.21.15.100:0/4207128209 learned_addr learned my addr 172.21.15.100:0/4207128209 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:22.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.908+0000 7f4df2a00640 1 --2- 172.21.15.100:0/4207128209 >> v2:172.21.15.123:3300/0 conn(0x7f4df40d08d0 0x7f4df40c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.909+0000 7f4df3e00640 1 -- 172.21.15.100:0/4207128209 >> v2:172.21.15.123:3300/0 conn(0x7f4df40d08d0 msgr2=0x7f4df40c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:22.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.909+0000 7f4df3e00640 1 --2- 172.21.15.100:0/4207128209 >> v2:172.21.15.123:3300/0 conn(0x7f4df40d08d0 0x7f4df40c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.909+0000 7f4df3e00640 1 -- 172.21.15.100:0/4207128209 >> v1:172.21.15.100:6789/0 conn(0x7f4df4158ce0 legacy=0x7f4df40cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.909+0000 7f4df3e00640 1 -- 172.21.15.100:0/4207128209 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df40ceb20 con 0x7f4df40cb340 2024-08-17T02:46:22.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.910+0000 7f4df3e00640 1 --2- 172.21.15.100:0/4207128209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4df40cb340 0x7f4df41590b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4df40ca0a0 tx=0x7f4dec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcdedcfd23856f4c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.910+0000 7f4df2000640 1 -- 172.21.15.100:0/4207128209 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec032400 con 0x7f4df40cb340 2024-08-17T02:46:22.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.910+0000 7f4df2000640 1 -- 172.21.15.100:0/4207128209 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dec02e050 con 0x7f4df40cb340 2024-08-17T02:46:22.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.910+0000 7f4df2000640 1 -- 172.21.15.100:0/4207128209 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec0327f0 con 0x7f4df40cb340 2024-08-17T02:46:22.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.910+0000 7f4dfa800640 1 -- 172.21.15.100:0/4207128209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4df40cb340 msgr2=0x7f4df41590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.910+0000 7f4dfa800640 1 --2- 172.21.15.100:0/4207128209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4df40cb340 0x7f4df41590b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4df40ca0a0 tx=0x7f4dec009840 comp rx=0 tx=0).stop 2024-08-17T02:46:22.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.911+0000 7f4dfa800640 1 -- 172.21.15.100:0/4207128209 shutdown_connections 2024-08-17T02:46:22.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.911+0000 7f4dfa800640 1 --2- 172.21.15.100:0/4207128209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4df40cb340 0x7f4df41590b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.911+0000 7f4dfa800640 1 --2- 172.21.15.100:0/4207128209 >> v2:172.21.15.123:3300/0 conn(0x7f4df40d08d0 0x7f4df40c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.911+0000 7f4dfa800640 1 -- 172.21.15.100:0/4207128209 >> 172.21.15.100:0/4207128209 conn(0x7f4df40cfdc0 msgr2=0x7f4df40d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:22.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.911+0000 7f4dfa800640 1 -- 172.21.15.100:0/4207128209 shutdown_connections 2024-08-17T02:46:22.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.911+0000 7f4dfa800640 1 -- 172.21.15.100:0/4207128209 wait complete. 2024-08-17T02:46:22.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.912+0000 7f4dfa800640 1 Processor -- start 2024-08-17T02:46:22.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.912+0000 7f4dfa800640 1 -- start start 2024-08-17T02:46:22.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.913+0000 7f4dfa800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4df40cb340 0x7f4df415aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.913+0000 7f4dfa800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4df40d08d0 0x7f4df41590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.913+0000 7f4dfa800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4df4158ce0 0x7f4df4151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.913+0000 7f4dfa800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df40b2b60 con 0x7f4df40cb340 2024-08-17T02:46:22.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.913+0000 7f4dfa800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df4159ae0 con 0x7f4df40d08d0 2024-08-17T02:46:22.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.913+0000 7f4dfa800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df4159dc0 con 0x7f4df4158ce0 2024-08-17T02:46:22.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.913+0000 7f4df3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4df40cb340 0x7f4df415aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.913+0000 7f4df3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4df40cb340 0x7f4df415aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33014/0 (socket says 172.21.15.100:33014) 2024-08-17T02:46:22.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.913+0000 7f4df3400640 1 -- 172.21.15.100:0/1739449351 learned_addr learned my addr 172.21.15.100:0/1739449351 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:22.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.914+0000 7f4df3e00640 1 --2- 172.21.15.100:0/1739449351 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4df4158ce0 0x7f4df4151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.914+0000 7f4df2a00640 1 --2- 172.21.15.100:0/1739449351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4df40d08d0 0x7f4df41590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.914+0000 7f4df3400640 1 -- 172.21.15.100:0/1739449351 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4df4158ce0 msgr2=0x7f4df4151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.914+0000 7f4df3400640 1 --2- 172.21.15.100:0/1739449351 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4df4158ce0 0x7f4df4151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.914+0000 7f4df3400640 1 -- 172.21.15.100:0/1739449351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4df40d08d0 msgr2=0x7f4df41590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.914+0000 7f4df3400640 1 --2- 172.21.15.100:0/1739449351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4df40d08d0 0x7f4df41590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.914+0000 7f4df3400640 1 -- 172.21.15.100:0/1739449351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec009ae0 con 0x7f4df40cb340 2024-08-17T02:46:22.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.914+0000 7f4df3e00640 1 --2- 172.21.15.100:0/1739449351 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4df4158ce0 0x7f4df4151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:22.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.914+0000 7f4df2a00640 1 --2- 172.21.15.100:0/1739449351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4df40d08d0 0x7f4df41590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:22.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.914+0000 7f4df3400640 1 --2- 172.21.15.100:0/1739449351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4df40cb340 0x7f4df415aa90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4de400c4c0 tx=0x7f4de4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.914+0000 7f4deaa00640 1 -- 172.21.15.100:0/1739449351 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4011590 con 0x7f4df40cb340 2024-08-17T02:46:22.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.914+0000 7f4deaa00640 1 -- 172.21.15.100:0/1739449351 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de4011710 con 0x7f4df40cb340 2024-08-17T02:46:22.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.914+0000 7f4deaa00640 1 -- 172.21.15.100:0/1739449351 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4011ad0 con 0x7f4df40cb340 2024-08-17T02:46:22.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.914+0000 7f4dfa800640 1 -- 172.21.15.100:0/1739449351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df415a0a0 con 0x7f4df40cb340 2024-08-17T02:46:22.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.914+0000 7f4dfa800640 1 -- 172.21.15.100:0/1739449351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df40b4d40 con 0x7f4df40cb340 2024-08-17T02:46:22.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.915+0000 7f4dfa800640 1 -- 172.21.15.100:0/1739449351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df40b2ca0 con 0x7f4df40cb340 2024-08-17T02:46:22.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.916+0000 7f4deaa00640 1 -- 172.21.15.100:0/1739449351 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4de401b3b0 con 0x7f4df40cb340 2024-08-17T02:46:22.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.917+0000 7f4deaa00640 1 --2- 172.21.15.100:0/1739449351 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4dd4065150 0x7f4dd4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.918+0000 7f4deaa00640 1 -- 172.21.15.100:0/1739449351 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4de40816b0 con 0x7f4df40cb340 2024-08-17T02:46:22.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.918+0000 7f4df2a00640 1 --2- 172.21.15.100:0/1739449351 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4dd4065150 0x7f4dd4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.918+0000 7f4df2a00640 1 --2- 172.21.15.100:0/1739449351 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4dd4065150 0x7f4dd4067600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4de0006e70 tx=0x7f4de0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:22.922+0000 7f4deaa00640 1 -- 172.21.15.100:0/1739449351 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4df40b2ca0 con 0x7f4df40cb340 2024-08-17T02:46:23.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.108+0000 7f4dfa800640 1 -- 172.21.15.100:0/1739449351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4df4064db0 con 0x7f4df40cb340 2024-08-17T02:46:23.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.676+0000 7f4deaa00640 1 -- 172.21.15.100:0/1739449351 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4de4017020 con 0x7f4df40cb340 2024-08-17T02:46:23.677 INFO:teuthology.orchestra.run.smithi100.stderr: removed all blocklist entries 2024-08-17T02:46:23.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.678+0000 7f4dfa800640 1 -- 172.21.15.100:0/1739449351 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4dd4065150 msgr2=0x7f4dd4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.678+0000 7f4dfa800640 1 --2- 172.21.15.100:0/1739449351 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4dd4065150 0x7f4dd4067600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4de0006e70 tx=0x7f4de0008040 comp rx=0 tx=0).stop 2024-08-17T02:46:23.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.679+0000 7f4dfa800640 1 -- 172.21.15.100:0/1739449351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4df40cb340 msgr2=0x7f4df415aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.679+0000 7f4dfa800640 1 --2- 172.21.15.100:0/1739449351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4df40cb340 0x7f4df415aa90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4de400c4c0 tx=0x7f4de4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.679+0000 7f4dfa800640 1 -- 172.21.15.100:0/1739449351 shutdown_connections 2024-08-17T02:46:23.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.679+0000 7f4dfa800640 1 --2- 172.21.15.100:0/1739449351 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4dd4065150 0x7f4dd4067600 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.679+0000 7f4dfa800640 1 --2- 172.21.15.100:0/1739449351 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4df4158ce0 0x7f4df4151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.679+0000 7f4dfa800640 1 --2- 172.21.15.100:0/1739449351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4df40d08d0 0x7f4df41590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.679+0000 7f4dfa800640 1 --2- 172.21.15.100:0/1739449351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4df40cb340 0x7f4df415aa90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.679+0000 7f4dfa800640 1 -- 172.21.15.100:0/1739449351 >> 172.21.15.100:0/1739449351 conn(0x7f4df40cfdc0 msgr2=0x7f4df4154960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:23.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.679+0000 7f4dfa800640 1 -- 172.21.15.100:0/1739449351 shutdown_connections 2024-08-17T02:46:23.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.679+0000 7f4dfa800640 1 -- 172.21.15.100:0/1739449351 wait complete. 2024-08-17T02:46:23.697 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-17T02:46:23.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.844+0000 7fb135000640 1 Processor -- start 2024-08-17T02:46:23.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.844+0000 7fb135000640 1 -- start start 2024-08-17T02:46:23.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.845+0000 7fb135000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb1300aa7d0 0x7fb13006ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.845+0000 7fb135000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb130158fa0 0x7fb1300ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.845+0000 7fb135000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1300a9a10 con 0x7fb13006da20 2024-08-17T02:46:23.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.845+0000 7fb135000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1300ac400 con 0x7fb1300aa7d0 2024-08-17T02:46:23.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.845+0000 7fb135000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1300a9cf0 con 0x7fb130158fa0 2024-08-17T02:46:23.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.845+0000 7fb12d400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb1300aa7d0 0x7fb13006ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.845+0000 7fb12d400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb1300aa7d0 0x7fb13006ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33028/0 (socket says 172.21.15.100:33028) 2024-08-17T02:46:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.845+0000 7fb12d400640 1 -- 172.21.15.100:0/1356509458 learned_addr learned my addr 172.21.15.100:0/1356509458 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.846+0000 7fb12e800640 1 --2- 172.21.15.100:0/1356509458 >> v2:172.21.15.123:3300/0 conn(0x7fb130158fa0 0x7fb1300ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.846+0000 7fb12d400640 1 -- 172.21.15.100:0/1356509458 >> v2:172.21.15.123:3300/0 conn(0x7fb130158fa0 msgr2=0x7fb1300ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.846+0000 7fb12d400640 1 --2- 172.21.15.100:0/1356509458 >> v2:172.21.15.123:3300/0 conn(0x7fb130158fa0 0x7fb1300ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.846+0000 7fb12d400640 1 -- 172.21.15.100:0/1356509458 >> v1:172.21.15.123:6789/0 conn(0x7fb13006da20 legacy=0x7fb130158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.846+0000 7fb12d400640 1 -- 172.21.15.100:0/1356509458 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1300a9fd0 con 0x7fb1300aa7d0 2024-08-17T02:46:23.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.847+0000 7fb12d400640 1 --2- 172.21.15.100:0/1356509458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1300aa7d0 0x7fb13006ddf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb1300ad2e0 tx=0x7fb11c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb066a4ef856ff5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.847+0000 7fb12ca00640 1 -- 172.21.15.100:0/1356509458 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c02adf0 con 0x7fb1300aa7d0 2024-08-17T02:46:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.847+0000 7fb12ca00640 1 -- 172.21.15.100:0/1356509458 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11c032440 con 0x7fb1300aa7d0 2024-08-17T02:46:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.847+0000 7fb12ca00640 1 -- 172.21.15.100:0/1356509458 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c032820 con 0x7fb1300aa7d0 2024-08-17T02:46:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.848+0000 7fb135000640 1 -- 172.21.15.100:0/1356509458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1300aa7d0 msgr2=0x7fb13006ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.848+0000 7fb135000640 1 --2- 172.21.15.100:0/1356509458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1300aa7d0 0x7fb13006ddf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb1300ad2e0 tx=0x7fb11c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.848+0000 7fb135000640 1 -- 172.21.15.100:0/1356509458 shutdown_connections 2024-08-17T02:46:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.848+0000 7fb135000640 1 --2- 172.21.15.100:0/1356509458 >> v2:172.21.15.123:3300/0 conn(0x7fb130158fa0 0x7fb1300ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.848+0000 7fb135000640 1 --2- 172.21.15.100:0/1356509458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1300aa7d0 0x7fb13006ddf0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.848+0000 7fb135000640 1 -- 172.21.15.100:0/1356509458 >> 172.21.15.100:0/1356509458 conn(0x7fb1300cb9b0 msgr2=0x7fb1300cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.848+0000 7fb135000640 1 -- 172.21.15.100:0/1356509458 shutdown_connections 2024-08-17T02:46:23.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.848+0000 7fb135000640 1 -- 172.21.15.100:0/1356509458 wait complete. 2024-08-17T02:46:23.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.849+0000 7fb135000640 1 Processor -- start 2024-08-17T02:46:23.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.849+0000 7fb135000640 1 -- start start 2024-08-17T02:46:23.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.850+0000 7fb135000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb13006da20 0x7fb13006a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.850+0000 7fb135000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1300aa7d0 0x7fb1300690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.850+0000 7fb135000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb130158fa0 0x7fb1301515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.850+0000 7fb135000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb130069c00 con 0x7fb1300aa7d0 2024-08-17T02:46:23.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.850+0000 7fb135000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb130069920 con 0x7fb13006da20 2024-08-17T02:46:23.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.850+0000 7fb135000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1300c8370 con 0x7fb130158fa0 2024-08-17T02:46:23.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.851+0000 7fb12d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1300aa7d0 0x7fb1300690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.851+0000 7fb12d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1300aa7d0 0x7fb1300690f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33044/0 (socket says 172.21.15.100:33044) 2024-08-17T02:46:23.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.851+0000 7fb12d400640 1 -- 172.21.15.100:0/632806064 learned_addr learned my addr 172.21.15.100:0/632806064 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:23.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.851+0000 7fb12de00640 1 --2- 172.21.15.100:0/632806064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb13006da20 0x7fb13006a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.851+0000 7fb12e800640 1 --2- 172.21.15.100:0/632806064 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb130158fa0 0x7fb1301515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.851+0000 7fb12d400640 1 -- 172.21.15.100:0/632806064 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb130158fa0 msgr2=0x7fb1301515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.851+0000 7fb12d400640 1 --2- 172.21.15.100:0/632806064 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb130158fa0 0x7fb1301515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.851+0000 7fb12d400640 1 -- 172.21.15.100:0/632806064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb13006da20 msgr2=0x7fb13006a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.851+0000 7fb12d400640 1 --2- 172.21.15.100:0/632806064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb13006da20 0x7fb13006a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.851+0000 7fb12d400640 1 -- 172.21.15.100:0/632806064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11c009450 con 0x7fb1300aa7d0 2024-08-17T02:46:23.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.851+0000 7fb12d400640 1 --2- 172.21.15.100:0/632806064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1300aa7d0 0x7fb1300690f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb11c009210 tx=0x7fb11c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:23.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.852+0000 7fb125600640 1 -- 172.21.15.100:0/632806064 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c031a60 con 0x7fb1300aa7d0 2024-08-17T02:46:23.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.852+0000 7fb125600640 1 -- 172.21.15.100:0/632806064 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11c031be0 con 0x7fb1300aa7d0 2024-08-17T02:46:23.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.852+0000 7fb125600640 1 -- 172.21.15.100:0/632806064 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c03d420 con 0x7fb1300aa7d0 2024-08-17T02:46:23.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.852+0000 7fb135000640 1 -- 172.21.15.100:0/632806064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1300c8650 con 0x7fb1300aa7d0 2024-08-17T02:46:23.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.852+0000 7fb135000640 1 -- 172.21.15.100:0/632806064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb130069630 con 0x7fb1300aa7d0 2024-08-17T02:46:23.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.853+0000 7fb135000640 1 -- 172.21.15.100:0/632806064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb130064db0 con 0x7fb1300aa7d0 2024-08-17T02:46:23.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.854+0000 7fb125600640 1 -- 172.21.15.100:0/632806064 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb11c039040 con 0x7fb1300aa7d0 2024-08-17T02:46:23.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.855+0000 7fb125600640 1 --2- 172.21.15.100:0/632806064 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb110065150 0x7fb110067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.855+0000 7fb125600640 1 -- 172.21.15.100:0/632806064 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb11c0a1da0 con 0x7fb1300aa7d0 2024-08-17T02:46:23.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.855+0000 7fb12de00640 1 --2- 172.21.15.100:0/632806064 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb110065150 0x7fb110067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.856+0000 7fb12de00640 1 --2- 172.21.15.100:0/632806064 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb110065150 0x7fb110067600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb120007fd0 tx=0x7fb120007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:23.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:23.859+0000 7fb125600640 1 -- 172.21.15.100:0/632806064 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb11c0701c0 con 0x7fb1300aa7d0 2024-08-17T02:46:24.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.092+0000 7fb135000640 1 -- 172.21.15.100:0/632806064 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb130156fe0 con 0x7fb1300aa7d0 2024-08-17T02:46:24.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.093+0000 7fb125600640 1 -- 172.21.15.100:0/632806064 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fb11c037090 con 0x7fb1300aa7d0 2024-08-17T02:46:24.093 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:24.093 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-08-17T02:46:24.094 INFO:teuthology.orchestra.run.smithi100.stdout: "auth_dump": [ 2024-08-17T02:46:24.094 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.094 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.a", 2024-08-17T02:46:24.094 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCfDsBmkatqCxAAqk765XDex/V72qF8wyPHPA==", 2024-08-17T02:46:24.094 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.094 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-08-17T02:46:24.094 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-08-17T02:46:24.094 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-08-17T02:46:24.094 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-08-17T02:46:24.094 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.094 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.095 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.095 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.b", 2024-08-17T02:46:24.095 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCfDsBmYppBHhAA7WM7MkdplGhtxEYAquoalg==", 2024-08-17T02:46:24.095 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.095 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-08-17T02:46:24.095 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-08-17T02:46:24.095 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-08-17T02:46:24.095 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-08-17T02:46:24.095 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.095 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.095 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.095 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.c", 2024-08-17T02:46:24.095 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCfDsBmfNi9FBAAibex/Ku5MvZcQQbPXA6+zg==", 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.d", 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCfDsBmVnGgJxAAogDB8enrbYRJRKEwTN8LxQ==", 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-08-17T02:46:24.097 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-08-17T02:46:24.097 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-08-17T02:46:24.097 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.097 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.097 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.097 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.0", 2024-08-17T02:46:24.097 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCiDsBmHr+DORAAAo1CnXGn1fDClOPW7KTU/g==", 2024-08-17T02:46:24.097 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.097 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-08-17T02:46:24.097 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-08-17T02:46:24.097 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-08-17T02:46:24.097 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.097 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.098 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.098 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.1", 2024-08-17T02:46:24.098 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCmDsBmxhq6AhAAqsf5q2ngt/RmnW6UX2w11A==", 2024-08-17T02:46:24.098 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.098 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-08-17T02:46:24.098 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-08-17T02:46:24.098 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-08-17T02:46:24.098 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.098 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.098 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.098 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.2", 2024-08-17T02:46:24.098 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCpDsBmibLtBhAA/idWQJbuilqFZBFNcsKJow==", 2024-08-17T02:46:24.098 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.099 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-08-17T02:46:24.099 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-08-17T02:46:24.099 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-08-17T02:46:24.099 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.099 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.099 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.099 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.3", 2024-08-17T02:46:24.099 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCsDsBmjXDxChAAEA9BJo1VPh2Rzq5KyuscuA==", 2024-08-17T02:46:24.099 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.099 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-08-17T02:46:24.099 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-08-17T02:46:24.099 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-08-17T02:46:24.099 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.100 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.100 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.100 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.4", 2024-08-17T02:46:24.100 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCyDsBmMQ7fBhAAJVA+Z43QZrc9abEqLHQNlw==", 2024-08-17T02:46:24.100 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.100 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-08-17T02:46:24.100 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-08-17T02:46:24.100 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-08-17T02:46:24.100 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.100 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.100 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.100 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.5", 2024-08-17T02:46:24.100 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQC1DsBm9mPODBAAq5blpeYBQcoErKMqaxQyMQ==", 2024-08-17T02:46:24.101 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.101 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-08-17T02:46:24.101 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-08-17T02:46:24.101 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-08-17T02:46:24.101 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.101 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.101 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.101 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.6", 2024-08-17T02:46:24.101 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQC4DsBmRY1FEBAAFEZa6jDFHDVxG1jPKSVgYg==", 2024-08-17T02:46:24.101 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.101 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-08-17T02:46:24.101 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-08-17T02:46:24.101 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-08-17T02:46:24.102 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.102 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.102 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.102 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.7", 2024-08-17T02:46:24.102 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQC7DsBmxKQZFBAAVKdMK0SW5gzFVSV9Lfl2+Q==", 2024-08-17T02:46:24.102 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.102 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-08-17T02:46:24.102 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-08-17T02:46:24.102 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-08-17T02:46:24.102 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.102 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.102 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.102 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.0", 2024-08-17T02:46:24.103 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCfDsBmHdqqLxAAHRfYUMhK+prQck4P7GXboA==", 2024-08-17T02:46:24.103 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.103 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-08-17T02:46:24.103 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-08-17T02:46:24.103 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-08-17T02:46:24.103 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-08-17T02:46:24.103 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.103 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.103 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.103 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.1", 2024-08-17T02:46:24.103 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCgDsBmGyYlABAAAKd4p6lI3u3Op6/6h8itnA==", 2024-08-17T02:46:24.103 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.103 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-08-17T02:46:24.104 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-08-17T02:46:24.104 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-08-17T02:46:24.104 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-08-17T02:46:24.104 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.104 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.104 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.104 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.2", 2024-08-17T02:46:24.104 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCfDsBm10auNRAA52wQWAZACIUhOYfNraWDPw==", 2024-08-17T02:46:24.104 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.104 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-08-17T02:46:24.104 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-08-17T02:46:24.104 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-08-17T02:46:24.104 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-08-17T02:46:24.104 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.3", 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCgDsBmvUotBhAAXAlaMT9Yfnp7Y1Z0Ho9OuA==", 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.admin", 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCeDsBm7VjgGBAAyLtSjBDi7xr3P85gZUqTdw==", 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-mds", 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDCDsBmFpEXKRAAbX3NtcVqU2+I3lthgA2uAA==", 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-mds" 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-mgr", 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDCDsBmrJoXKRAA1g6H/lAsD6Jj6WCpIH3H1g==", 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-osd", 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDCDsBmm6IXKRAA6XdPRZq01o8i63ki1xtgdw==", 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.108 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-osd" 2024-08-17T02:46:24.108 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.108 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.108 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.108 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-rbd", 2024-08-17T02:46:24.108 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDCDsBmVaoXKRAAO/FZ9vzSDe1mlhrmMnCrkw==", 2024-08-17T02:46:24.108 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.108 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-17T02:46:24.108 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.108 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.108 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.108 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-17T02:46:24.108 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDCDsBmqbMXKRAAJxste6keTDx2onSZHADphA==", 2024-08-17T02:46:24.109 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.109 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-17T02:46:24.109 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.109 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.109 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.109 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-rgw", 2024-08-17T02:46:24.109 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDCDsBm1LsXKRAABykOWMEdi+93pX+WYuI9hA==", 2024-08-17T02:46:24.109 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.109 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-17T02:46:24.109 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.109 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.109 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.109 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mgr.x", 2024-08-17T02:46:24.110 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCfDsBm5+1CBRAACor1Yz9eoici1JkZzFkePw==", 2024-08-17T02:46:24.110 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.110 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-08-17T02:46:24.110 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile mgr", 2024-08-17T02:46:24.110 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-08-17T02:46:24.110 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.110 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:24.110 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:24.110 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mgr.y", 2024-08-17T02:46:24.110 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCeDsBmozEhOhAAXAXbgAOEMQK20irHb/P+nw==", 2024-08-17T02:46:24.110 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-08-17T02:46:24.110 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-08-17T02:46:24.111 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile mgr", 2024-08-17T02:46:24.111 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-08-17T02:46:24.111 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.111 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:24.111 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-08-17T02:46:24.111 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-08-17T02:46:24.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.094+0000 7fb135000640 1 -- 172.21.15.100:0/632806064 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb110065150 msgr2=0x7fb110067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.094+0000 7fb135000640 1 --2- 172.21.15.100:0/632806064 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb110065150 0x7fb110067600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb120007fd0 tx=0x7fb120007e30 comp rx=0 tx=0).stop 2024-08-17T02:46:24.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.094+0000 7fb135000640 1 -- 172.21.15.100:0/632806064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1300aa7d0 msgr2=0x7fb1300690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.095+0000 7fb135000640 1 --2- 172.21.15.100:0/632806064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1300aa7d0 0x7fb1300690f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb11c009210 tx=0x7fb11c032000 comp rx=0 tx=0).stop 2024-08-17T02:46:24.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.095+0000 7fb135000640 1 -- 172.21.15.100:0/632806064 shutdown_connections 2024-08-17T02:46:24.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.095+0000 7fb135000640 1 --2- 172.21.15.100:0/632806064 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb110065150 0x7fb110067600 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.095+0000 7fb135000640 1 --2- 172.21.15.100:0/632806064 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb130158fa0 0x7fb1301515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.095+0000 7fb135000640 1 --2- 172.21.15.100:0/632806064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1300aa7d0 0x7fb1300690f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.095+0000 7fb135000640 1 --2- 172.21.15.100:0/632806064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb13006da20 0x7fb13006a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.095+0000 7fb135000640 1 -- 172.21.15.100:0/632806064 >> 172.21.15.100:0/632806064 conn(0x7fb1300cb9b0 msgr2=0x7fb1301560e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:24.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.095+0000 7fb135000640 1 -- 172.21.15.100:0/632806064 shutdown_connections 2024-08-17T02:46:24.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.095+0000 7fb135000640 1 -- 172.21.15.100:0/632806064 wait complete. 2024-08-17T02:46:24.114 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-17T02:46:24.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.261+0000 7f3df3e00640 1 Processor -- start 2024-08-17T02:46:24.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.262+0000 7f3df3e00640 1 -- start start 2024-08-17T02:46:24.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.263+0000 7f3df3e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3df4156ad0 0x7f3df40cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.263+0000 7f3df3e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3df4156ea0 0x7f3df406d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.263+0000 7f3df3e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df40caaf0 con 0x7f3df406dab0 2024-08-17T02:46:24.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.263+0000 7f3df3e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df40ca900 con 0x7f3df4156ea0 2024-08-17T02:46:24.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.263+0000 7f3df3e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df40cc560 con 0x7f3df4156ad0 2024-08-17T02:46:24.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.263+0000 7f3debe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3df4156ea0 0x7f3df406d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.263+0000 7f3debe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3df4156ea0 0x7f3df406d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33054/0 (socket says 172.21.15.100:33054) 2024-08-17T02:46:24.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.263+0000 7f3debe00640 1 -- 172.21.15.100:0/3091419473 learned_addr learned my addr 172.21.15.100:0/3091419473 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:24.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.263+0000 7f3df2a00640 1 --2- 172.21.15.100:0/3091419473 >> v2:172.21.15.123:3300/0 conn(0x7f3df4156ad0 0x7f3df40cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.263+0000 7f3debe00640 1 -- 172.21.15.100:0/3091419473 >> v2:172.21.15.123:3300/0 conn(0x7f3df4156ad0 msgr2=0x7f3df40cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:24.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.263+0000 7f3debe00640 1 --2- 172.21.15.100:0/3091419473 >> v2:172.21.15.123:3300/0 conn(0x7f3df4156ad0 0x7f3df40cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.263+0000 7f3debe00640 1 -- 172.21.15.100:0/3091419473 >> v1:172.21.15.123:6789/0 conn(0x7f3df406dab0 legacy=0x7f3df40c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:24.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.264+0000 7f3debe00640 1 -- 172.21.15.100:0/3091419473 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df4157300 con 0x7f3df4156ea0 2024-08-17T02:46:24.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.264+0000 7f3debe00640 1 --2- 172.21.15.100:0/3091419473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3df4156ea0 0x7f3df406d570 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3df4065fd0 tx=0x7f3ddc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d658831542f2ab server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.265+0000 7f3df2000640 1 -- 172.21.15.100:0/3091419473 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc02ae60 con 0x7f3df4156ea0 2024-08-17T02:46:24.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.265+0000 7f3df2000640 1 -- 172.21.15.100:0/3091419473 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc032440 con 0x7f3df4156ea0 2024-08-17T02:46:24.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.265+0000 7f3df2000640 1 -- 172.21.15.100:0/3091419473 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0327e0 con 0x7f3df4156ea0 2024-08-17T02:46:24.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.265+0000 7f3df3e00640 1 -- 172.21.15.100:0/3091419473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3df4156ea0 msgr2=0x7f3df406d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.265+0000 7f3df3e00640 1 --2- 172.21.15.100:0/3091419473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3df4156ea0 0x7f3df406d570 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3df4065fd0 tx=0x7f3ddc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.265+0000 7f3df3e00640 1 -- 172.21.15.100:0/3091419473 shutdown_connections 2024-08-17T02:46:24.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.265+0000 7f3df3e00640 1 --2- 172.21.15.100:0/3091419473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3df4156ea0 0x7f3df406d570 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.265+0000 7f3df3e00640 1 --2- 172.21.15.100:0/3091419473 >> v2:172.21.15.123:3300/0 conn(0x7f3df4156ad0 0x7f3df40cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.265+0000 7f3df3e00640 1 -- 172.21.15.100:0/3091419473 >> 172.21.15.100:0/3091419473 conn(0x7f3df4067750 msgr2=0x7f3df40cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:24.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.265+0000 7f3df3e00640 1 -- 172.21.15.100:0/3091419473 shutdown_connections 2024-08-17T02:46:24.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.265+0000 7f3df3e00640 1 -- 172.21.15.100:0/3091419473 wait complete. 2024-08-17T02:46:24.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.267+0000 7f3df3e00640 1 Processor -- start 2024-08-17T02:46:24.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.267+0000 7f3df3e00640 1 -- start start 2024-08-17T02:46:24.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.268+0000 7f3df3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3df406dab0 0x7f3df4158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.268+0000 7f3df3e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3df4156ad0 0x7f3df414e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.268+0000 7f3df3e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3df4156ea0 0x7f3df406c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.268+0000 7f3df3e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df414ed50 con 0x7f3df406dab0 2024-08-17T02:46:24.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.268+0000 7f3df3e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df41501b0 con 0x7f3df4156ea0 2024-08-17T02:46:24.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.268+0000 7f3df3e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df414cdc0 con 0x7f3df4156ad0 2024-08-17T02:46:24.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.268+0000 7f3df2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3df406dab0 0x7f3df4158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.268+0000 7f3df2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3df406dab0 0x7f3df4158cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33070/0 (socket says 172.21.15.100:33070) 2024-08-17T02:46:24.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.268+0000 7f3df2a00640 1 -- 172.21.15.100:0/3536750022 learned_addr learned my addr 172.21.15.100:0/3536750022 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:24.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.268+0000 7f3df2a00640 1 -- 172.21.15.100:0/3536750022 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3df4156ad0 msgr2=0x7f3df414e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.268+0000 7f3debe00640 1 --2- 172.21.15.100:0/3536750022 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3df4156ad0 0x7f3df414e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.268+0000 7f3df3400640 1 --2- 172.21.15.100:0/3536750022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3df4156ea0 0x7f3df406c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.268+0000 7f3df2a00640 1 --2- 172.21.15.100:0/3536750022 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3df4156ad0 0x7f3df414e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.268+0000 7f3df2a00640 1 -- 172.21.15.100:0/3536750022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3df4156ea0 msgr2=0x7f3df406c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.268+0000 7f3df2a00640 1 --2- 172.21.15.100:0/3536750022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3df4156ea0 0x7f3df406c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.268+0000 7f3df2a00640 1 -- 172.21.15.100:0/3536750022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc009450 con 0x7f3df406dab0 2024-08-17T02:46:24.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.268+0000 7f3df3400640 1 --2- 172.21.15.100:0/3536750022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3df4156ea0 0x7f3df406c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:24.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.269+0000 7f3df2a00640 1 --2- 172.21.15.100:0/3536750022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3df406dab0 0x7f3df4158cb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3de400d890 tx=0x7f3de4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.269+0000 7f3dea000640 1 -- 172.21.15.100:0/3536750022 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de400de20 con 0x7f3df406dab0 2024-08-17T02:46:24.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.269+0000 7f3dea000640 1 -- 172.21.15.100:0/3536750022 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de400b8d0 con 0x7f3df406dab0 2024-08-17T02:46:24.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.269+0000 7f3df3e00640 1 -- 172.21.15.100:0/3536750022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df414d0a0 con 0x7f3df406dab0 2024-08-17T02:46:24.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.269+0000 7f3dea000640 1 -- 172.21.15.100:0/3536750022 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de400bc70 con 0x7f3df406dab0 2024-08-17T02:46:24.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.269+0000 7f3df3e00640 1 -- 172.21.15.100:0/3536750022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df414d660 con 0x7f3df406dab0 2024-08-17T02:46:24.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.270+0000 7f3df3e00640 1 -- 172.21.15.100:0/3536750022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df4071050 con 0x7f3df406dab0 2024-08-17T02:46:24.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.271+0000 7f3dea000640 1 -- 172.21.15.100:0/3536750022 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3de4014640 con 0x7f3df406dab0 2024-08-17T02:46:24.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.272+0000 7f3dea000640 1 --2- 172.21.15.100:0/3536750022 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3dd0065150 0x7f3dd0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.272+0000 7f3dea000640 1 -- 172.21.15.100:0/3536750022 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3de40827f0 con 0x7f3df406dab0 2024-08-17T02:46:24.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.272+0000 7f3debe00640 1 --2- 172.21.15.100:0/3536750022 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3dd0065150 0x7f3dd0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.272+0000 7f3debe00640 1 --2- 172.21.15.100:0/3536750022 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3dd0065150 0x7f3dd0067600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc034000 tx=0x7f3ddc032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.276+0000 7f3dea000640 1 -- 172.21.15.100:0/3536750022 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3de4050b60 con 0x7f3df406dab0 2024-08-17T02:46:24.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.509+0000 7f3df3e00640 1 -- 172.21.15.100:0/3536750022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f3df406f480 con 0x7f3df406dab0 2024-08-17T02:46:24.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.514+0000 7f3dea000640 1 -- 172.21.15.100:0/3536750022 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3de4054180 con 0x7f3df406dab0 2024-08-17T02:46:24.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.516+0000 7f3df3e00640 1 -- 172.21.15.100:0/3536750022 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3dd0065150 msgr2=0x7f3dd0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.516+0000 7f3df3e00640 1 --2- 172.21.15.100:0/3536750022 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3dd0065150 0x7f3dd0067600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc034000 tx=0x7f3ddc032000 comp rx=0 tx=0).stop 2024-08-17T02:46:24.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.516+0000 7f3df3e00640 1 -- 172.21.15.100:0/3536750022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3df406dab0 msgr2=0x7f3df4158cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.516+0000 7f3df3e00640 1 --2- 172.21.15.100:0/3536750022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3df406dab0 0x7f3df4158cb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3de400d890 tx=0x7f3de4008040 comp rx=0 tx=0).stop 2024-08-17T02:46:24.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.516+0000 7f3df3e00640 1 -- 172.21.15.100:0/3536750022 shutdown_connections 2024-08-17T02:46:24.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.516+0000 7f3df3e00640 1 --2- 172.21.15.100:0/3536750022 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3dd0065150 0x7f3dd0067600 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.516+0000 7f3df3e00640 1 --2- 172.21.15.100:0/3536750022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3df4156ea0 0x7f3df406c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.516+0000 7f3df3e00640 1 --2- 172.21.15.100:0/3536750022 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3df4156ad0 0x7f3df414e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.516+0000 7f3df3e00640 1 --2- 172.21.15.100:0/3536750022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3df406dab0 0x7f3df4158cb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.516+0000 7f3df3e00640 1 -- 172.21.15.100:0/3536750022 >> 172.21.15.100:0/3536750022 conn(0x7f3df4067750 msgr2=0x7f3df40699f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:24.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.516+0000 7f3df3e00640 1 -- 172.21.15.100:0/3536750022 shutdown_connections 2024-08-17T02:46:24.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.516+0000 7f3df3e00640 1 -- 172.21.15.100:0/3536750022 wait complete. 2024-08-17T02:46:24.531 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-17T02:46:24.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.681+0000 7f5410a00640 1 Processor -- start 2024-08-17T02:46:24.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.681+0000 7f5410a00640 1 -- start start 2024-08-17T02:46:24.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.682+0000 7f5410a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f540c159ca0 0x7f540c0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.682+0000 7f5410a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f540c0ca8a0 0x7f540c0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.682+0000 7f5410a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540c0ccf30 con 0x7f540c0ccad0 2024-08-17T02:46:24.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.682+0000 7f5410a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c0cd6e0 con 0x7f540c0ca8a0 2024-08-17T02:46:24.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.682+0000 7f5410a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c0cadc0 con 0x7f540c159ca0 2024-08-17T02:46:24.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.683+0000 7f5409e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f540c0ca8a0 0x7f540c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.683+0000 7f5409e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f540c0ca8a0 0x7f540c0cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33078/0 (socket says 172.21.15.100:33078) 2024-08-17T02:46:24.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.683+0000 7f5409e00640 1 -- 172.21.15.100:0/2024849624 learned_addr learned my addr 172.21.15.100:0/2024849624 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:24.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.683+0000 7f540a800640 1 --2- 172.21.15.100:0/2024849624 >> v2:172.21.15.123:3300/0 conn(0x7f540c159ca0 0x7f540c0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.683+0000 7f5409e00640 1 -- 172.21.15.100:0/2024849624 >> v2:172.21.15.123:3300/0 conn(0x7f540c159ca0 msgr2=0x7f540c0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:24.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.683+0000 7f5409e00640 1 --2- 172.21.15.100:0/2024849624 >> v2:172.21.15.123:3300/0 conn(0x7f540c159ca0 0x7f540c0ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.683+0000 7f5409e00640 1 -- 172.21.15.100:0/2024849624 >> v1:172.21.15.123:6789/0 conn(0x7f540c0ccad0 legacy=0x7f540c0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.683+0000 7f5409e00640 1 -- 172.21.15.100:0/2024849624 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c0cb060 con 0x7f540c0ca8a0 2024-08-17T02:46:24.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.685+0000 7f5409e00640 1 --2- 172.21.15.100:0/2024849624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f540c0ca8a0 0x7f540c0cc590 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f540c08a320 tx=0x7f53f80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c826a0739f644a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.685+0000 7f5409400640 1 -- 172.21.15.100:0/2024849624 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f802ae80 con 0x7f540c0ca8a0 2024-08-17T02:46:24.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.685+0000 7f5409400640 1 -- 172.21.15.100:0/2024849624 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f8032440 con 0x7f540c0ca8a0 2024-08-17T02:46:24.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.685+0000 7f5409400640 1 -- 172.21.15.100:0/2024849624 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f8032800 con 0x7f540c0ca8a0 2024-08-17T02:46:24.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.686+0000 7f5410a00640 1 -- 172.21.15.100:0/2024849624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f540c0ca8a0 msgr2=0x7f540c0cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.686+0000 7f5410a00640 1 --2- 172.21.15.100:0/2024849624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f540c0ca8a0 0x7f540c0cc590 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f540c08a320 tx=0x7f53f80091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.686+0000 7f5410a00640 1 -- 172.21.15.100:0/2024849624 shutdown_connections 2024-08-17T02:46:24.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.686+0000 7f5410a00640 1 --2- 172.21.15.100:0/2024849624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f540c0ca8a0 0x7f540c0cc590 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.686+0000 7f5410a00640 1 --2- 172.21.15.100:0/2024849624 >> v2:172.21.15.123:3300/0 conn(0x7f540c159ca0 0x7f540c0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.686+0000 7f5410a00640 1 -- 172.21.15.100:0/2024849624 >> 172.21.15.100:0/2024849624 conn(0x7f540c098e00 msgr2=0x7f540c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:24.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.686+0000 7f5410a00640 1 -- 172.21.15.100:0/2024849624 shutdown_connections 2024-08-17T02:46:24.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.686+0000 7f5410a00640 1 -- 172.21.15.100:0/2024849624 wait complete. 2024-08-17T02:46:24.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.688+0000 7f5410a00640 1 Processor -- start 2024-08-17T02:46:24.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.688+0000 7f5410a00640 1 -- start start 2024-08-17T02:46:24.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.689+0000 7f5410a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f540c0ca8a0 0x7f540c1552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.689+0000 7f5410a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f540c0ccad0 0x7f540c0c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.689+0000 7f5410a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f540c159ca0 0x7f540c156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.689+0000 7f5410a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0c8090 con 0x7f540c159ca0 2024-08-17T02:46:24.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.689+0000 7f5410a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c1557f0 con 0x7f540c0ca8a0 2024-08-17T02:46:24.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.689+0000 7f5410a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0c7480 con 0x7f540c0ccad0 2024-08-17T02:46:24.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.689+0000 7f540b200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f540c159ca0 0x7f540c156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.689+0000 7f540b200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f540c159ca0 0x7f540c156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33086/0 (socket says 172.21.15.100:33086) 2024-08-17T02:46:24.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.689+0000 7f540b200640 1 -- 172.21.15.100:0/1586054081 learned_addr learned my addr 172.21.15.100:0/1586054081 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:24.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.689+0000 7f540b200640 1 -- 172.21.15.100:0/1586054081 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f540c0ccad0 msgr2=0x7f540c0c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.689+0000 7f540b200640 1 --2- 172.21.15.100:0/1586054081 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f540c0ccad0 0x7f540c0c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.689+0000 7f540b200640 1 -- 172.21.15.100:0/1586054081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f540c0ca8a0 msgr2=0x7f540c1552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.689+0000 7f540a800640 1 --2- 172.21.15.100:0/1586054081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f540c0ca8a0 0x7f540c1552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.689+0000 7f540b200640 1 --2- 172.21.15.100:0/1586054081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f540c0ca8a0 0x7f540c1552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.689+0000 7f540b200640 1 -- 172.21.15.100:0/1586054081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f8009450 con 0x7f540c159ca0 2024-08-17T02:46:24.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.689+0000 7f540a800640 1 --2- 172.21.15.100:0/1586054081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f540c0ca8a0 0x7f540c1552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:24.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.690+0000 7f540b200640 1 --2- 172.21.15.100:0/1586054081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f540c159ca0 0x7f540c156df0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f540400c870 tx=0x7f5404001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.690+0000 7f5402000640 1 -- 172.21.15.100:0/1586054081 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540400ce60 con 0x7f540c159ca0 2024-08-17T02:46:24.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.690+0000 7f5402000640 1 -- 172.21.15.100:0/1586054081 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5404006b10 con 0x7f540c159ca0 2024-08-17T02:46:24.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.690+0000 7f5402000640 1 -- 172.21.15.100:0/1586054081 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540400a850 con 0x7f540c159ca0 2024-08-17T02:46:24.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.690+0000 7f5410a00640 1 -- 172.21.15.100:0/1586054081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540c0c7760 con 0x7f540c159ca0 2024-08-17T02:46:24.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.690+0000 7f5410a00640 1 -- 172.21.15.100:0/1586054081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540c0c7d20 con 0x7f540c159ca0 2024-08-17T02:46:24.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.691+0000 7f5410a00640 1 -- 172.21.15.100:0/1586054081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540c0cf720 con 0x7f540c159ca0 2024-08-17T02:46:24.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.692+0000 7f5402000640 1 -- 172.21.15.100:0/1586054081 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f540400ac80 con 0x7f540c159ca0 2024-08-17T02:46:24.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.693+0000 7f5402000640 1 --2- 172.21.15.100:0/1586054081 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f53ec065150 0x7f53ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.693+0000 7f5402000640 1 -- 172.21.15.100:0/1586054081 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5404081fe0 con 0x7f540c159ca0 2024-08-17T02:46:24.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.693+0000 7f540a800640 1 --2- 172.21.15.100:0/1586054081 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f53ec065150 0x7f53ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.693+0000 7f540a800640 1 --2- 172.21.15.100:0/1586054081 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f53ec065150 0x7f53ec067600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f53fc006e70 tx=0x7f53fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.696+0000 7f5402000640 1 -- 172.21.15.100:0/1586054081 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f540c0cf720 con 0x7f540c159ca0 2024-08-17T02:46:24.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.932+0000 7f5410a00640 1 -- 172.21.15.100:0/1586054081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f540c0cf720 con 0x7f540c159ca0 2024-08-17T02:46:24.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.936+0000 7f5402000640 1 -- 172.21.15.100:0/1586054081 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f540c0cf720 con 0x7f540c159ca0 2024-08-17T02:46:24.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.938+0000 7f5410a00640 1 -- 172.21.15.100:0/1586054081 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f53ec065150 msgr2=0x7f53ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.938+0000 7f5410a00640 1 --2- 172.21.15.100:0/1586054081 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f53ec065150 0x7f53ec067600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f53fc006e70 tx=0x7f53fc008040 comp rx=0 tx=0).stop 2024-08-17T02:46:24.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.938+0000 7f5410a00640 1 -- 172.21.15.100:0/1586054081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f540c159ca0 msgr2=0x7f540c156df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.938+0000 7f5410a00640 1 --2- 172.21.15.100:0/1586054081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f540c159ca0 0x7f540c156df0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f540400c870 tx=0x7f5404001690 comp rx=0 tx=0).stop 2024-08-17T02:46:24.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.938+0000 7f5410a00640 1 -- 172.21.15.100:0/1586054081 shutdown_connections 2024-08-17T02:46:24.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.938+0000 7f5410a00640 1 --2- 172.21.15.100:0/1586054081 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f53ec065150 0x7f53ec067600 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.938+0000 7f5410a00640 1 --2- 172.21.15.100:0/1586054081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f540c159ca0 0x7f540c156df0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.938+0000 7f5410a00640 1 --2- 172.21.15.100:0/1586054081 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f540c0ccad0 0x7f540c0c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.938+0000 7f5410a00640 1 --2- 172.21.15.100:0/1586054081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f540c0ca8a0 0x7f540c1552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.938+0000 7f5410a00640 1 -- 172.21.15.100:0/1586054081 >> 172.21.15.100:0/1586054081 conn(0x7f540c098e00 msgr2=0x7f540c158250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:24.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.939+0000 7f5410a00640 1 -- 172.21.15.100:0/1586054081 shutdown_connections 2024-08-17T02:46:24.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:24.939+0000 7f5410a00640 1 -- 172.21.15.100:0/1586054081 wait complete. 2024-08-17T02:46:24.954 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-17T02:46:25.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.110+0000 7fd8f9e00640 1 Processor -- start 2024-08-17T02:46:25.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.110+0000 7fd8f9e00640 1 -- start start 2024-08-17T02:46:25.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.111+0000 7fd8f9e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8f40af6d0 0x7fd8f40aa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.111+0000 7fd8f9e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd8f40ac820 0x7fd8f4159080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.111+0000 7fd8f9e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f40abc80 con 0x7fd8f4158cb0 2024-08-17T02:46:25.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.111+0000 7fd8f9e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f40aae50 con 0x7fd8f40ac820 2024-08-17T02:46:25.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.111+0000 7fd8f9e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40afb20 con 0x7fd8f40af6d0 2024-08-17T02:46:25.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.111+0000 7fd8f2a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd8f4158cb0 0x7fd8f40ac110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49540/0 (socket says 172.21.15.100:49540) 2024-08-17T02:46:25.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.111+0000 7fd8f2a00640 1 -- 172.21.15.100:0/3197094108 learned_addr learned my addr 172.21.15.100:0/3197094108 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:25.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.111+0000 7fd8f3400640 1 --2- 172.21.15.100:0/3197094108 >> v2:172.21.15.100:3300/0 conn(0x7fd8f40ac820 0x7fd8f4159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.112+0000 7fd8f2000640 1 --2- 172.21.15.100:0/3197094108 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8f40af6d0 0x7fd8f40aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.112+0000 7fd8f3400640 1 -- 172.21.15.100:0/3197094108 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8f40af6d0 msgr2=0x7fd8f40aa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:25.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.112+0000 7fd8f3400640 1 --2- 172.21.15.100:0/3197094108 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8f40af6d0 0x7fd8f40aa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.112+0000 7fd8f3400640 1 -- 172.21.15.100:0/3197094108 >> v1:172.21.15.100:6789/0 conn(0x7fd8f4158cb0 legacy=0x7fd8f40ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.112+0000 7fd8f3400640 1 -- 172.21.15.100:0/3197094108 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f40ab070 con 0x7fd8f40ac820 2024-08-17T02:46:25.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.113+0000 7fd8f3400640 1 --2- 172.21.15.100:0/3197094108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f40ac820 0x7fd8f4159080 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009e60 tx=0x7fd8ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e545fe27974d6b3b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.113+0000 7fd8f1600640 1 -- 172.21.15.100:0/3197094108 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec007550 con 0x7fd8f40ac820 2024-08-17T02:46:25.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.113+0000 7fd8f1600640 1 -- 172.21.15.100:0/3197094108 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec02d050 con 0x7fd8f40ac820 2024-08-17T02:46:25.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.113+0000 7fd8f1600640 1 -- 172.21.15.100:0/3197094108 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec007920 con 0x7fd8f40ac820 2024-08-17T02:46:25.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.114+0000 7fd8f9e00640 1 -- 172.21.15.100:0/3197094108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f40ac820 msgr2=0x7fd8f4159080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.114+0000 7fd8f9e00640 1 --2- 172.21.15.100:0/3197094108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f40ac820 0x7fd8f4159080 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009e60 tx=0x7fd8ec009780 comp rx=0 tx=0).stop 2024-08-17T02:46:25.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.114+0000 7fd8f9e00640 1 -- 172.21.15.100:0/3197094108 shutdown_connections 2024-08-17T02:46:25.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.114+0000 7fd8f9e00640 1 --2- 172.21.15.100:0/3197094108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f40ac820 0x7fd8f4159080 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.114+0000 7fd8f9e00640 1 --2- 172.21.15.100:0/3197094108 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8f40af6d0 0x7fd8f40aa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.114+0000 7fd8f9e00640 1 -- 172.21.15.100:0/3197094108 >> 172.21.15.100:0/3197094108 conn(0x7fd8f4096a70 msgr2=0x7fd8f4096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:25.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.114+0000 7fd8f9e00640 1 -- 172.21.15.100:0/3197094108 shutdown_connections 2024-08-17T02:46:25.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.114+0000 7fd8f9e00640 1 -- 172.21.15.100:0/3197094108 wait complete. 2024-08-17T02:46:25.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.115+0000 7fd8f9e00640 1 Processor -- start 2024-08-17T02:46:25.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.116+0000 7fd8f9e00640 1 -- start start 2024-08-17T02:46:25.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.116+0000 7fd8f9e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8f40ac820 0x7fd8f4154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.116+0000 7fd8f9e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8f40af6d0 0x7fd8f4168b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.116+0000 7fd8f9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f4158cb0 0x7fd8f40c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.116+0000 7fd8f9e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f4099c90 con 0x7fd8f4158cb0 2024-08-17T02:46:25.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.116+0000 7fd8f9e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f4097ab0 con 0x7fd8f40ac820 2024-08-17T02:46:25.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.116+0000 7fd8f9e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f4097d90 con 0x7fd8f40af6d0 2024-08-17T02:46:25.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.117+0000 7fd8f2000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8f40af6d0 0x7fd8f4168b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.117+0000 7fd8f2a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8f40ac820 0x7fd8f4154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.117+0000 7fd8f3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f4158cb0 0x7fd8f40c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.117+0000 7fd8f2000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8f40af6d0 0x7fd8f4168b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:53806/0 (socket says 172.21.15.100:53806) 2024-08-17T02:46:25.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.117+0000 7fd8f2000640 1 -- 172.21.15.100:0/2783925637 learned_addr learned my addr 172.21.15.100:0/2783925637 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:25.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.117+0000 7fd8f3400640 1 -- 172.21.15.100:0/2783925637 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8f40af6d0 msgr2=0x7fd8f4168b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.117+0000 7fd8f3400640 1 --2- 172.21.15.100:0/2783925637 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8f40af6d0 0x7fd8f4168b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.117+0000 7fd8f3400640 1 -- 172.21.15.100:0/2783925637 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8f40ac820 msgr2=0x7fd8f4154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.117+0000 7fd8f3400640 1 --2- 172.21.15.100:0/2783925637 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8f40ac820 0x7fd8f4154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.117+0000 7fd8f3400640 1 -- 172.21.15.100:0/2783925637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec009a20 con 0x7fd8f4158cb0 2024-08-17T02:46:25.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.118+0000 7fd8f3400640 1 --2- 172.21.15.100:0/2783925637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f4158cb0 0x7fd8f40c76f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec031000 tx=0x7fd8ec037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.118+0000 7fd8ea000640 1 -- 172.21.15.100:0/2783925637 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec0318b0 con 0x7fd8f4158cb0 2024-08-17T02:46:25.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.118+0000 7fd8ea000640 1 -- 172.21.15.100:0/2783925637 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec040070 con 0x7fd8f4158cb0 2024-08-17T02:46:25.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.118+0000 7fd8ea000640 1 -- 172.21.15.100:0/2783925637 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec031c80 con 0x7fd8f4158cb0 2024-08-17T02:46:25.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.118+0000 7fd8f9e00640 1 -- 172.21.15.100:0/2783925637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f4098070 con 0x7fd8f4158cb0 2024-08-17T02:46:25.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.118+0000 7fd8f9e00640 1 -- 172.21.15.100:0/2783925637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f4098630 con 0x7fd8f4158cb0 2024-08-17T02:46:25.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.119+0000 7fd8f9e00640 1 -- 172.21.15.100:0/2783925637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f4064db0 con 0x7fd8f4158cb0 2024-08-17T02:46:25.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.120+0000 7fd8ea000640 1 -- 172.21.15.100:0/2783925637 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd8ec042030 con 0x7fd8f4158cb0 2024-08-17T02:46:25.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.121+0000 7fd8ea000640 1 --2- 172.21.15.100:0/2783925637 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd8d4065150 0x7fd8d4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.121+0000 7fd8ea000640 1 -- 172.21.15.100:0/2783925637 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd8ec0a36d0 con 0x7fd8f4158cb0 2024-08-17T02:46:25.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.121+0000 7fd8f2a00640 1 --2- 172.21.15.100:0/2783925637 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd8d4065150 0x7fd8d4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.121+0000 7fd8f2a00640 1 --2- 172.21.15.100:0/2783925637 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd8d4065150 0x7fd8d4067600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40018c0 tx=0x7fd8e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.125+0000 7fd8ea000640 1 -- 172.21.15.100:0/2783925637 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd8ec071c50 con 0x7fd8f4158cb0 2024-08-17T02:46:25.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.357+0000 7fd8f9e00640 1 -- 172.21.15.100:0/2783925637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fd8f4070550 con 0x7fd8f4158cb0 2024-08-17T02:46:25.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.361+0000 7fd8ea000640 1 -- 172.21.15.100:0/2783925637 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd8ec075270 con 0x7fd8f4158cb0 2024-08-17T02:46:25.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.364+0000 7fd8f9e00640 1 -- 172.21.15.100:0/2783925637 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd8d4065150 msgr2=0x7fd8d4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.364+0000 7fd8f9e00640 1 --2- 172.21.15.100:0/2783925637 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd8d4065150 0x7fd8d4067600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40018c0 tx=0x7fd8e4009040 comp rx=0 tx=0).stop 2024-08-17T02:46:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.364+0000 7fd8f9e00640 1 -- 172.21.15.100:0/2783925637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f4158cb0 msgr2=0x7fd8f40c76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.364+0000 7fd8f9e00640 1 --2- 172.21.15.100:0/2783925637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f4158cb0 0x7fd8f40c76f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec031000 tx=0x7fd8ec037000 comp rx=0 tx=0).stop 2024-08-17T02:46:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.364+0000 7fd8f9e00640 1 -- 172.21.15.100:0/2783925637 shutdown_connections 2024-08-17T02:46:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.364+0000 7fd8f9e00640 1 --2- 172.21.15.100:0/2783925637 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd8d4065150 0x7fd8d4067600 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.364+0000 7fd8f9e00640 1 --2- 172.21.15.100:0/2783925637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f4158cb0 0x7fd8f40c76f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.364+0000 7fd8f9e00640 1 --2- 172.21.15.100:0/2783925637 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8f40af6d0 0x7fd8f4168b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.364+0000 7fd8f9e00640 1 --2- 172.21.15.100:0/2783925637 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8f40ac820 0x7fd8f4154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.364+0000 7fd8f9e00640 1 -- 172.21.15.100:0/2783925637 >> 172.21.15.100:0/2783925637 conn(0x7fd8f4096a70 msgr2=0x7fd8f41564d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:25.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.364+0000 7fd8f9e00640 1 -- 172.21.15.100:0/2783925637 shutdown_connections 2024-08-17T02:46:25.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.364+0000 7fd8f9e00640 1 -- 172.21.15.100:0/2783925637 wait complete. 2024-08-17T02:46:25.379 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-17T02:46:25.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.527+0000 7fb5f5a00640 1 Processor -- start 2024-08-17T02:46:25.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.527+0000 7fb5f5a00640 1 -- start start 2024-08-17T02:46:25.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.528+0000 7fb5f5a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb5f006da20 0x7fb5f006ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.528+0000 7fb5f5a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb5f00aa7d0 0x7fb5f0158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.528+0000 7fb5f5a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f00a9a10 con 0x7fb5f0158dd0 2024-08-17T02:46:25.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.528+0000 7fb5f5a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f00ac400 con 0x7fb5f00aa7d0 2024-08-17T02:46:25.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.528+0000 7fb5f5a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f00a9cf0 con 0x7fb5f006da20 2024-08-17T02:46:25.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.528+0000 7fb5ee000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb5f00aa7d0 0x7fb5f0158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.529+0000 7fb5ee000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb5f00aa7d0 0x7fb5f0158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33126/0 (socket says 172.21.15.100:33126) 2024-08-17T02:46:25.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.529+0000 7fb5ee000640 1 -- 172.21.15.100:0/2880838023 learned_addr learned my addr 172.21.15.100:0/2880838023 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:25.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.529+0000 7fb5eea00640 1 --2- 172.21.15.100:0/2880838023 >> v2:172.21.15.123:3300/0 conn(0x7fb5f006da20 0x7fb5f006ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.529+0000 7fb5ee000640 1 -- 172.21.15.100:0/2880838023 >> v2:172.21.15.123:3300/0 conn(0x7fb5f006da20 msgr2=0x7fb5f006ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:25.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.529+0000 7fb5ee000640 1 --2- 172.21.15.100:0/2880838023 >> v2:172.21.15.123:3300/0 conn(0x7fb5f006da20 0x7fb5f006ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.529+0000 7fb5ee000640 1 -- 172.21.15.100:0/2880838023 >> v1:172.21.15.123:6789/0 conn(0x7fb5f0158dd0 legacy=0x7fb5f00ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:25.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.529+0000 7fb5ee000640 1 -- 172.21.15.100:0/2880838023 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f00a9fd0 con 0x7fb5f00aa7d0 2024-08-17T02:46:25.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.530+0000 7fb5ee000640 1 --2- 172.21.15.100:0/2880838023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f00aa7d0 0x7fb5f0158890 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0068280 tx=0x7fb5dc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93fe4382640dae92 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.530+0000 7fb5ed600640 1 -- 172.21.15.100:0/2880838023 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc02add0 con 0x7fb5f00aa7d0 2024-08-17T02:46:25.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.530+0000 7fb5ed600640 1 -- 172.21.15.100:0/2880838023 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5dc032440 con 0x7fb5f00aa7d0 2024-08-17T02:46:25.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.530+0000 7fb5ed600640 1 -- 172.21.15.100:0/2880838023 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc032820 con 0x7fb5f00aa7d0 2024-08-17T02:46:25.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.531+0000 7fb5f5a00640 1 -- 172.21.15.100:0/2880838023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f00aa7d0 msgr2=0x7fb5f0158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.531+0000 7fb5f5a00640 1 --2- 172.21.15.100:0/2880838023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f00aa7d0 0x7fb5f0158890 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0068280 tx=0x7fb5dc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.531+0000 7fb5f5a00640 1 -- 172.21.15.100:0/2880838023 shutdown_connections 2024-08-17T02:46:25.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.531+0000 7fb5f5a00640 1 --2- 172.21.15.100:0/2880838023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f00aa7d0 0x7fb5f0158890 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.531+0000 7fb5f5a00640 1 --2- 172.21.15.100:0/2880838023 >> v2:172.21.15.123:3300/0 conn(0x7fb5f006da20 0x7fb5f006ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.531+0000 7fb5f5a00640 1 -- 172.21.15.100:0/2880838023 >> 172.21.15.100:0/2880838023 conn(0x7fb5f00cb9b0 msgr2=0x7fb5f00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:25.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.531+0000 7fb5f5a00640 1 -- 172.21.15.100:0/2880838023 shutdown_connections 2024-08-17T02:46:25.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.531+0000 7fb5f5a00640 1 -- 172.21.15.100:0/2880838023 wait complete. 2024-08-17T02:46:25.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.532+0000 7fb5f5a00640 1 Processor -- start 2024-08-17T02:46:25.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.532+0000 7fb5f5a00640 1 -- start start 2024-08-17T02:46:25.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.533+0000 7fb5f5a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f006da20 0x7fb5f0159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.533+0000 7fb5f5a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5f00aa7d0 0x7fb5f014a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.533+0000 7fb5f5a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb5f0158dd0 0x7fb5f00cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.533+0000 7fb5f5a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f015d0a0 con 0x7fb5f006da20 2024-08-17T02:46:25.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.533+0000 7fb5f5a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f00cb1a0 con 0x7fb5f00aa7d0 2024-08-17T02:46:25.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.533+0000 7fb5f5a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f015cdc0 con 0x7fb5f0158dd0 2024-08-17T02:46:25.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.534+0000 7fb5eea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f006da20 0x7fb5f0159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.534+0000 7fb5eea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f006da20 0x7fb5f0159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33134/0 (socket says 172.21.15.100:33134) 2024-08-17T02:46:25.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.534+0000 7fb5eea00640 1 -- 172.21.15.100:0/2730268390 learned_addr learned my addr 172.21.15.100:0/2730268390 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:25.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.534+0000 7fb5ee000640 1 --2- 172.21.15.100:0/2730268390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5f00aa7d0 0x7fb5f014a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.534+0000 7fb5ef400640 1 --2- 172.21.15.100:0/2730268390 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb5f0158dd0 0x7fb5f00cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.534+0000 7fb5eea00640 1 -- 172.21.15.100:0/2730268390 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb5f0158dd0 msgr2=0x7fb5f00cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.534+0000 7fb5eea00640 1 --2- 172.21.15.100:0/2730268390 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb5f0158dd0 0x7fb5f00cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.534+0000 7fb5eea00640 1 -- 172.21.15.100:0/2730268390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5f00aa7d0 msgr2=0x7fb5f014a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.534+0000 7fb5eea00640 1 --2- 172.21.15.100:0/2730268390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5f00aa7d0 0x7fb5f014a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.534+0000 7fb5eea00640 1 -- 172.21.15.100:0/2730268390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc009450 con 0x7fb5f006da20 2024-08-17T02:46:25.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.534+0000 7fb5eea00640 1 --2- 172.21.15.100:0/2730268390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f006da20 0x7fb5f0159470 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000d8c0 tx=0x7fb5e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.534+0000 7fb5e6000640 1 -- 172.21.15.100:0/2730268390 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e000de50 con 0x7fb5f006da20 2024-08-17T02:46:25.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.534+0000 7fb5e6000640 1 -- 172.21.15.100:0/2730268390 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e00098b0 con 0x7fb5f006da20 2024-08-17T02:46:25.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.534+0000 7fb5e6000640 1 -- 172.21.15.100:0/2730268390 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0009c50 con 0x7fb5f006da20 2024-08-17T02:46:25.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.534+0000 7fb5f5a00640 1 -- 172.21.15.100:0/2730268390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f00c8400 con 0x7fb5f006da20 2024-08-17T02:46:25.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.535+0000 7fb5f5a00640 1 -- 172.21.15.100:0/2730268390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f00c8a50 con 0x7fb5f006da20 2024-08-17T02:46:25.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.536+0000 7fb5f5a00640 1 -- 172.21.15.100:0/2730268390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f0064db0 con 0x7fb5f006da20 2024-08-17T02:46:25.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.537+0000 7fb5e6000640 1 -- 172.21.15.100:0/2730268390 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb5e0014410 con 0x7fb5f006da20 2024-08-17T02:46:25.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.537+0000 7fb5e6000640 1 --2- 172.21.15.100:0/2730268390 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb5d0065220 0x7fb5d00676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.537+0000 7fb5e6000640 1 -- 172.21.15.100:0/2730268390 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb5e00828f0 con 0x7fb5f006da20 2024-08-17T02:46:25.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.538+0000 7fb5ee000640 1 --2- 172.21.15.100:0/2730268390 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb5d0065220 0x7fb5d00676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.538+0000 7fb5ee000640 1 --2- 172.21.15.100:0/2730268390 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb5d0065220 0x7fb5d00676d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc034000 tx=0x7fb5dc032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.541+0000 7fb5e6000640 1 -- 172.21.15.100:0/2730268390 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb5e0050da0 con 0x7fb5f006da20 2024-08-17T02:46:25.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.779+0000 7fb5f5a00640 1 -- 172.21.15.100:0/2730268390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fb5f0068d90 con 0x7fb5f006da20 2024-08-17T02:46:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.783+0000 7fb5e6000640 1 -- 172.21.15.100:0/2730268390 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb5e00543c0 con 0x7fb5f006da20 2024-08-17T02:46:25.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.785+0000 7fb5f5a00640 1 -- 172.21.15.100:0/2730268390 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb5d0065220 msgr2=0x7fb5d00676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.785+0000 7fb5f5a00640 1 --2- 172.21.15.100:0/2730268390 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb5d0065220 0x7fb5d00676d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc034000 tx=0x7fb5dc032000 comp rx=0 tx=0).stop 2024-08-17T02:46:25.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.785+0000 7fb5f5a00640 1 -- 172.21.15.100:0/2730268390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f006da20 msgr2=0x7fb5f0159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.785+0000 7fb5f5a00640 1 --2- 172.21.15.100:0/2730268390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f006da20 0x7fb5f0159470 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000d8c0 tx=0x7fb5e0008040 comp rx=0 tx=0).stop 2024-08-17T02:46:25.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.785+0000 7fb5f5a00640 1 -- 172.21.15.100:0/2730268390 shutdown_connections 2024-08-17T02:46:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.785+0000 7fb5f5a00640 1 --2- 172.21.15.100:0/2730268390 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb5d0065220 0x7fb5d00676d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.785+0000 7fb5f5a00640 1 --2- 172.21.15.100:0/2730268390 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb5f0158dd0 0x7fb5f00cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.785+0000 7fb5f5a00640 1 --2- 172.21.15.100:0/2730268390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5f00aa7d0 0x7fb5f014a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.785+0000 7fb5f5a00640 1 --2- 172.21.15.100:0/2730268390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5f006da20 0x7fb5f0159470 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.785+0000 7fb5f5a00640 1 -- 172.21.15.100:0/2730268390 >> 172.21.15.100:0/2730268390 conn(0x7fb5f00cb9b0 msgr2=0x7fb5f00b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.785+0000 7fb5f5a00640 1 -- 172.21.15.100:0/2730268390 shutdown_connections 2024-08-17T02:46:25.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.786+0000 7fb5f5a00640 1 -- 172.21.15.100:0/2730268390 wait complete. 2024-08-17T02:46:25.801 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-17T02:46:25.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.948+0000 7fa29d200640 1 Processor -- start 2024-08-17T02:46:25.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.949+0000 7fa29d200640 1 -- start start 2024-08-17T02:46:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.950+0000 7fa29d200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa298155900 0x7fa298155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.950+0000 7fa29d200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa298158b30 0x7fa2980ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.950+0000 7fa29d200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa298157690 con 0x7fa2980b0270 2024-08-17T02:46:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.950+0000 7fa29d200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa298156a80 con 0x7fa298158b30 2024-08-17T02:46:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.950+0000 7fa29d200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa298156d60 con 0x7fa298155900 2024-08-17T02:46:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.950+0000 7fa297400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa298155900 0x7fa298155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.950+0000 7fa297e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa298158b30 0x7fa2980ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.950+0000 7fa297400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa298155900 0x7fa298155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:53818/0 (socket says 172.21.15.100:53818) 2024-08-17T02:46:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.950+0000 7fa297400640 1 -- 172.21.15.100:0/1369991716 learned_addr learned my addr 172.21.15.100:0/1369991716 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:25.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.951+0000 7fa297400640 1 -- 172.21.15.100:0/1369991716 >> v2:172.21.15.123:3300/0 conn(0x7fa298158b30 msgr2=0x7fa2980ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:25.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.951+0000 7fa297400640 1 --2- 172.21.15.100:0/1369991716 >> v2:172.21.15.123:3300/0 conn(0x7fa298158b30 0x7fa2980ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.951+0000 7fa297400640 1 -- 172.21.15.100:0/1369991716 >> v1:172.21.15.123:6789/0 conn(0x7fa2980b0270 legacy=0x7fa298156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.951+0000 7fa297400640 1 -- 172.21.15.100:0/1369991716 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa298157040 con 0x7fa298155900 2024-08-17T02:46:25.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.951+0000 7fa297e00640 1 --2- 172.21.15.100:0/1369991716 >> v2:172.21.15.123:3300/0 conn(0x7fa298158b30 0x7fa2980ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:25.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.952+0000 7fa297400640 1 --2- 172.21.15.100:0/1369991716 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa298155900 0x7fa298155cd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa288009910 tx=0x7fa2880091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1b2619185805b9c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.952+0000 7fa296a00640 1 -- 172.21.15.100:0/1369991716 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28802adb0 con 0x7fa298155900 2024-08-17T02:46:25.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.952+0000 7fa296a00640 1 -- 172.21.15.100:0/1369991716 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa288032440 con 0x7fa298155900 2024-08-17T02:46:25.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.952+0000 7fa296a00640 1 -- 172.21.15.100:0/1369991716 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2880327e0 con 0x7fa298155900 2024-08-17T02:46:25.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.953+0000 7fa29d200640 1 -- 172.21.15.100:0/1369991716 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa298155900 msgr2=0x7fa298155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.953+0000 7fa29d200640 1 --2- 172.21.15.100:0/1369991716 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa298155900 0x7fa298155cd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa288009910 tx=0x7fa2880091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.953+0000 7fa29d200640 1 -- 172.21.15.100:0/1369991716 shutdown_connections 2024-08-17T02:46:25.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.953+0000 7fa29d200640 1 --2- 172.21.15.100:0/1369991716 >> v2:172.21.15.123:3300/0 conn(0x7fa298158b30 0x7fa2980ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.953+0000 7fa29d200640 1 --2- 172.21.15.100:0/1369991716 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa298155900 0x7fa298155cd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.953+0000 7fa29d200640 1 -- 172.21.15.100:0/1369991716 >> 172.21.15.100:0/1369991716 conn(0x7fa298067750 msgr2=0x7fa2980cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:25.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.953+0000 7fa29d200640 1 -- 172.21.15.100:0/1369991716 shutdown_connections 2024-08-17T02:46:25.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.953+0000 7fa29d200640 1 -- 172.21.15.100:0/1369991716 wait complete. 2024-08-17T02:46:25.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.954+0000 7fa29d200640 1 Processor -- start 2024-08-17T02:46:25.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.954+0000 7fa29d200640 1 -- start start 2024-08-17T02:46:25.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.955+0000 7fa29d200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa2980b0270 0x7fa298144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.955+0000 7fa29d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa298155900 0x7fa298148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.955+0000 7fa29d200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa298158b30 0x7fa298147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.955+0000 7fa29d200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa298149660 con 0x7fa298155900 2024-08-17T02:46:25.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.955+0000 7fa29d200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa298146bf0 con 0x7fa298158b30 2024-08-17T02:46:25.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.955+0000 7fa29d200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2981462c0 con 0x7fa2980b0270 2024-08-17T02:46:25.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.955+0000 7fa28ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa298155900 0x7fa298148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.955+0000 7fa28ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa298155900 0x7fa298148d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33142/0 (socket says 172.21.15.100:33142) 2024-08-17T02:46:25.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.955+0000 7fa28ea00640 1 -- 172.21.15.100:0/991054718 learned_addr learned my addr 172.21.15.100:0/991054718 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:25.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.956+0000 7fa297400640 1 --2- 172.21.15.100:0/991054718 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa2980b0270 0x7fa298144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.956+0000 7fa297e00640 1 --2- 172.21.15.100:0/991054718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa298158b30 0x7fa298147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.956+0000 7fa28ea00640 1 -- 172.21.15.100:0/991054718 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa2980b0270 msgr2=0x7fa298144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.956+0000 7fa28ea00640 1 --2- 172.21.15.100:0/991054718 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa2980b0270 0x7fa298144550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.956+0000 7fa28ea00640 1 -- 172.21.15.100:0/991054718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa298158b30 msgr2=0x7fa298147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.956+0000 7fa28ea00640 1 --2- 172.21.15.100:0/991054718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa298158b30 0x7fa298147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.956+0000 7fa28ea00640 1 -- 172.21.15.100:0/991054718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa290009a20 con 0x7fa298155900 2024-08-17T02:46:25.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.956+0000 7fa28ea00640 1 --2- 172.21.15.100:0/991054718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa298155900 0x7fa298148d10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa28000c560 tx=0x7fa280007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.956+0000 7fa28f400640 1 -- 172.21.15.100:0/991054718 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280011590 con 0x7fa298155900 2024-08-17T02:46:25.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.956+0000 7fa28f400640 1 -- 172.21.15.100:0/991054718 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa280011710 con 0x7fa298155900 2024-08-17T02:46:25.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.956+0000 7fa29d200640 1 -- 172.21.15.100:0/991054718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa288009450 con 0x7fa298155900 2024-08-17T02:46:25.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.956+0000 7fa28f400640 1 -- 172.21.15.100:0/991054718 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280011ad0 con 0x7fa298155900 2024-08-17T02:46:25.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.957+0000 7fa29d200640 1 -- 172.21.15.100:0/991054718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa298146650 con 0x7fa298155900 2024-08-17T02:46:25.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.958+0000 7fa29d200640 1 -- 172.21.15.100:0/991054718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa298144b20 con 0x7fa298155900 2024-08-17T02:46:25.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.958+0000 7fa28f400640 1 -- 172.21.15.100:0/991054718 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa28001b3b0 con 0x7fa298155900 2024-08-17T02:46:25.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.960+0000 7fa28f400640 1 --2- 172.21.15.100:0/991054718 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa274065150 0x7fa274067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.960+0000 7fa28f400640 1 -- 172.21.15.100:0/991054718 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa2800816a0 con 0x7fa298155900 2024-08-17T02:46:25.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.960+0000 7fa297400640 1 --2- 172.21.15.100:0/991054718 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa274065150 0x7fa274067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.960+0000 7fa297400640 1 --2- 172.21.15.100:0/991054718 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa274065150 0x7fa274067600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa288009910 tx=0x7fa288032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:25.964+0000 7fa28f400640 1 -- 172.21.15.100:0/991054718 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa28004fab0 con 0x7fa298155900 2024-08-17T02:46:26.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.203+0000 7fa29d200640 1 -- 172.21.15.100:0/991054718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fa298071050 con 0x7fa298155900 2024-08-17T02:46:26.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.207+0000 7fa28f400640 1 -- 172.21.15.100:0/991054718 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa280017020 con 0x7fa298155900 2024-08-17T02:46:26.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.209+0000 7fa29d200640 1 -- 172.21.15.100:0/991054718 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa274065150 msgr2=0x7fa274067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.209+0000 7fa29d200640 1 --2- 172.21.15.100:0/991054718 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa274065150 0x7fa274067600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa288009910 tx=0x7fa288032000 comp rx=0 tx=0).stop 2024-08-17T02:46:26.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.209+0000 7fa29d200640 1 -- 172.21.15.100:0/991054718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa298155900 msgr2=0x7fa298148d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.209+0000 7fa29d200640 1 --2- 172.21.15.100:0/991054718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa298155900 0x7fa298148d10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa28000c560 tx=0x7fa280007ef0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.209+0000 7fa29d200640 1 -- 172.21.15.100:0/991054718 shutdown_connections 2024-08-17T02:46:26.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.209+0000 7fa29d200640 1 --2- 172.21.15.100:0/991054718 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa274065150 0x7fa274067600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.209+0000 7fa29d200640 1 --2- 172.21.15.100:0/991054718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa298158b30 0x7fa298147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.209+0000 7fa29d200640 1 --2- 172.21.15.100:0/991054718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa298155900 0x7fa298148d10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.209+0000 7fa29d200640 1 --2- 172.21.15.100:0/991054718 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa2980b0270 0x7fa298144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.209+0000 7fa29d200640 1 -- 172.21.15.100:0/991054718 >> 172.21.15.100:0/991054718 conn(0x7fa298067750 msgr2=0x7fa2980af8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:26.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.209+0000 7fa29d200640 1 -- 172.21.15.100:0/991054718 shutdown_connections 2024-08-17T02:46:26.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.209+0000 7fa29d200640 1 -- 172.21.15.100:0/991054718 wait complete. 2024-08-17T02:46:26.225 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-17T02:46:26.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.371+0000 7f275c000640 1 Processor -- start 2024-08-17T02:46:26.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.371+0000 7f275c000640 1 -- start start 2024-08-17T02:46:26.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.372+0000 7f275c000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f275406da20 0x7f275406ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.372+0000 7f275c000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f27540aa7d0 0x7f2754158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.373+0000 7f275c000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27540a9a10 con 0x7f2754158dd0 2024-08-17T02:46:26.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.373+0000 7f275c000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27540ac400 con 0x7f27540aa7d0 2024-08-17T02:46:26.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.373+0000 7f275c000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27540a9cf0 con 0x7f275406da20 2024-08-17T02:46:26.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.373+0000 7f2758c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f27540aa7d0 0x7f2754158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.373+0000 7f275a000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2754158dd0 0x7f27540ab6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49548/0 (socket says 172.21.15.100:49548) 2024-08-17T02:46:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.373+0000 7f275a000640 1 -- 172.21.15.100:0/453771844 learned_addr learned my addr 172.21.15.100:0/453771844 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.373+0000 7f2759600640 1 --2- 172.21.15.100:0/453771844 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f275406da20 0x7f275406ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.373+0000 7f2758c00640 1 -- 172.21.15.100:0/453771844 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f275406da20 msgr2=0x7f275406ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.373+0000 7f2758c00640 1 --2- 172.21.15.100:0/453771844 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f275406da20 0x7f275406ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.373+0000 7f2758c00640 1 -- 172.21.15.100:0/453771844 >> v1:172.21.15.100:6789/0 conn(0x7f2754158dd0 legacy=0x7f27540ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.373+0000 7f2758c00640 1 -- 172.21.15.100:0/453771844 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27540a9fd0 con 0x7f27540aa7d0 2024-08-17T02:46:26.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.374+0000 7f2758c00640 1 --2- 172.21.15.100:0/453771844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27540aa7d0 0x7f2754158890 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2740009850 tx=0x7f27400090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9d648239f15972 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:26.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.375+0000 7f2753e00640 1 -- 172.21.15.100:0/453771844 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274002ad00 con 0x7f27540aa7d0 2024-08-17T02:46:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.375+0000 7f2753e00640 1 -- 172.21.15.100:0/453771844 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274002ae60 con 0x7f27540aa7d0 2024-08-17T02:46:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.375+0000 7f2753e00640 1 -- 172.21.15.100:0/453771844 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740032670 con 0x7f27540aa7d0 2024-08-17T02:46:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.375+0000 7f275c000640 1 -- 172.21.15.100:0/453771844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27540aa7d0 msgr2=0x7f2754158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.375+0000 7f275c000640 1 --2- 172.21.15.100:0/453771844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27540aa7d0 0x7f2754158890 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2740009850 tx=0x7f27400090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.375+0000 7f275c000640 1 -- 172.21.15.100:0/453771844 shutdown_connections 2024-08-17T02:46:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.375+0000 7f275c000640 1 --2- 172.21.15.100:0/453771844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27540aa7d0 0x7f2754158890 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.375+0000 7f275c000640 1 --2- 172.21.15.100:0/453771844 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f275406da20 0x7f275406ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.375+0000 7f275c000640 1 -- 172.21.15.100:0/453771844 >> 172.21.15.100:0/453771844 conn(0x7f27540cb9b0 msgr2=0x7f27540cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.375+0000 7f275c000640 1 -- 172.21.15.100:0/453771844 shutdown_connections 2024-08-17T02:46:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.375+0000 7f275c000640 1 -- 172.21.15.100:0/453771844 wait complete. 2024-08-17T02:46:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.377+0000 7f275c000640 1 Processor -- start 2024-08-17T02:46:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.377+0000 7f275c000640 1 -- start start 2024-08-17T02:46:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.378+0000 7f275c000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f275406da20 0x7f275414a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.378+0000 7f275c000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27540aa7d0 0x7f27541594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.378+0000 7f275c000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2754158dd0 0x7f27541554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.378+0000 7f275c000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275415a800 con 0x7f27540aa7d0 2024-08-17T02:46:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.378+0000 7f275c000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275414aa30 con 0x7f275406da20 2024-08-17T02:46:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.378+0000 7f275c000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275415ac70 con 0x7f2754158dd0 2024-08-17T02:46:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.378+0000 7f2758c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27540aa7d0 0x7f27541594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.378+0000 7f2758c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27540aa7d0 0x7f27541594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33164/0 (socket says 172.21.15.100:33164) 2024-08-17T02:46:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.378+0000 7f2758c00640 1 -- 172.21.15.100:0/2312830907 learned_addr learned my addr 172.21.15.100:0/2312830907 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.378+0000 7f275a000640 1 --2- 172.21.15.100:0/2312830907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2754158dd0 0x7f27541554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.378+0000 7f2759600640 1 --2- 172.21.15.100:0/2312830907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f275406da20 0x7f275414a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.378+0000 7f2758c00640 1 -- 172.21.15.100:0/2312830907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2754158dd0 msgr2=0x7f27541554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.378+0000 7f2758c00640 1 --2- 172.21.15.100:0/2312830907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2754158dd0 0x7f27541554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.378+0000 7f2758c00640 1 -- 172.21.15.100:0/2312830907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f275406da20 msgr2=0x7f275414a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.378+0000 7f2758c00640 1 --2- 172.21.15.100:0/2312830907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f275406da20 0x7f275414a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.378+0000 7f2758c00640 1 -- 172.21.15.100:0/2312830907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2740009390 con 0x7f27540aa7d0 2024-08-17T02:46:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.378+0000 7f2759600640 1 --2- 172.21.15.100:0/2312830907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f275406da20 0x7f275414a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.379+0000 7f2758c00640 1 --2- 172.21.15.100:0/2312830907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27540aa7d0 0x7f27541594a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2740009850 tx=0x7f2740032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.379+0000 7f2750c00640 1 -- 172.21.15.100:0/2312830907 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274003b6e0 con 0x7f27540aa7d0 2024-08-17T02:46:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.379+0000 7f2750c00640 1 -- 172.21.15.100:0/2312830907 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274003b840 con 0x7f27540aa7d0 2024-08-17T02:46:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.379+0000 7f2750c00640 1 -- 172.21.15.100:0/2312830907 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274003bbe0 con 0x7f27540aa7d0 2024-08-17T02:46:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.379+0000 7f275c000640 1 -- 172.21.15.100:0/2312830907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275414c100 con 0x7f27540aa7d0 2024-08-17T02:46:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.379+0000 7f275c000640 1 -- 172.21.15.100:0/2312830907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2754169430 con 0x7f27540aa7d0 2024-08-17T02:46:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.380+0000 7f275c000640 1 -- 172.21.15.100:0/2312830907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2754064db0 con 0x7f27540aa7d0 2024-08-17T02:46:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.381+0000 7f2750c00640 1 -- 172.21.15.100:0/2312830907 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2740043030 con 0x7f27540aa7d0 2024-08-17T02:46:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.382+0000 7f2750c00640 1 --2- 172.21.15.100:0/2312830907 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f2734065150 0x7f2734067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.382+0000 7f2750c00640 1 -- 172.21.15.100:0/2312830907 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2740041070 con 0x7f27540aa7d0 2024-08-17T02:46:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.382+0000 7f2759600640 1 --2- 172.21.15.100:0/2312830907 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f2734065150 0x7f2734067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.383+0000 7f2759600640 1 --2- 172.21.15.100:0/2312830907 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f2734065150 0x7f2734067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2748009cf0 tx=0x7f2748008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:26.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.386+0000 7f2750c00640 1 -- 172.21.15.100:0/2312830907 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2740070e50 con 0x7f27540aa7d0 2024-08-17T02:46:26.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.617+0000 7f275c000640 1 -- 172.21.15.100:0/2312830907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f2754159f60 con 0x7f27540aa7d0 2024-08-17T02:46:26.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.621+0000 7f2750c00640 1 -- 172.21.15.100:0/2312830907 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f27400370a0 con 0x7f27540aa7d0 2024-08-17T02:46:26.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.624+0000 7f275c000640 1 -- 172.21.15.100:0/2312830907 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f2734065150 msgr2=0x7f2734067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.624+0000 7f275c000640 1 --2- 172.21.15.100:0/2312830907 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f2734065150 0x7f2734067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2748009cf0 tx=0x7f2748008040 comp rx=0 tx=0).stop 2024-08-17T02:46:26.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.624+0000 7f275c000640 1 -- 172.21.15.100:0/2312830907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27540aa7d0 msgr2=0x7f27541594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.624+0000 7f275c000640 1 --2- 172.21.15.100:0/2312830907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27540aa7d0 0x7f27541594a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2740009850 tx=0x7f2740032000 comp rx=0 tx=0).stop 2024-08-17T02:46:26.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.624+0000 7f275c000640 1 -- 172.21.15.100:0/2312830907 shutdown_connections 2024-08-17T02:46:26.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.624+0000 7f275c000640 1 --2- 172.21.15.100:0/2312830907 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f2734065150 0x7f2734067600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.624+0000 7f275c000640 1 --2- 172.21.15.100:0/2312830907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2754158dd0 0x7f27541554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.624+0000 7f275c000640 1 --2- 172.21.15.100:0/2312830907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27540aa7d0 0x7f27541594a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.624+0000 7f275c000640 1 --2- 172.21.15.100:0/2312830907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f275406da20 0x7f275414a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.624+0000 7f275c000640 1 -- 172.21.15.100:0/2312830907 >> 172.21.15.100:0/2312830907 conn(0x7f27540cb9b0 msgr2=0x7f27540cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:26.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.624+0000 7f275c000640 1 -- 172.21.15.100:0/2312830907 shutdown_connections 2024-08-17T02:46:26.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.624+0000 7f275c000640 1 -- 172.21.15.100:0/2312830907 wait complete. 2024-08-17T02:46:26.640 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:26.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.787+0000 7f5cc9400640 1 Processor -- start 2024-08-17T02:46:26.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.787+0000 7f5cc9400640 1 -- start start 2024-08-17T02:46:26.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.788+0000 7f5cc9400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5cc41401b0 0x7f5cc40caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.788+0000 7f5cc9400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5cc40b1440 0x7f5cc40c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.788+0000 7f5cc9400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc40caa80 con 0x7f5cc4140580 2024-08-17T02:46:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.788+0000 7f5cc9400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc40cb450 con 0x7f5cc41401b0 2024-08-17T02:46:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.788+0000 7f5cc9400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40c9e70 con 0x7f5cc40b1440 2024-08-17T02:46:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.788+0000 7f5cc2800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5cc41401b0 0x7f5cc40caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.788+0000 7f5cc2800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5cc41401b0 0x7f5cc40caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33166/0 (socket says 172.21.15.100:33166) 2024-08-17T02:46:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.788+0000 7f5cc2800640 1 -- 172.21.15.100:0/2399505706 learned_addr learned my addr 172.21.15.100:0/2399505706 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.789+0000 7f5cc2800640 1 -- 172.21.15.100:0/2399505706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5cc40b1440 msgr2=0x7f5cc40c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.789+0000 7f5cc3200640 1 --2- 172.21.15.100:0/2399505706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5cc40b1440 0x7f5cc40c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.789+0000 7f5cc2800640 1 --2- 172.21.15.100:0/2399505706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5cc40b1440 0x7f5cc40c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.789+0000 7f5cc2800640 1 -- 172.21.15.100:0/2399505706 >> v1:172.21.15.123:6789/0 conn(0x7f5cc4140580 legacy=0x7f5cc40b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.789+0000 7f5cc2800640 1 -- 172.21.15.100:0/2399505706 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc40ca150 con 0x7f5cc41401b0 2024-08-17T02:46:26.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.789+0000 7f5cc3200640 1 --2- 172.21.15.100:0/2399505706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5cc40b1440 0x7f5cc40c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.790+0000 7f5cc2800640 1 --2- 172.21.15.100:0/2399505706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cc41401b0 0x7f5cc40caf10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4009910 tx=0x7f5cb40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0691896a62d211 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.790+0000 7f5cc1400640 1 -- 172.21.15.100:0/2399505706 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb402ad40 con 0x7f5cc41401b0 2024-08-17T02:46:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.790+0000 7f5cc1400640 1 -- 172.21.15.100:0/2399505706 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb4032440 con 0x7f5cc41401b0 2024-08-17T02:46:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.790+0000 7f5cc1400640 1 -- 172.21.15.100:0/2399505706 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb402aea0 con 0x7f5cc41401b0 2024-08-17T02:46:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.791+0000 7f5cc9400640 1 -- 172.21.15.100:0/2399505706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cc41401b0 msgr2=0x7f5cc40caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.791+0000 7f5cc9400640 1 --2- 172.21.15.100:0/2399505706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cc41401b0 0x7f5cc40caf10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4009910 tx=0x7f5cb40091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.791+0000 7f5cc9400640 1 -- 172.21.15.100:0/2399505706 shutdown_connections 2024-08-17T02:46:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.791+0000 7f5cc9400640 1 --2- 172.21.15.100:0/2399505706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5cc40b1440 0x7f5cc40c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.791+0000 7f5cc9400640 1 --2- 172.21.15.100:0/2399505706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cc41401b0 0x7f5cc40caf10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.791+0000 7f5cc9400640 1 -- 172.21.15.100:0/2399505706 >> 172.21.15.100:0/2399505706 conn(0x7f5cc40cb9b0 msgr2=0x7f5cc40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:26.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.791+0000 7f5cc9400640 1 -- 172.21.15.100:0/2399505706 shutdown_connections 2024-08-17T02:46:26.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.791+0000 7f5cc9400640 1 -- 172.21.15.100:0/2399505706 wait complete. 2024-08-17T02:46:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.792+0000 7f5cc9400640 1 Processor -- start 2024-08-17T02:46:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.792+0000 7f5cc9400640 1 -- start start 2024-08-17T02:46:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.793+0000 7f5cc9400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5cc40b1440 0x7f5cc40af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.793+0000 7f5cc9400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cc41401b0 0x7f5cc4168f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.793+0000 7f5cc9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cc4140580 0x7f5cc40c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.793+0000 7f5cc9400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40c5d30 con 0x7f5cc4140580 2024-08-17T02:46:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.793+0000 7f5cc9400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40b01d0 con 0x7f5cc41401b0 2024-08-17T02:46:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.793+0000 7f5cc9400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40c5120 con 0x7f5cc40b1440 2024-08-17T02:46:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.793+0000 7f5cc3200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cc4140580 0x7f5cc40c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.793+0000 7f5cc3200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cc4140580 0x7f5cc40c61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33168/0 (socket says 172.21.15.100:33168) 2024-08-17T02:46:26.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.793+0000 7f5cc3200640 1 -- 172.21.15.100:0/1625367755 learned_addr learned my addr 172.21.15.100:0/1625367755 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.794+0000 7f5cc2800640 1 --2- 172.21.15.100:0/1625367755 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5cc40b1440 0x7f5cc40af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.794+0000 7f5cc1e00640 1 --2- 172.21.15.100:0/1625367755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cc41401b0 0x7f5cc4168f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.794+0000 7f5cc3200640 1 -- 172.21.15.100:0/1625367755 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5cc40b1440 msgr2=0x7f5cc40af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.794+0000 7f5cc3200640 1 --2- 172.21.15.100:0/1625367755 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5cc40b1440 0x7f5cc40af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.794+0000 7f5cc3200640 1 -- 172.21.15.100:0/1625367755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cc41401b0 msgr2=0x7f5cc4168f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.794+0000 7f5cc3200640 1 --2- 172.21.15.100:0/1625367755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cc41401b0 0x7f5cc4168f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.794+0000 7f5cc3200640 1 -- 172.21.15.100:0/1625367755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb4009450 con 0x7f5cc4140580 2024-08-17T02:46:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.794+0000 7f5cc3200640 1 --2- 172.21.15.100:0/1625367755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cc4140580 0x7f5cc40c61c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00a380 tx=0x7f5cbc0078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.794+0000 7f5cba000640 1 -- 172.21.15.100:0/1625367755 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc00d650 con 0x7f5cc4140580 2024-08-17T02:46:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.794+0000 7f5cba000640 1 -- 172.21.15.100:0/1625367755 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cbc00d7b0 con 0x7f5cc4140580 2024-08-17T02:46:26.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.794+0000 7f5cba000640 1 -- 172.21.15.100:0/1625367755 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc00db70 con 0x7f5cc4140580 2024-08-17T02:46:26.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.794+0000 7f5cc9400640 1 -- 172.21.15.100:0/1625367755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc40c5400 con 0x7f5cc4140580 2024-08-17T02:46:26.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.795+0000 7f5cc9400640 1 -- 172.21.15.100:0/1625367755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc40c59c0 con 0x7f5cc4140580 2024-08-17T02:46:26.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.796+0000 7f5cc9400640 1 -- 172.21.15.100:0/1625367755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc40c5ee0 con 0x7f5cc4140580 2024-08-17T02:46:26.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.796+0000 7f5cba000640 1 -- 172.21.15.100:0/1625367755 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5cbc01e3b0 con 0x7f5cc4140580 2024-08-17T02:46:26.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.797+0000 7f5cba000640 1 --2- 172.21.15.100:0/1625367755 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ca4065150 0x7f5ca4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.797+0000 7f5cba000640 1 -- 172.21.15.100:0/1625367755 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5cbc082b20 con 0x7f5cc4140580 2024-08-17T02:46:26.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.797+0000 7f5cc2800640 1 --2- 172.21.15.100:0/1625367755 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ca4065150 0x7f5ca4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.798+0000 7f5cc2800640 1 --2- 172.21.15.100:0/1625367755 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ca4065150 0x7f5ca4067600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4034000 tx=0x7f5cb4032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:26.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.801+0000 7f5cba000640 1 -- 172.21.15.100:0/1625367755 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5cc40c5ee0 con 0x7f5cc4140580 2024-08-17T02:46:26.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.976+0000 7f5cc9400640 1 -- 172.21.15.100:0/1625367755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cc40c5ee0 con 0x7f5cc4140580 2024-08-17T02:46:26.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.977+0000 7f5cba000640 1 -- 172.21.15.100:0/1625367755 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12182 (secure 0 0 0) 0x7f5cc40c5ee0 con 0x7f5cc4140580 2024-08-17T02:46:26.978 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:26.978 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":29,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:46:23.685237+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:26.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.979+0000 7f5cc9400640 1 -- 172.21.15.100:0/1625367755 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ca4065150 msgr2=0x7f5ca4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.979+0000 7f5cc9400640 1 --2- 172.21.15.100:0/1625367755 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ca4065150 0x7f5ca4067600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4034000 tx=0x7f5cb4032000 comp rx=0 tx=0).stop 2024-08-17T02:46:26.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.979+0000 7f5cc9400640 1 -- 172.21.15.100:0/1625367755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cc4140580 msgr2=0x7f5cc40c61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.979+0000 7f5cc9400640 1 --2- 172.21.15.100:0/1625367755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cc4140580 0x7f5cc40c61c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00a380 tx=0x7f5cbc0078d0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.979+0000 7f5cc9400640 1 -- 172.21.15.100:0/1625367755 shutdown_connections 2024-08-17T02:46:26.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.979+0000 7f5cc9400640 1 --2- 172.21.15.100:0/1625367755 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ca4065150 0x7f5ca4067600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.979+0000 7f5cc9400640 1 --2- 172.21.15.100:0/1625367755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cc4140580 0x7f5cc40c61c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.979+0000 7f5cc9400640 1 --2- 172.21.15.100:0/1625367755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cc41401b0 0x7f5cc4168f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.979+0000 7f5cc9400640 1 --2- 172.21.15.100:0/1625367755 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5cc40b1440 0x7f5cc40af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.979+0000 7f5cc9400640 1 -- 172.21.15.100:0/1625367755 >> 172.21.15.100:0/1625367755 conn(0x7f5cc40cb9b0 msgr2=0x7f5cc406d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:26.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.979+0000 7f5cc9400640 1 -- 172.21.15.100:0/1625367755 shutdown_connections 2024-08-17T02:46:26.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:26.979+0000 7f5cc9400640 1 -- 172.21.15.100:0/1625367755 wait complete. 2024-08-17T02:46:26.996 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:45:35.140990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:46:26.996 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.148+0000 7f3454600640 1 Processor -- start 2024-08-17T02:46:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.148+0000 7f3454600640 1 -- start start 2024-08-17T02:46:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.149+0000 7f3454600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f344c0aa880 0x7f344c0aac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.149+0000 7f3454600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f344c156f00 0x7f344c0ab190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.149+0000 7f3454600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f344c0aed80 con 0x7f344c0ad3b0 2024-08-17T02:46:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.149+0000 7f3454600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f344c0adf60 con 0x7f344c0aa880 2024-08-17T02:46:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.149+0000 7f3454600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344c0ab6d0 con 0x7f344c156f00 2024-08-17T02:46:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.149+0000 7f3452600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f344c0ad3b0 0x7f344c0ad850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42042/0 (socket says 172.21.15.100:42042) 2024-08-17T02:46:27.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.149+0000 7f3452600640 1 -- 172.21.15.100:0/51270677 learned_addr learned my addr 172.21.15.100:0/51270677 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:27.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.149+0000 7f3451200640 1 --2- 172.21.15.100:0/51270677 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f344c156f00 0x7f344c0ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.150+0000 7f3451c00640 1 --2- 172.21.15.100:0/51270677 >> v2:172.21.15.123:3300/0 conn(0x7f344c0aa880 0x7f344c0aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.150+0000 7f344be00640 1 -- 172.21.15.100:0/51270677 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747190518 0 0) 0x7f344c0aed80 con 0x7f344c0ad3b0 2024-08-17T02:46:27.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.150+0000 7f344be00640 1 -- 172.21.15.100:0/51270677 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34340034e0 con 0x7f344c0ad3b0 2024-08-17T02:46:27.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.150+0000 7f3451c00640 1 -- 172.21.15.100:0/51270677 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f344c156f00 msgr2=0x7f344c0ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:27.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.150+0000 7f3451c00640 1 --2- 172.21.15.100:0/51270677 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f344c156f00 0x7f344c0ab190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.150+0000 7f3451c00640 1 -- 172.21.15.100:0/51270677 >> v1:172.21.15.100:6789/0 conn(0x7f344c0ad3b0 legacy=0x7f344c0ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.150+0000 7f3451c00640 1 -- 172.21.15.100:0/51270677 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c0ae170 con 0x7f344c0aa880 2024-08-17T02:46:27.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.151+0000 7f3451c00640 1 --2- 172.21.15.100:0/51270677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f344c0aa880 0x7f344c0aac50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3440009850 tx=0x7f34400090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78aee61ae25018d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:27.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.152+0000 7f344be00640 1 -- 172.21.15.100:0/51270677 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344002ad00 con 0x7f344c0aa880 2024-08-17T02:46:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.152+0000 7f344be00640 1 -- 172.21.15.100:0/51270677 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344002ae60 con 0x7f344c0aa880 2024-08-17T02:46:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.152+0000 7f344be00640 1 -- 172.21.15.100:0/51270677 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440032650 con 0x7f344c0aa880 2024-08-17T02:46:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.152+0000 7f3454600640 1 -- 172.21.15.100:0/51270677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f344c0aa880 msgr2=0x7f344c0aac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.152+0000 7f3454600640 1 --2- 172.21.15.100:0/51270677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f344c0aa880 0x7f344c0aac50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3440009850 tx=0x7f34400090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.152+0000 7f3454600640 1 -- 172.21.15.100:0/51270677 shutdown_connections 2024-08-17T02:46:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.152+0000 7f3454600640 1 --2- 172.21.15.100:0/51270677 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f344c156f00 0x7f344c0ab190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.152+0000 7f3454600640 1 --2- 172.21.15.100:0/51270677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f344c0aa880 0x7f344c0aac50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.152+0000 7f3454600640 1 -- 172.21.15.100:0/51270677 >> 172.21.15.100:0/51270677 conn(0x7f344c096a70 msgr2=0x7f344c096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.152+0000 7f3454600640 1 -- 172.21.15.100:0/51270677 shutdown_connections 2024-08-17T02:46:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.152+0000 7f3454600640 1 -- 172.21.15.100:0/51270677 wait complete. 2024-08-17T02:46:27.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.154+0000 7f3454600640 1 Processor -- start 2024-08-17T02:46:27.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.154+0000 7f3454600640 1 -- start start 2024-08-17T02:46:27.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.154+0000 7f3454600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f344c0aa880 0x7f344c148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.155+0000 7f3454600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f344c0ad3b0 0x7f344c06c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.155+0000 7f3454600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f344c156f00 0x7f344c06c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.155+0000 7f3454600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c152a30 con 0x7f344c0ad3b0 2024-08-17T02:46:27.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.155+0000 7f3454600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c169270 con 0x7f344c0aa880 2024-08-17T02:46:27.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.155+0000 7f3454600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344c169550 con 0x7f344c156f00 2024-08-17T02:46:27.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.155+0000 7f3451200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f344c0ad3b0 0x7f344c06c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.155+0000 7f3451200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f344c0ad3b0 0x7f344c06c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44922/0 (socket says 172.21.15.100:44922) 2024-08-17T02:46:27.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.155+0000 7f3451200640 1 -- 172.21.15.100:0/3560822433 learned_addr learned my addr 172.21.15.100:0/3560822433 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.155+0000 7f3452600640 1 --2- 172.21.15.100:0/3560822433 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f344c156f00 0x7f344c06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.155+0000 7f3451c00640 1 --2- 172.21.15.100:0/3560822433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f344c0aa880 0x7f344c148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.155+0000 7f3451200640 1 -- 172.21.15.100:0/3560822433 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f344c156f00 msgr2=0x7f344c06c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.155+0000 7f3451200640 1 --2- 172.21.15.100:0/3560822433 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f344c156f00 0x7f344c06c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.155+0000 7f3451200640 1 -- 172.21.15.100:0/3560822433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f344c0aa880 msgr2=0x7f344c148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.155+0000 7f3451200640 1 --2- 172.21.15.100:0/3560822433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f344c0aa880 0x7f344c148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.155+0000 7f3451200640 1 -- 172.21.15.100:0/3560822433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3440009390 con 0x7f344c0ad3b0 2024-08-17T02:46:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.155+0000 7f3452600640 1 --2- 172.21.15.100:0/3560822433 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f344c156f00 0x7f344c06c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.155+0000 7f3451c00640 1 --2- 172.21.15.100:0/3560822433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f344c0aa880 0x7f344c148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.155+0000 7f3451200640 1 --2- 172.21.15.100:0/3560822433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f344c0ad3b0 0x7f344c06c050 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f343800e8d0 tx=0x7f34380090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.156+0000 7f3448c00640 1 -- 172.21.15.100:0/3560822433 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3438009480 con 0x7f344c0ad3b0 2024-08-17T02:46:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.156+0000 7f3448c00640 1 -- 172.21.15.100:0/3560822433 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343800c8e0 con 0x7f344c0ad3b0 2024-08-17T02:46:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.156+0000 7f3448c00640 1 -- 172.21.15.100:0/3560822433 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343800cca0 con 0x7f344c0ad3b0 2024-08-17T02:46:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.156+0000 7f3454600640 1 -- 172.21.15.100:0/3560822433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f344c169830 con 0x7f344c0ad3b0 2024-08-17T02:46:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.156+0000 7f3454600640 1 -- 172.21.15.100:0/3560822433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f344c168f70 con 0x7f344c0ad3b0 2024-08-17T02:46:27.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.157+0000 7f3454600640 1 -- 172.21.15.100:0/3560822433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344c064db0 con 0x7f344c0ad3b0 2024-08-17T02:46:27.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.158+0000 7f3448c00640 1 -- 172.21.15.100:0/3560822433 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3438013680 con 0x7f344c0ad3b0 2024-08-17T02:46:27.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.158+0000 7f3448c00640 1 --2- 172.21.15.100:0/3560822433 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f342c065150 0x7f342c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.159+0000 7f3448c00640 1 -- 172.21.15.100:0/3560822433 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3438082280 con 0x7f344c0ad3b0 2024-08-17T02:46:27.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.159+0000 7f3451c00640 1 --2- 172.21.15.100:0/3560822433 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f342c065150 0x7f342c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.159+0000 7f3451c00640 1 --2- 172.21.15.100:0/3560822433 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f342c065150 0x7f342c067600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3440034000 tx=0x7f3440032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:27.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.162+0000 7f3448c00640 1 -- 172.21.15.100:0/3560822433 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f34380505f0 con 0x7f344c0ad3b0 2024-08-17T02:46:27.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.334+0000 7f3454600640 1 -- 172.21.15.100:0/3560822433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f344c1566e0 con 0x7f344c0ad3b0 2024-08-17T02:46:27.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.334+0000 7f3448c00640 1 -- 172.21.15.100:0/3560822433 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3438053c10 con 0x7f344c0ad3b0 2024-08-17T02:46:27.335 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-08-17T02:46:27.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.336+0000 7f3454600640 1 -- 172.21.15.100:0/3560822433 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f342c065150 msgr2=0x7f342c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.336+0000 7f3454600640 1 --2- 172.21.15.100:0/3560822433 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f342c065150 0x7f342c067600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3440034000 tx=0x7f3440032000 comp rx=0 tx=0).stop 2024-08-17T02:46:27.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.336+0000 7f3454600640 1 -- 172.21.15.100:0/3560822433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f344c0ad3b0 msgr2=0x7f344c06c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.336+0000 7f3454600640 1 --2- 172.21.15.100:0/3560822433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f344c0ad3b0 0x7f344c06c050 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f343800e8d0 tx=0x7f34380090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.337+0000 7f3454600640 1 -- 172.21.15.100:0/3560822433 shutdown_connections 2024-08-17T02:46:27.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.337+0000 7f3454600640 1 --2- 172.21.15.100:0/3560822433 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f342c065150 0x7f342c067600 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.337+0000 7f3454600640 1 --2- 172.21.15.100:0/3560822433 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f344c156f00 0x7f344c06c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.337+0000 7f3454600640 1 --2- 172.21.15.100:0/3560822433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f344c0ad3b0 0x7f344c06c050 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.337+0000 7f3454600640 1 --2- 172.21.15.100:0/3560822433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f344c0aa880 0x7f344c148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.337+0000 7f3454600640 1 -- 172.21.15.100:0/3560822433 >> 172.21.15.100:0/3560822433 conn(0x7f344c096a70 msgr2=0x7f344c06ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:27.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.337+0000 7f3454600640 1 -- 172.21.15.100:0/3560822433 shutdown_connections 2024-08-17T02:46:27.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.337+0000 7f3454600640 1 -- 172.21.15.100:0/3560822433 wait complete. 2024-08-17T02:46:27.352 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:46:27.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.499+0000 7fbc83e00640 1 Processor -- start 2024-08-17T02:46:27.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.500+0000 7fbc83e00640 1 -- start start 2024-08-17T02:46:27.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.501+0000 7fbc83e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc840b0270 0x7fbc841563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.501+0000 7fbc83e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc84157690 con 0x7fbc84155900 2024-08-17T02:46:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.501+0000 7fbc83e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc84156a80 con 0x7fbc84158b30 2024-08-17T02:46:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.501+0000 7fbc83e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84156d60 con 0x7fbc840b0270 2024-08-17T02:46:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.501+0000 7fbc82a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fbc84155900 0x7fbc84155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42050/0 (socket says 172.21.15.100:42050) 2024-08-17T02:46:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.501+0000 7fbc82a00640 1 -- 172.21.15.100:0/2239705411 learned_addr learned my addr 172.21.15.100:0/2239705411 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.501+0000 7fbc82000640 1 --2- 172.21.15.100:0/2239705411 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc840b0270 0x7fbc841563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.502+0000 7fbc81600640 1 -- 172.21.15.100:0/2239705411 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246292143 0 0) 0x7fbc84157690 con 0x7fbc84155900 2024-08-17T02:46:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.502+0000 7fbc81600640 1 -- 172.21.15.100:0/2239705411 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc680034e0 con 0x7fbc84155900 2024-08-17T02:46:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.502+0000 7fbc81600640 1 -- 172.21.15.100:0/2239705411 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973163416 0 0) 0x7fbc84156a80 con 0x7fbc84158b30 2024-08-17T02:46:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.502+0000 7fbc81600640 1 -- 172.21.15.100:0/2239705411 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc84157690 con 0x7fbc84158b30 2024-08-17T02:46:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.502+0000 7fbc82000640 1 -- 172.21.15.100:0/2239705411 >> v1:172.21.15.123:6789/0 conn(0x7fbc84158b30 legacy=0x7fbc840ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.502+0000 7fbc82000640 1 -- 172.21.15.100:0/2239705411 >> v1:172.21.15.100:6789/0 conn(0x7fbc84155900 legacy=0x7fbc84155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.502+0000 7fbc82000640 1 -- 172.21.15.100:0/2239705411 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc84157040 con 0x7fbc840b0270 2024-08-17T02:46:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.503+0000 7fbc82000640 1 --2- 172.21.15.100:0/2239705411 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc840b0270 0x7fbc841563e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbc70009880 tx=0x7fbc700090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49163eb202848705 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.503+0000 7fbc81600640 1 -- 172.21.15.100:0/2239705411 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7002ad70 con 0x7fbc840b0270 2024-08-17T02:46:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.503+0000 7fbc81600640 1 -- 172.21.15.100:0/2239705411 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc70032440 con 0x7fbc840b0270 2024-08-17T02:46:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.503+0000 7fbc81600640 1 -- 172.21.15.100:0/2239705411 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc700327c0 con 0x7fbc840b0270 2024-08-17T02:46:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.504+0000 7fbc83e00640 1 -- 172.21.15.100:0/2239705411 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc840b0270 msgr2=0x7fbc841563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.504+0000 7fbc83e00640 1 --2- 172.21.15.100:0/2239705411 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc840b0270 0x7fbc841563e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbc70009880 tx=0x7fbc700090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.504+0000 7fbc83e00640 1 -- 172.21.15.100:0/2239705411 shutdown_connections 2024-08-17T02:46:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.504+0000 7fbc83e00640 1 --2- 172.21.15.100:0/2239705411 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc840b0270 0x7fbc841563e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.504+0000 7fbc83e00640 1 -- 172.21.15.100:0/2239705411 >> 172.21.15.100:0/2239705411 conn(0x7fbc84067750 msgr2=0x7fbc840cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.504+0000 7fbc83e00640 1 -- 172.21.15.100:0/2239705411 shutdown_connections 2024-08-17T02:46:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.504+0000 7fbc83e00640 1 -- 172.21.15.100:0/2239705411 wait complete. 2024-08-17T02:46:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.505+0000 7fbc83e00640 1 Processor -- start 2024-08-17T02:46:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.505+0000 7fbc83e00640 1 -- start start 2024-08-17T02:46:27.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.506+0000 7fbc83e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc840b0270 0x7fbc841687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.506+0000 7fbc83e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc84155900 0x7fbc840c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.506+0000 7fbc83e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc84158b30 0x7fbc840c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.506+0000 7fbc83e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8416a150 con 0x7fbc840b0270 2024-08-17T02:46:27.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.506+0000 7fbc83e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc840c15b0 con 0x7fbc84155900 2024-08-17T02:46:27.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.506+0000 7fbc83e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc840c1890 con 0x7fbc84158b30 2024-08-17T02:46:27.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.506+0000 7fbc82a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc840b0270 0x7fbc841687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.506+0000 7fbc82a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc840b0270 0x7fbc841687d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44934/0 (socket says 172.21.15.100:44934) 2024-08-17T02:46:27.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.506+0000 7fbc82a00640 1 -- 172.21.15.100:0/406741297 learned_addr learned my addr 172.21.15.100:0/406741297 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.507+0000 7fbc83400640 1 --2- 172.21.15.100:0/406741297 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc84158b30 0x7fbc840c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.507+0000 7fbc82000640 1 --2- 172.21.15.100:0/406741297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc84155900 0x7fbc840c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.507+0000 7fbc82a00640 1 -- 172.21.15.100:0/406741297 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc84158b30 msgr2=0x7fbc840c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.507+0000 7fbc82a00640 1 --2- 172.21.15.100:0/406741297 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc84158b30 0x7fbc840c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.507+0000 7fbc82a00640 1 -- 172.21.15.100:0/406741297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc84155900 msgr2=0x7fbc840c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.507+0000 7fbc82a00640 1 --2- 172.21.15.100:0/406741297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc84155900 0x7fbc840c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.507+0000 7fbc82a00640 1 -- 172.21.15.100:0/406741297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc70009390 con 0x7fbc840b0270 2024-08-17T02:46:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.507+0000 7fbc82000640 1 --2- 172.21.15.100:0/406741297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc84155900 0x7fbc840c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.507+0000 7fbc82a00640 1 --2- 172.21.15.100:0/406741297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc840b0270 0x7fbc841687d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbc74005840 tx=0x7fbc74007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.507+0000 7fbc7a000640 1 -- 172.21.15.100:0/406741297 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74005aa0 con 0x7fbc840b0270 2024-08-17T02:46:27.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.507+0000 7fbc7a000640 1 -- 172.21.15.100:0/406741297 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc74005c00 con 0x7fbc840b0270 2024-08-17T02:46:27.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.507+0000 7fbc7a000640 1 -- 172.21.15.100:0/406741297 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc740070f0 con 0x7fbc840b0270 2024-08-17T02:46:27.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.507+0000 7fbc83e00640 1 -- 172.21.15.100:0/406741297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc840c1b70 con 0x7fbc840b0270 2024-08-17T02:46:27.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.507+0000 7fbc83e00640 1 -- 172.21.15.100:0/406741297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc84168d10 con 0x7fbc840b0270 2024-08-17T02:46:27.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.508+0000 7fbc83e00640 1 -- 172.21.15.100:0/406741297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc840c1ff0 con 0x7fbc840b0270 2024-08-17T02:46:27.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.509+0000 7fbc7a000640 1 -- 172.21.15.100:0/406741297 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbc74007520 con 0x7fbc840b0270 2024-08-17T02:46:27.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.510+0000 7fbc7a000640 1 --2- 172.21.15.100:0/406741297 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbc64065150 0x7fbc64067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.510+0000 7fbc7a000640 1 -- 172.21.15.100:0/406741297 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbc74081c30 con 0x7fbc840b0270 2024-08-17T02:46:27.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.510+0000 7fbc82000640 1 --2- 172.21.15.100:0/406741297 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbc64065150 0x7fbc64067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.511+0000 7fbc82000640 1 --2- 172.21.15.100:0/406741297 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbc64065150 0x7fbc64067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbc70034000 tx=0x7fbc70032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:27.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.514+0000 7fbc7a000640 1 -- 172.21.15.100:0/406741297 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbc74050020 con 0x7fbc840b0270 2024-08-17T02:46:27.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.689+0000 7fbc83e00640 1 -- 172.21.15.100:0/406741297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbc84071050 con 0x7fbc840b0270 2024-08-17T02:46:27.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.689+0000 7fbc7a000640 1 -- 172.21.15.100:0/406741297 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7fbc74053640 con 0x7fbc840b0270 2024-08-17T02:46:27.690 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:27.690 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-08-17T02:46:27.690 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:27.690 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-08-17T02:46:27.690 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2024-08-17T02:46:27.691 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:27.691 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-08-17T02:46:27.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.691+0000 7fbc83e00640 1 -- 172.21.15.100:0/406741297 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbc64065150 msgr2=0x7fbc64067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.691+0000 7fbc83e00640 1 --2- 172.21.15.100:0/406741297 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbc64065150 0x7fbc64067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbc70034000 tx=0x7fbc70032000 comp rx=0 tx=0).stop 2024-08-17T02:46:27.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.691+0000 7fbc83e00640 1 -- 172.21.15.100:0/406741297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc840b0270 msgr2=0x7fbc841687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.691+0000 7fbc83e00640 1 --2- 172.21.15.100:0/406741297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc840b0270 0x7fbc841687d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbc74005840 tx=0x7fbc74007e10 comp rx=0 tx=0).stop 2024-08-17T02:46:27.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.691+0000 7fbc83e00640 1 -- 172.21.15.100:0/406741297 shutdown_connections 2024-08-17T02:46:27.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.691+0000 7fbc83e00640 1 --2- 172.21.15.100:0/406741297 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbc64065150 0x7fbc64067600 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.691+0000 7fbc83e00640 1 --2- 172.21.15.100:0/406741297 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc84158b30 0x7fbc840c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.691+0000 7fbc83e00640 1 --2- 172.21.15.100:0/406741297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc84155900 0x7fbc840c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.691+0000 7fbc83e00640 1 --2- 172.21.15.100:0/406741297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc840b0270 0x7fbc841687d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.691+0000 7fbc83e00640 1 -- 172.21.15.100:0/406741297 >> 172.21.15.100:0/406741297 conn(0x7fbc84067750 msgr2=0x7fbc840ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:27.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.692+0000 7fbc83e00640 1 -- 172.21.15.100:0/406741297 shutdown_connections 2024-08-17T02:46:27.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.692+0000 7fbc83e00640 1 -- 172.21.15.100:0/406741297 wait complete. 2024-08-17T02:46:27.707 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:46:27.708 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:46:27.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.858+0000 7fb477e00640 1 Processor -- start 2024-08-17T02:46:27.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.858+0000 7fb477e00640 1 -- start start 2024-08-17T02:46:27.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.859+0000 7fb477e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb47806df00 0x7fb47806e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.860+0000 7fb477e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4780acea0 con 0x7fb4780af940 2024-08-17T02:46:27.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.860+0000 7fb477e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4780ac870 con 0x7fb4780ab980 2024-08-17T02:46:27.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.860+0000 7fb477e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4780abe00 con 0x7fb47806df00 2024-08-17T02:46:27.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.860+0000 7fb476a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb47806df00 0x7fb47806e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.860+0000 7fb476a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb47806df00 0x7fb47806e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44948/0 (socket says 172.21.15.100:44948) 2024-08-17T02:46:27.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.860+0000 7fb476a00640 1 -- 172.21.15.100:0/2953045038 learned_addr learned my addr 172.21.15.100:0/2953045038 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:27.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.860+0000 7fb476a00640 1 -- 172.21.15.100:0/2953045038 >> v1:172.21.15.123:6789/0 conn(0x7fb4780ab980 legacy=0x7fb47815b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:27.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.860+0000 7fb476a00640 1 -- 172.21.15.100:0/2953045038 >> v1:172.21.15.100:6789/0 conn(0x7fb4780af940 legacy=0x7fb4780ab270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.860+0000 7fb476a00640 1 -- 172.21.15.100:0/2953045038 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4780afda0 con 0x7fb47806df00 2024-08-17T02:46:27.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.861+0000 7fb476a00640 1 --2- 172.21.15.100:0/2953045038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb47806df00 0x7fb47806e2d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb468009910 tx=0x7fb4680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594fe55933767a95 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:27.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.861+0000 7fb476000640 1 -- 172.21.15.100:0/2953045038 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46802ae60 con 0x7fb47806df00 2024-08-17T02:46:27.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.861+0000 7fb476000640 1 -- 172.21.15.100:0/2953045038 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb468032440 con 0x7fb47806df00 2024-08-17T02:46:27.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.861+0000 7fb476000640 1 -- 172.21.15.100:0/2953045038 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4680327e0 con 0x7fb47806df00 2024-08-17T02:46:27.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.862+0000 7fb477e00640 1 -- 172.21.15.100:0/2953045038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb47806df00 msgr2=0x7fb47806e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.862+0000 7fb477e00640 1 --2- 172.21.15.100:0/2953045038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb47806df00 0x7fb47806e2d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb468009910 tx=0x7fb4680091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.862+0000 7fb477e00640 1 -- 172.21.15.100:0/2953045038 shutdown_connections 2024-08-17T02:46:27.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.862+0000 7fb477e00640 1 --2- 172.21.15.100:0/2953045038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb47806df00 0x7fb47806e2d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.862+0000 7fb477e00640 1 -- 172.21.15.100:0/2953045038 >> 172.21.15.100:0/2953045038 conn(0x7fb478067750 msgr2=0x7fb47806c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:27.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.862+0000 7fb477e00640 1 -- 172.21.15.100:0/2953045038 shutdown_connections 2024-08-17T02:46:27.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.862+0000 7fb477e00640 1 -- 172.21.15.100:0/2953045038 wait complete. 2024-08-17T02:46:27.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.864+0000 7fb477e00640 1 Processor -- start 2024-08-17T02:46:27.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.864+0000 7fb477e00640 1 -- start start 2024-08-17T02:46:27.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.864+0000 7fb477e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb47806df00 0x7fb47814d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.865+0000 7fb477e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4780ab980 0x7fb47814ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.865+0000 7fb477e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4780af940 0x7fb478169580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.865+0000 7fb477e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47814f510 con 0x7fb4780af940 2024-08-17T02:46:27.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.865+0000 7fb477e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4781533c0 con 0x7fb4780ab980 2024-08-17T02:46:27.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.865+0000 7fb477e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4781536a0 con 0x7fb47806df00 2024-08-17T02:46:27.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.865+0000 7fb477400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4780af940 0x7fb478169580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.865+0000 7fb477400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4780af940 0x7fb478169580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44958/0 (socket says 172.21.15.100:44958) 2024-08-17T02:46:27.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.865+0000 7fb477400640 1 -- 172.21.15.100:0/4044191675 learned_addr learned my addr 172.21.15.100:0/4044191675 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:27.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.865+0000 7fb476a00640 1 --2- 172.21.15.100:0/4044191675 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb47806df00 0x7fb47814d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.865+0000 7fb46e000640 1 --2- 172.21.15.100:0/4044191675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4780ab980 0x7fb47814ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.865+0000 7fb477400640 1 -- 172.21.15.100:0/4044191675 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb47806df00 msgr2=0x7fb47814d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.865+0000 7fb477400640 1 --2- 172.21.15.100:0/4044191675 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb47806df00 0x7fb47814d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.865+0000 7fb477400640 1 -- 172.21.15.100:0/4044191675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4780ab980 msgr2=0x7fb47814ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.865+0000 7fb477400640 1 --2- 172.21.15.100:0/4044191675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4780ab980 0x7fb47814ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.865+0000 7fb477400640 1 -- 172.21.15.100:0/4044191675 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb468009450 con 0x7fb4780af940 2024-08-17T02:46:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.865+0000 7fb46e000640 1 --2- 172.21.15.100:0/4044191675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4780ab980 0x7fb47814ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.866+0000 7fb477400640 1 --2- 172.21.15.100:0/4044191675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4780af940 0x7fb478169580 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb47000b7f0 tx=0x7fb470009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.866+0000 7fb46ea00640 1 -- 172.21.15.100:0/4044191675 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47000c490 con 0x7fb4780af940 2024-08-17T02:46:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.866+0000 7fb46ea00640 1 -- 172.21.15.100:0/4044191675 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47000c5f0 con 0x7fb4780af940 2024-08-17T02:46:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.866+0000 7fb46ea00640 1 -- 172.21.15.100:0/4044191675 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47000c9f0 con 0x7fb4780af940 2024-08-17T02:46:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.866+0000 7fb477e00640 1 -- 172.21.15.100:0/4044191675 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb478153980 con 0x7fb4780af940 2024-08-17T02:46:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.866+0000 7fb477e00640 1 -- 172.21.15.100:0/4044191675 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47814f170 con 0x7fb4780af940 2024-08-17T02:46:27.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.867+0000 7fb477e00640 1 -- 172.21.15.100:0/4044191675 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb478071050 con 0x7fb4780af940 2024-08-17T02:46:27.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.868+0000 7fb46ea00640 1 -- 172.21.15.100:0/4044191675 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb470012070 con 0x7fb4780af940 2024-08-17T02:46:27.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.869+0000 7fb46ea00640 1 --2- 172.21.15.100:0/4044191675 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb454065150 0x7fb454067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.869+0000 7fb46ea00640 1 -- 172.21.15.100:0/4044191675 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb470081b10 con 0x7fb4780af940 2024-08-17T02:46:27.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.869+0000 7fb476a00640 1 --2- 172.21.15.100:0/4044191675 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb454065150 0x7fb454067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.869+0000 7fb476a00640 1 --2- 172.21.15.100:0/4044191675 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb454065150 0x7fb454067600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb468034000 tx=0x7fb468032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:27.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:27.872+0000 7fb46ea00640 1 -- 172.21.15.100:0/4044191675 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb47004fe80 con 0x7fb4780af940 2024-08-17T02:46:28.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.043+0000 7fb477e00640 1 -- 172.21.15.100:0/4044191675 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb4780b1200 con 0x7fb4780af940 2024-08-17T02:46:28.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.696+0000 7fb46ea00640 1 -- 172.21.15.100:0/4044191675 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb47001a020 con 0x7fb4780af940 2024-08-17T02:46:28.697 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2024-08-17T02:46:28.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.700+0000 7fb477e00640 1 -- 172.21.15.100:0/4044191675 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb454065150 msgr2=0x7fb454067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:28.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.700+0000 7fb477e00640 1 --2- 172.21.15.100:0/4044191675 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb454065150 0x7fb454067600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb468034000 tx=0x7fb468032000 comp rx=0 tx=0).stop 2024-08-17T02:46:28.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.700+0000 7fb477e00640 1 -- 172.21.15.100:0/4044191675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4780af940 msgr2=0x7fb478169580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:28.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.700+0000 7fb477e00640 1 --2- 172.21.15.100:0/4044191675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4780af940 0x7fb478169580 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb47000b7f0 tx=0x7fb470009840 comp rx=0 tx=0).stop 2024-08-17T02:46:28.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.700+0000 7fb477e00640 1 -- 172.21.15.100:0/4044191675 shutdown_connections 2024-08-17T02:46:28.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.700+0000 7fb477e00640 1 --2- 172.21.15.100:0/4044191675 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb454065150 0x7fb454067600 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.700+0000 7fb477e00640 1 --2- 172.21.15.100:0/4044191675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4780af940 0x7fb478169580 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.700+0000 7fb477e00640 1 --2- 172.21.15.100:0/4044191675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4780ab980 0x7fb47814ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.700+0000 7fb477e00640 1 --2- 172.21.15.100:0/4044191675 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb47806df00 0x7fb47814d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.700+0000 7fb477e00640 1 -- 172.21.15.100:0/4044191675 >> 172.21.15.100:0/4044191675 conn(0x7fb478067750 msgr2=0x7fb478068590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:28.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.701+0000 7fb477e00640 1 -- 172.21.15.100:0/4044191675 shutdown_connections 2024-08-17T02:46:28.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.701+0000 7fb477e00640 1 -- 172.21.15.100:0/4044191675 wait complete. 2024-08-17T02:46:28.721 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:46:28.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.880+0000 7f72b1200640 1 Processor -- start 2024-08-17T02:46:28.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.880+0000 7f72b1200640 1 -- start start 2024-08-17T02:46:28.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.881+0000 7f72b1200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72ac158d80 0x7f72ac15d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:28.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.881+0000 7f72b1200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f72ac0c9a50 0x7f72ac06a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:28.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.881+0000 7f72b1200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72ac15d180 con 0x7f72ac067700 2024-08-17T02:46:28.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.881+0000 7f72b1200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ac06a580 con 0x7f72ac0c9a50 2024-08-17T02:46:28.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.881+0000 7f72b1200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac067b50 con 0x7f72ac158d80 2024-08-17T02:46:28.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.881+0000 7f72a1400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f72ac067700 0x7f72ac0c9340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42064/0 (socket says 172.21.15.100:42064) 2024-08-17T02:46:28.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.881+0000 7f72a1400640 1 -- 172.21.15.100:0/665484849 learned_addr learned my addr 172.21.15.100:0/665484849 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:28.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.882+0000 7f72a9e00640 1 --2- 172.21.15.100:0/665484849 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72ac158d80 0x7f72ac15d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:28.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.882+0000 7f72aa800640 1 --2- 172.21.15.100:0/665484849 >> v2:172.21.15.123:3300/0 conn(0x7f72ac0c9a50 0x7f72ac06a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:28.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.882+0000 7f72a9400640 1 -- 172.21.15.100:0/665484849 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930553206 0 0) 0x7f72ac15d180 con 0x7f72ac067700 2024-08-17T02:46:28.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.882+0000 7f72a9400640 1 -- 172.21.15.100:0/665484849 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72900034e0 con 0x7f72ac067700 2024-08-17T02:46:28.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.882+0000 7f72a9400640 1 -- 172.21.15.100:0/665484849 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1808002036 0 0) 0x7f72900034e0 con 0x7f72ac067700 2024-08-17T02:46:28.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.882+0000 7f72a9400640 1 -- 172.21.15.100:0/665484849 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72ac158d80 msgr2=0x7f72ac15d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:28.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.882+0000 7f72a9400640 1 --2- 172.21.15.100:0/665484849 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72ac158d80 0x7f72ac15d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.882+0000 7f72a9400640 1 -- 172.21.15.100:0/665484849 >> v2:172.21.15.123:3300/0 conn(0x7f72ac0c9a50 msgr2=0x7f72ac06a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:28.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.882+0000 7f72a9400640 1 --2- 172.21.15.100:0/665484849 >> v2:172.21.15.123:3300/0 conn(0x7f72ac0c9a50 0x7f72ac06a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.882+0000 7f72a9400640 1 -- 172.21.15.100:0/665484849 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac06a790 con 0x7f72ac067700 2024-08-17T02:46:28.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.882+0000 7f72a9400640 1 -- 172.21.15.100:0/665484849 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1817143124 0 0) 0x7f7294001470 con 0x7f72ac067700 2024-08-17T02:46:28.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.882+0000 7f72a9400640 1 -- 172.21.15.100:0/665484849 >> v1:172.21.15.100:6789/0 conn(0x7f72ac067700 legacy=0x7f72ac0c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:28.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.882+0000 7f72a9400640 1 --2- 172.21.15.100:0/665484849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72900039d0 0x7f7290003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:28.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.882+0000 7f72a9400640 1 --2- 172.21.15.100:0/665484849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7290004780 0x7f7290004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:28.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.882+0000 7f72a9400640 1 --2- 172.21.15.100:0/665484849 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72ac158d80 0x7f7290005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:28.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.882+0000 7f72a9400640 1 -- 172.21.15.100:0/665484849 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac06a580 con 0x7f7290004780 2024-08-17T02:46:28.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.882+0000 7f72a9400640 1 -- 172.21.15.100:0/665484849 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac067b50 con 0x7f72900039d0 2024-08-17T02:46:28.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.882+0000 7f72a9400640 1 -- 172.21.15.100:0/665484849 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729000ba50 con 0x7f72ac158d80 2024-08-17T02:46:28.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.883+0000 7f72a1400640 1 --2- 172.21.15.100:0/665484849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7290004780 0x7f7290004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:28.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.883+0000 7f72aa800640 1 --2- 172.21.15.100:0/665484849 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72ac158d80 0x7f7290005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:28.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.883+0000 7f72a9e00640 1 --2- 172.21.15.100:0/665484849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72900039d0 0x7f7290003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:28.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.883+0000 7f72a1400640 1 -- 172.21.15.100:0/665484849 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72ac158d80 msgr2=0x7f7290005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:28.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.883+0000 7f72a1400640 1 --2- 172.21.15.100:0/665484849 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72ac158d80 0x7f7290005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.883+0000 7f72a1400640 1 -- 172.21.15.100:0/665484849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72900039d0 msgr2=0x7f7290003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:28.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.883+0000 7f72a1400640 1 --2- 172.21.15.100:0/665484849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72900039d0 0x7f7290003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.883+0000 7f72a1400640 1 -- 172.21.15.100:0/665484849 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72900034e0 con 0x7f7290004780 2024-08-17T02:46:28.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.883+0000 7f72a9e00640 1 --2- 172.21.15.100:0/665484849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72900039d0 0x7f7290003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:28.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.884+0000 7f72a1400640 1 --2- 172.21.15.100:0/665484849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7290004780 0x7f7290004bf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f729400c2a0 tx=0x7f7294001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839b4ae8823af33f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:28.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.884+0000 7f72a9400640 1 -- 172.21.15.100:0/665484849 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294005890 con 0x7f7290004780 2024-08-17T02:46:28.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.884+0000 7f72a9400640 1 -- 172.21.15.100:0/665484849 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7294005a30 con 0x7f7290004780 2024-08-17T02:46:28.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.884+0000 7f72a9400640 1 -- 172.21.15.100:0/665484849 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294005e30 con 0x7f7290004780 2024-08-17T02:46:28.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.885+0000 7f72b1200640 1 -- 172.21.15.100:0/665484849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7290004780 msgr2=0x7f7290004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:28.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.885+0000 7f72b1200640 1 --2- 172.21.15.100:0/665484849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7290004780 0x7f7290004bf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f729400c2a0 tx=0x7f7294001e90 comp rx=0 tx=0).stop 2024-08-17T02:46:28.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.885+0000 7f72aa800640 1 -- 172.21.15.100:0/665484849 reap_dead start 2024-08-17T02:46:28.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.885+0000 7f72b1200640 1 -- 172.21.15.100:0/665484849 shutdown_connections 2024-08-17T02:46:28.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.885+0000 7f72b1200640 1 -- 172.21.15.100:0/665484849 >> 172.21.15.100:0/665484849 conn(0x7f72ac0ccc50 msgr2=0x7f72ac0c8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:28.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.885+0000 7f72b1200640 1 -- 172.21.15.100:0/665484849 shutdown_connections 2024-08-17T02:46:28.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.885+0000 7f72b1200640 1 -- 172.21.15.100:0/665484849 wait complete. 2024-08-17T02:46:28.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.886+0000 7f72b1200640 1 Processor -- start 2024-08-17T02:46:28.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.886+0000 7f72b1200640 1 -- start start 2024-08-17T02:46:28.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.887+0000 7f72b1200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7290004780 0x7f72ac1567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:28.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.887+0000 7f72b1200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72ac159150 0x7f72ac096c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:28.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.887+0000 7f72b1200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72ac0971c0 0x7f72ac0c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:28.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.887+0000 7f72b1200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac0c71e0 con 0x7f72ac159150 2024-08-17T02:46:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.887+0000 7f72b1200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac097610 con 0x7f7290004780 2024-08-17T02:46:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.887+0000 7f72b1200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac0c6640 con 0x7f72ac0971c0 2024-08-17T02:46:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.887+0000 7f72a1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72ac159150 0x7f72ac096c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.888+0000 7f72a1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72ac159150 0x7f72ac096c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44978/0 (socket says 172.21.15.100:44978) 2024-08-17T02:46:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.888+0000 7f72a1400640 1 -- 172.21.15.100:0/452960370 learned_addr learned my addr 172.21.15.100:0/452960370 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.888+0000 7f72aa800640 1 --2- 172.21.15.100:0/452960370 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72ac0971c0 0x7f72ac0c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.888+0000 7f72a9e00640 1 --2- 172.21.15.100:0/452960370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7290004780 0x7f72ac1567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.888+0000 7f72a1400640 1 -- 172.21.15.100:0/452960370 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72ac0971c0 msgr2=0x7f72ac0c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.888+0000 7f72a1400640 1 --2- 172.21.15.100:0/452960370 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72ac0971c0 0x7f72ac0c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.888+0000 7f72a1400640 1 -- 172.21.15.100:0/452960370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7290004780 msgr2=0x7f72ac1567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.888+0000 7f72a1400640 1 --2- 172.21.15.100:0/452960370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7290004780 0x7f72ac1567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.888+0000 7f72a1400640 1 -- 172.21.15.100:0/452960370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac0c60e0 con 0x7f72ac159150 2024-08-17T02:46:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.888+0000 7f72a1400640 1 --2- 172.21.15.100:0/452960370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72ac159150 0x7f72ac096c80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7294007c40 tx=0x7f7294034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.888+0000 7f72a2000640 1 -- 172.21.15.100:0/452960370 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294001430 con 0x7f72ac159150 2024-08-17T02:46:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.889+0000 7f72a2000640 1 -- 172.21.15.100:0/452960370 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729403f460 con 0x7f72ac159150 2024-08-17T02:46:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.889+0000 7f72b1200640 1 -- 172.21.15.100:0/452960370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ac0c68b0 con 0x7f72ac159150 2024-08-17T02:46:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.889+0000 7f72a2000640 1 -- 172.21.15.100:0/452960370 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72940015b0 con 0x7f72ac159150 2024-08-17T02:46:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.889+0000 7f72b1200640 1 -- 172.21.15.100:0/452960370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ac0c6e70 con 0x7f72ac159150 2024-08-17T02:46:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.890+0000 7f72b1200640 1 -- 172.21.15.100:0/452960370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72ac0710c0 con 0x7f72ac159150 2024-08-17T02:46:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.891+0000 7f72a2000640 1 -- 172.21.15.100:0/452960370 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f729403fa30 con 0x7f72ac159150 2024-08-17T02:46:28.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.892+0000 7f72a2000640 1 --2- 172.21.15.100:0/452960370 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7288065150 0x7f7288067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:28.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.892+0000 7f72a2000640 1 -- 172.21.15.100:0/452960370 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f72940a2f00 con 0x7f72ac159150 2024-08-17T02:46:28.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.892+0000 7f72a9e00640 1 --2- 172.21.15.100:0/452960370 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7288065150 0x7f7288067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:28.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.893+0000 7f72a9e00640 1 --2- 172.21.15.100:0/452960370 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7288065150 0x7f7288067600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f729c006e70 tx=0x7f729c0090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:28.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:28.897+0000 7f72a2000640 1 -- 172.21.15.100:0/452960370 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f72940711b0 con 0x7f72ac159150 2024-08-17T02:46:29.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.070+0000 7f72b1200640 1 -- 172.21.15.100:0/452960370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f72ac0c7320 con 0x7f72ac159150 2024-08-17T02:46:29.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.703+0000 7f72a2000640 1 -- 172.21.15.100:0/452960370 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f72940747d0 con 0x7f72ac159150 2024-08-17T02:46:29.704 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2024-08-17T02:46:29.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.707+0000 7f72b1200640 1 -- 172.21.15.100:0/452960370 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7288065150 msgr2=0x7f7288067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:29.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.707+0000 7f72b1200640 1 --2- 172.21.15.100:0/452960370 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7288065150 0x7f7288067600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f729c006e70 tx=0x7f729c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.707+0000 7f72b1200640 1 -- 172.21.15.100:0/452960370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72ac159150 msgr2=0x7f72ac096c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:29.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.707+0000 7f72b1200640 1 --2- 172.21.15.100:0/452960370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72ac159150 0x7f72ac096c80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7294007c40 tx=0x7f7294034000 comp rx=0 tx=0).stop 2024-08-17T02:46:29.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.707+0000 7f72b1200640 1 -- 172.21.15.100:0/452960370 shutdown_connections 2024-08-17T02:46:29.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.707+0000 7f72b1200640 1 --2- 172.21.15.100:0/452960370 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7288065150 0x7f7288067600 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.707+0000 7f72b1200640 1 --2- 172.21.15.100:0/452960370 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72ac0971c0 0x7f72ac0c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.707+0000 7f72b1200640 1 --2- 172.21.15.100:0/452960370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72ac159150 0x7f72ac096c80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.707+0000 7f72b1200640 1 --2- 172.21.15.100:0/452960370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7290004780 0x7f72ac1567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.707+0000 7f72b1200640 1 -- 172.21.15.100:0/452960370 >> 172.21.15.100:0/452960370 conn(0x7f72ac0ccc50 msgr2=0x7f72ac06fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:29.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.713+0000 7f72b1200640 1 -- 172.21.15.100:0/452960370 shutdown_connections 2024-08-17T02:46:29.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.713+0000 7f72b1200640 1 -- 172.21.15.100:0/452960370 wait complete. 2024-08-17T02:46:29.737 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:46:29.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.889+0000 7f6374c00640 1 Processor -- start 2024-08-17T02:46:29.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.889+0000 7f6374c00640 1 -- start start 2024-08-17T02:46:29.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.891+0000 7f6374c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6370156c50 0x7f63700c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.891+0000 7f6374c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f63700adcf0 0x7f63700ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.891+0000 7f6374c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f63700abb00 0x7f63700c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.891+0000 7f6374c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63700ab130 con 0x7f6370156c50 2024-08-17T02:46:29.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.891+0000 7f6374c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63700ae5a0 con 0x7f63700adcf0 2024-08-17T02:46:29.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.891+0000 7f6374c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63700ae2c0 con 0x7f63700abb00 2024-08-17T02:46:29.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.891+0000 7f636de00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6370156c50 0x7f63700c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.891+0000 7f636de00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6370156c50 0x7f63700c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44990/0 (socket says 172.21.15.100:44990) 2024-08-17T02:46:29.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.891+0000 7f636de00640 1 -- 172.21.15.100:0/3222735771 learned_addr learned my addr 172.21.15.100:0/3222735771 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:29.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.891+0000 7f636e800640 1 --2- 172.21.15.100:0/3222735771 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f63700abb00 0x7f63700c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.891+0000 7f6365400640 1 --2- 172.21.15.100:0/3222735771 >> v2:172.21.15.123:3300/0 conn(0x7f63700adcf0 0x7f63700ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.891+0000 7f636de00640 1 -- 172.21.15.100:0/3222735771 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f63700abb00 msgr2=0x7f63700c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:29.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.891+0000 7f636de00640 1 --2- 172.21.15.100:0/3222735771 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f63700abb00 0x7f63700c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.891+0000 7f636de00640 1 -- 172.21.15.100:0/3222735771 >> v2:172.21.15.123:3300/0 conn(0x7f63700adcf0 msgr2=0x7f63700ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:29.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.891+0000 7f636de00640 1 --2- 172.21.15.100:0/3222735771 >> v2:172.21.15.123:3300/0 conn(0x7f63700adcf0 0x7f63700ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.891+0000 7f636de00640 1 -- 172.21.15.100:0/3222735771 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63700aaae0 con 0x7f6370156c50 2024-08-17T02:46:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.892+0000 7f636de00640 1 --2- 172.21.15.100:0/3222735771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6370156c50 0x7f63700c7cf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f637006f0c0 tx=0x7f63600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81287e0c8e372524 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.893+0000 7f636d400640 1 -- 172.21.15.100:0/3222735771 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636002acb0 con 0x7f6370156c50 2024-08-17T02:46:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.893+0000 7f636d400640 1 -- 172.21.15.100:0/3222735771 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636002ae10 con 0x7f6370156c50 2024-08-17T02:46:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.893+0000 7f636d400640 1 -- 172.21.15.100:0/3222735771 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6360032670 con 0x7f6370156c50 2024-08-17T02:46:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.893+0000 7f6374c00640 1 -- 172.21.15.100:0/3222735771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6370156c50 msgr2=0x7f63700c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.893+0000 7f6374c00640 1 --2- 172.21.15.100:0/3222735771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6370156c50 0x7f63700c7cf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f637006f0c0 tx=0x7f63600091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.893+0000 7f6374c00640 1 -- 172.21.15.100:0/3222735771 shutdown_connections 2024-08-17T02:46:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.893+0000 7f6374c00640 1 --2- 172.21.15.100:0/3222735771 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f63700abb00 0x7f63700c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.893+0000 7f6374c00640 1 --2- 172.21.15.100:0/3222735771 >> v2:172.21.15.123:3300/0 conn(0x7f63700adcf0 0x7f63700ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.893+0000 7f6374c00640 1 --2- 172.21.15.100:0/3222735771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6370156c50 0x7f63700c7cf0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.893+0000 7f6374c00640 1 -- 172.21.15.100:0/3222735771 >> 172.21.15.100:0/3222735771 conn(0x7f6370067750 msgr2=0x7f63700c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.893+0000 7f6374c00640 1 -- 172.21.15.100:0/3222735771 shutdown_connections 2024-08-17T02:46:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.893+0000 7f6374c00640 1 -- 172.21.15.100:0/3222735771 wait complete. 2024-08-17T02:46:29.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.895+0000 7f6374c00640 1 Processor -- start 2024-08-17T02:46:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.895+0000 7f6374c00640 1 -- start start 2024-08-17T02:46:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.896+0000 7f6374c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63700abb00 0x7f637014b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.896+0000 7f6374c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63700adcf0 0x7f63701505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.896+0000 7f6374c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6370156c50 0x7f637014e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.896+0000 7f6374c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6370150140 con 0x7f63700adcf0 2024-08-17T02:46:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.896+0000 7f6374c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6370157da0 con 0x7f63700abb00 2024-08-17T02:46:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.896+0000 7f6374c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637014f530 con 0x7f6370156c50 2024-08-17T02:46:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.896+0000 7f6365400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63700adcf0 0x7f63701505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.896+0000 7f6365400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63700adcf0 0x7f63701505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44998/0 (socket says 172.21.15.100:44998) 2024-08-17T02:46:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.896+0000 7f6365400640 1 -- 172.21.15.100:0/181898697 learned_addr learned my addr 172.21.15.100:0/181898697 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.896+0000 7f636e800640 1 --2- 172.21.15.100:0/181898697 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6370156c50 0x7f637014e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.896+0000 7f636de00640 1 --2- 172.21.15.100:0/181898697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63700abb00 0x7f637014b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.896+0000 7f6365400640 1 -- 172.21.15.100:0/181898697 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6370156c50 msgr2=0x7f637014e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:29.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.896+0000 7f6365400640 1 --2- 172.21.15.100:0/181898697 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6370156c50 0x7f637014e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.896+0000 7f6365400640 1 -- 172.21.15.100:0/181898697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63700abb00 msgr2=0x7f637014b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:29.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.896+0000 7f6365400640 1 --2- 172.21.15.100:0/181898697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63700abb00 0x7f637014b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.896+0000 7f6365400640 1 -- 172.21.15.100:0/181898697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6360009450 con 0x7f63700adcf0 2024-08-17T02:46:29.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.897+0000 7f6365400640 1 --2- 172.21.15.100:0/181898697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63700adcf0 0x7f63701505d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f635800d890 tx=0x7f6358008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:29.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.897+0000 7f6366000640 1 -- 172.21.15.100:0/181898697 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635800de20 con 0x7f63700adcf0 2024-08-17T02:46:29.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.897+0000 7f6366000640 1 -- 172.21.15.100:0/181898697 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635800b8d0 con 0x7f63700adcf0 2024-08-17T02:46:29.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.897+0000 7f6374c00640 1 -- 172.21.15.100:0/181898697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637014f810 con 0x7f63700adcf0 2024-08-17T02:46:29.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.897+0000 7f6366000640 1 -- 172.21.15.100:0/181898697 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635800bc70 con 0x7f63700adcf0 2024-08-17T02:46:29.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.897+0000 7f6374c00640 1 -- 172.21.15.100:0/181898697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637014fdd0 con 0x7f63700adcf0 2024-08-17T02:46:29.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.898+0000 7f6374c00640 1 -- 172.21.15.100:0/181898697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63701502f0 con 0x7f63700adcf0 2024-08-17T02:46:29.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.899+0000 7f6366000640 1 -- 172.21.15.100:0/181898697 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6358014640 con 0x7f63700adcf0 2024-08-17T02:46:29.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.900+0000 7f6366000640 1 --2- 172.21.15.100:0/181898697 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f634c065150 0x7f634c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.900+0000 7f6366000640 1 -- 172.21.15.100:0/181898697 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f63580829a0 con 0x7f63700adcf0 2024-08-17T02:46:29.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.900+0000 7f636de00640 1 --2- 172.21.15.100:0/181898697 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f634c065150 0x7f634c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.901+0000 7f636de00640 1 --2- 172.21.15.100:0/181898697 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f634c065150 0x7f634c067600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6360034000 tx=0x7f6360032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:29.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:29.905+0000 7f6366000640 1 -- 172.21.15.100:0/181898697 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f63701502f0 con 0x7f63700adcf0 2024-08-17T02:46:30.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.112+0000 7f6374c00640 1 -- 172.21.15.100:0/181898697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6370071050 con 0x7f63700adcf0 2024-08-17T02:46:30.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.705+0000 7f6366000640 1 -- 172.21.15.100:0/181898697 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6358054620 con 0x7f63700adcf0 2024-08-17T02:46:30.706 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 4 and data pool 5 2024-08-17T02:46:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.709+0000 7f6374c00640 1 -- 172.21.15.100:0/181898697 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f634c065150 msgr2=0x7f634c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.709+0000 7f6374c00640 1 --2- 172.21.15.100:0/181898697 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f634c065150 0x7f634c067600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6360034000 tx=0x7f6360032000 comp rx=0 tx=0).stop 2024-08-17T02:46:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.709+0000 7f6374c00640 1 -- 172.21.15.100:0/181898697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63700adcf0 msgr2=0x7f63701505d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.709+0000 7f6374c00640 1 --2- 172.21.15.100:0/181898697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63700adcf0 0x7f63701505d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f635800d890 tx=0x7f6358008040 comp rx=0 tx=0).stop 2024-08-17T02:46:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.709+0000 7f6374c00640 1 -- 172.21.15.100:0/181898697 shutdown_connections 2024-08-17T02:46:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.709+0000 7f6374c00640 1 --2- 172.21.15.100:0/181898697 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f634c065150 0x7f634c067600 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.709+0000 7f6374c00640 1 --2- 172.21.15.100:0/181898697 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6370156c50 0x7f637014e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:30.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.709+0000 7f6374c00640 1 --2- 172.21.15.100:0/181898697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63700adcf0 0x7f63701505d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:30.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.709+0000 7f6374c00640 1 --2- 172.21.15.100:0/181898697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63700abb00 0x7f637014b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:30.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.709+0000 7f6374c00640 1 -- 172.21.15.100:0/181898697 >> 172.21.15.100:0/181898697 conn(0x7f6370067750 msgr2=0x7f637006c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:30.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.710+0000 7f6374c00640 1 -- 172.21.15.100:0/181898697 shutdown_connections 2024-08-17T02:46:30.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.711+0000 7f6374c00640 1 -- 172.21.15.100:0/181898697 wait complete. 2024-08-17T02:46:30.745 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:30.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.893+0000 7f450cc00640 1 Processor -- start 2024-08-17T02:46:30.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.894+0000 7f450cc00640 1 -- start start 2024-08-17T02:46:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.895+0000 7f450cc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4508155900 0x7f4508155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.895+0000 7f450cc00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f45080b0270 0x7f4508156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.895+0000 7f450cc00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4508157b20 0x7f4508157f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.895+0000 7f450cc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4508157690 con 0x7f4508155900 2024-08-17T02:46:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.895+0000 7f450cc00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4508156a80 con 0x7f45080b0270 2024-08-17T02:46:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.895+0000 7f450cc00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4508156d60 con 0x7f4508157b20 2024-08-17T02:46:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.895+0000 7f4507400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4508155900 0x7f4508155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.895+0000 7f4507400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4508155900 0x7f4508155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45010/0 (socket says 172.21.15.100:45010) 2024-08-17T02:46:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.895+0000 7f4507400640 1 -- 172.21.15.100:0/2109426228 learned_addr learned my addr 172.21.15.100:0/2109426228 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.895+0000 7f4507400640 1 -- 172.21.15.100:0/2109426228 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4508157b20 msgr2=0x7f4508157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.895+0000 7f4507e00640 1 --2- 172.21.15.100:0/2109426228 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4508157b20 0x7f4508157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.896+0000 7f4507400640 1 --2- 172.21.15.100:0/2109426228 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4508157b20 0x7f4508157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.896+0000 7f44fea00640 1 --2- 172.21.15.100:0/2109426228 >> v2:172.21.15.123:3300/0 conn(0x7f45080b0270 0x7f4508156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.896+0000 7f4507400640 1 -- 172.21.15.100:0/2109426228 >> v2:172.21.15.123:3300/0 conn(0x7f45080b0270 msgr2=0x7f4508156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.896+0000 7f4507400640 1 --2- 172.21.15.100:0/2109426228 >> v2:172.21.15.123:3300/0 conn(0x7f45080b0270 0x7f4508156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.896+0000 7f4507400640 1 -- 172.21.15.100:0/2109426228 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4508157040 con 0x7f4508155900 2024-08-17T02:46:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.896+0000 7f4507e00640 1 --2- 172.21.15.100:0/2109426228 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4508157b20 0x7f4508157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.896+0000 7f44fea00640 1 --2- 172.21.15.100:0/2109426228 >> v2:172.21.15.123:3300/0 conn(0x7f45080b0270 0x7f4508156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.897+0000 7f4507400640 1 --2- 172.21.15.100:0/2109426228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4508155900 0x7f4508155cd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f450806f430 tx=0x7f44f80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894ea5d06f97f828 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.897+0000 7f4506a00640 1 -- 172.21.15.100:0/2109426228 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f802ad40 con 0x7f4508155900 2024-08-17T02:46:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.897+0000 7f4506a00640 1 -- 172.21.15.100:0/2109426228 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f8032440 con 0x7f4508155900 2024-08-17T02:46:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.897+0000 7f4506a00640 1 -- 172.21.15.100:0/2109426228 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f802aea0 con 0x7f4508155900 2024-08-17T02:46:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.897+0000 7f450cc00640 1 -- 172.21.15.100:0/2109426228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4508155900 msgr2=0x7f4508155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.897+0000 7f450cc00640 1 --2- 172.21.15.100:0/2109426228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4508155900 0x7f4508155cd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f450806f430 tx=0x7f44f80091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.897+0000 7f450cc00640 1 -- 172.21.15.100:0/2109426228 shutdown_connections 2024-08-17T02:46:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.897+0000 7f450cc00640 1 --2- 172.21.15.100:0/2109426228 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4508157b20 0x7f4508157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.897+0000 7f450cc00640 1 --2- 172.21.15.100:0/2109426228 >> v2:172.21.15.123:3300/0 conn(0x7f45080b0270 0x7f4508156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.897+0000 7f450cc00640 1 --2- 172.21.15.100:0/2109426228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4508155900 0x7f4508155cd0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:30.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.897+0000 7f450cc00640 1 -- 172.21.15.100:0/2109426228 >> 172.21.15.100:0/2109426228 conn(0x7f4508067750 msgr2=0x7f45080cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:30.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.898+0000 7f450cc00640 1 -- 172.21.15.100:0/2109426228 shutdown_connections 2024-08-17T02:46:30.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.898+0000 7f450cc00640 1 -- 172.21.15.100:0/2109426228 wait complete. 2024-08-17T02:46:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.899+0000 7f450cc00640 1 Processor -- start 2024-08-17T02:46:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.899+0000 7f450cc00640 1 -- start start 2024-08-17T02:46:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.900+0000 7f450cc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080b0270 0x7f45080a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.900+0000 7f450cc00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4508155900 0x7f450814fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.900+0000 7f450cc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4508157b20 0x7f4508153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.900+0000 7f450cc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45080aa670 con 0x7f45080b0270 2024-08-17T02:46:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.900+0000 7f450cc00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450814ae30 con 0x7f4508157b20 2024-08-17T02:46:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.900+0000 7f450cc00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4508153780 con 0x7f4508155900 2024-08-17T02:46:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.900+0000 7f4507400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080b0270 0x7f45080a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.900+0000 7f4507400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080b0270 0x7f45080a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45024/0 (socket says 172.21.15.100:45024) 2024-08-17T02:46:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.900+0000 7f4507400640 1 -- 172.21.15.100:0/1834263970 learned_addr learned my addr 172.21.15.100:0/1834263970 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.900+0000 7f44fea00640 1 --2- 172.21.15.100:0/1834263970 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4508155900 0x7f450814fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.900+0000 7f4507e00640 1 --2- 172.21.15.100:0/1834263970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4508157b20 0x7f4508153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.901+0000 7f4507400640 1 -- 172.21.15.100:0/1834263970 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4508155900 msgr2=0x7f450814fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.901+0000 7f4507400640 1 --2- 172.21.15.100:0/1834263970 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4508155900 0x7f450814fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.901+0000 7f4507400640 1 -- 172.21.15.100:0/1834263970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4508157b20 msgr2=0x7f4508153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.901+0000 7f4507400640 1 --2- 172.21.15.100:0/1834263970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4508157b20 0x7f4508153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.901+0000 7f4507400640 1 -- 172.21.15.100:0/1834263970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f8009450 con 0x7f45080b0270 2024-08-17T02:46:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.901+0000 7f4507e00640 1 --2- 172.21.15.100:0/1834263970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4508157b20 0x7f4508153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.901+0000 7f4507400640 1 --2- 172.21.15.100:0/1834263970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080b0270 0x7f45080a98e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f44f8035040 tx=0x7f44f8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.901+0000 7f44ff400640 1 -- 172.21.15.100:0/1834263970 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8031a60 con 0x7f45080b0270 2024-08-17T02:46:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.901+0000 7f44ff400640 1 -- 172.21.15.100:0/1834263970 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f8031be0 con 0x7f45080b0270 2024-08-17T02:46:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.901+0000 7f450cc00640 1 -- 172.21.15.100:0/1834263970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45080a9e20 con 0x7f45080b0270 2024-08-17T02:46:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.901+0000 7f44ff400640 1 -- 172.21.15.100:0/1834263970 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f803d420 con 0x7f45080b0270 2024-08-17T02:46:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.901+0000 7f450cc00640 1 -- 172.21.15.100:0/1834263970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45080ac090 con 0x7f45080b0270 2024-08-17T02:46:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.902+0000 7f450cc00640 1 -- 172.21.15.100:0/1834263970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4508071050 con 0x7f45080b0270 2024-08-17T02:46:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.903+0000 7f44ff400640 1 -- 172.21.15.100:0/1834263970 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f44f8039040 con 0x7f45080b0270 2024-08-17T02:46:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.904+0000 7f44ff400640 1 --2- 172.21.15.100:0/1834263970 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f44e40651d0 0x7f44e4067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.904+0000 7f44ff400640 1 -- 172.21.15.100:0/1834263970 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f44f80a2340 con 0x7f45080b0270 2024-08-17T02:46:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.905+0000 7f44fea00640 1 --2- 172.21.15.100:0/1834263970 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f44e40651d0 0x7f44e4067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:30.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.905+0000 7f44fea00640 1 --2- 172.21.15.100:0/1834263970 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f44e40651d0 0x7f44e4067680 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f45080ca6b0 tx=0x7f44f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:30.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:30.908+0000 7f44ff400640 1 -- 172.21.15.100:0/1834263970 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f44f8070410 con 0x7f45080b0270 2024-08-17T02:46:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.082+0000 7f450cc00640 1 -- 172.21.15.100:0/1834263970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45080ac3b0 con 0x7f45080b0270 2024-08-17T02:46:31.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.083+0000 7f44ff400640 1 -- 172.21.15.100:0/1834263970 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f44f8073a30 con 0x7f45080b0270 2024-08-17T02:46:31.084 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:31.084 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":32,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:46:30.114068+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:28.081485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:29.108765+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:31.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.085+0000 7f450cc00640 1 -- 172.21.15.100:0/1834263970 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f44e40651d0 msgr2=0x7f44e4067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:31.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.085+0000 7f450cc00640 1 --2- 172.21.15.100:0/1834263970 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f44e40651d0 0x7f44e4067680 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f45080ca6b0 tx=0x7f44f0008040 comp rx=0 tx=0).stop 2024-08-17T02:46:31.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.085+0000 7f450cc00640 1 -- 172.21.15.100:0/1834263970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080b0270 msgr2=0x7f45080a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:31.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.085+0000 7f450cc00640 1 --2- 172.21.15.100:0/1834263970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080b0270 0x7f45080a98e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f44f8035040 tx=0x7f44f8032000 comp rx=0 tx=0).stop 2024-08-17T02:46:31.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.085+0000 7f450cc00640 1 -- 172.21.15.100:0/1834263970 shutdown_connections 2024-08-17T02:46:31.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.085+0000 7f450cc00640 1 --2- 172.21.15.100:0/1834263970 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f44e40651d0 0x7f44e4067680 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:31.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.085+0000 7f450cc00640 1 --2- 172.21.15.100:0/1834263970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4508157b20 0x7f4508153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:31.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.085+0000 7f450cc00640 1 --2- 172.21.15.100:0/1834263970 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4508155900 0x7f450814fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:31.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.085+0000 7f450cc00640 1 --2- 172.21.15.100:0/1834263970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080b0270 0x7f45080a98e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:31.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.085+0000 7f450cc00640 1 -- 172.21.15.100:0/1834263970 >> 172.21.15.100:0/1834263970 conn(0x7f4508067750 msgr2=0x7f4508068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:31.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.085+0000 7f450cc00640 1 -- 172.21.15.100:0/1834263970 shutdown_connections 2024-08-17T02:46:31.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.085+0000 7f450cc00640 1 -- 172.21.15.100:0/1834263970 wait complete. 2024-08-17T02:46:31.101 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:31.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.249+0000 7f6134400640 1 Processor -- start 2024-08-17T02:46:31.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.249+0000 7f6134400640 1 -- start start 2024-08-17T02:46:31.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.251+0000 7f6134400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f612c155df0 0x7f612c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.251+0000 7f6134400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612c156670 con 0x7f612c06df00 2024-08-17T02:46:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.251+0000 7f6134400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612c06e5e0 con 0x7f612c155a20 2024-08-17T02:46:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.251+0000 7f6134400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612c0b0350 con 0x7f612c155df0 2024-08-17T02:46:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.251+0000 7f6131000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f612c06df00 0x7f612c156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42072/0 (socket says 172.21.15.100:42072) 2024-08-17T02:46:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.251+0000 7f6131000640 1 -- 172.21.15.100:0/3048289970 learned_addr learned my addr 172.21.15.100:0/3048289970 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.251+0000 7f6132400640 1 --2- 172.21.15.100:0/3048289970 >> v2:172.21.15.123:3300/0 conn(0x7f612c155df0 0x7f612c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:31.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.251+0000 7f612be00640 1 -- 172.21.15.100:0/3048289970 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822865033 0 0) 0x7f612c156670 con 0x7f612c06df00 2024-08-17T02:46:31.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.251+0000 7f612be00640 1 -- 172.21.15.100:0/3048289970 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61140034e0 con 0x7f612c06df00 2024-08-17T02:46:31.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.252+0000 7f6132400640 1 -- 172.21.15.100:0/3048289970 >> v1:172.21.15.123:6789/0 conn(0x7f612c155a20 legacy=0x7f612c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:31.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.252+0000 7f6132400640 1 -- 172.21.15.100:0/3048289970 >> v1:172.21.15.100:6789/0 conn(0x7f612c06df00 legacy=0x7f612c156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:31.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.252+0000 7f6132400640 1 -- 172.21.15.100:0/3048289970 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c06e8c0 con 0x7f612c155df0 2024-08-17T02:46:31.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.253+0000 7f6132400640 1 --2- 172.21.15.100:0/3048289970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f612c155df0 0x7f612c0adf10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6124009e60 tx=0x7f6124009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae57062bed530cbd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:31.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.253+0000 7f612be00640 1 -- 172.21.15.100:0/3048289970 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124032640 con 0x7f612c155df0 2024-08-17T02:46:31.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.253+0000 7f612be00640 1 -- 172.21.15.100:0/3048289970 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61240327a0 con 0x7f612c155df0 2024-08-17T02:46:31.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.253+0000 7f612be00640 1 -- 172.21.15.100:0/3048289970 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124032b20 con 0x7f612c155df0 2024-08-17T02:46:31.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.253+0000 7f6134400640 1 -- 172.21.15.100:0/3048289970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f612c155df0 msgr2=0x7f612c0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:31.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.253+0000 7f6134400640 1 --2- 172.21.15.100:0/3048289970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f612c155df0 0x7f612c0adf10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6124009e60 tx=0x7f6124009780 comp rx=0 tx=0).stop 2024-08-17T02:46:31.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.254+0000 7f6134400640 1 -- 172.21.15.100:0/3048289970 shutdown_connections 2024-08-17T02:46:31.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.254+0000 7f6134400640 1 --2- 172.21.15.100:0/3048289970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f612c155df0 0x7f612c0adf10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:31.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.254+0000 7f6134400640 1 -- 172.21.15.100:0/3048289970 >> 172.21.15.100:0/3048289970 conn(0x7f612c0cb9b0 msgr2=0x7f612c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:31.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.254+0000 7f6134400640 1 -- 172.21.15.100:0/3048289970 shutdown_connections 2024-08-17T02:46:31.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.254+0000 7f6134400640 1 -- 172.21.15.100:0/3048289970 wait complete. 2024-08-17T02:46:31.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.255+0000 7f6134400640 1 Processor -- start 2024-08-17T02:46:31.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.255+0000 7f6134400640 1 -- start start 2024-08-17T02:46:31.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.256+0000 7f6134400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f612c06df00 0x7f612c169aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:31.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.256+0000 7f6134400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f612c155a20 0x7f612c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:31.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.256+0000 7f6134400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f612c155df0 0x7f612c0acac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:31.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.256+0000 7f6134400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c06a0a0 con 0x7f612c155df0 2024-08-17T02:46:31.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.256+0000 7f6134400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c069000 con 0x7f612c06df00 2024-08-17T02:46:31.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.256+0000 7f6134400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612c0692e0 con 0x7f612c155a20 2024-08-17T02:46:31.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.256+0000 7f6132400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f612c155df0 0x7f612c0acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:31.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.256+0000 7f6132400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f612c155df0 0x7f612c0acac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45032/0 (socket says 172.21.15.100:45032) 2024-08-17T02:46:31.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.256+0000 7f6132400640 1 -- 172.21.15.100:0/1939858237 learned_addr learned my addr 172.21.15.100:0/1939858237 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:31.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.256+0000 7f6131000640 1 --2- 172.21.15.100:0/1939858237 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f612c155a20 0x7f612c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:31.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.256+0000 7f6131a00640 1 --2- 172.21.15.100:0/1939858237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f612c06df00 0x7f612c169aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:31.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.257+0000 7f6132400640 1 -- 172.21.15.100:0/1939858237 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f612c155a20 msgr2=0x7f612c0687b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:31.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.257+0000 7f6132400640 1 --2- 172.21.15.100:0/1939858237 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f612c155a20 0x7f612c0687b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:31.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.257+0000 7f6132400640 1 -- 172.21.15.100:0/1939858237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f612c06df00 msgr2=0x7f612c169aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:31.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.257+0000 7f6132400640 1 --2- 172.21.15.100:0/1939858237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f612c06df00 0x7f612c169aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:31.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.257+0000 7f6132400640 1 -- 172.21.15.100:0/1939858237 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6124009a20 con 0x7f612c155df0 2024-08-17T02:46:31.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.257+0000 7f6132400640 1 --2- 172.21.15.100:0/1939858237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f612c155df0 0x7f612c0acac0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f61240099f0 tx=0x7f612403a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:31.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.257+0000 7f6128c00640 1 -- 172.21.15.100:0/1939858237 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612400e050 con 0x7f612c155df0 2024-08-17T02:46:31.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.257+0000 7f6128c00640 1 -- 172.21.15.100:0/1939858237 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6124032e90 con 0x7f612c155df0 2024-08-17T02:46:31.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.257+0000 7f6128c00640 1 -- 172.21.15.100:0/1939858237 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612403cd20 con 0x7f612c155df0 2024-08-17T02:46:31.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.257+0000 7f6134400640 1 -- 172.21.15.100:0/1939858237 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612c0695c0 con 0x7f612c155df0 2024-08-17T02:46:31.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.257+0000 7f6134400640 1 -- 172.21.15.100:0/1939858237 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612c069b80 con 0x7f612c155df0 2024-08-17T02:46:31.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.258+0000 7f6134400640 1 -- 172.21.15.100:0/1939858237 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612c064db0 con 0x7f612c155df0 2024-08-17T02:46:31.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.259+0000 7f6128c00640 1 -- 172.21.15.100:0/1939858237 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f612404f450 con 0x7f612c155df0 2024-08-17T02:46:31.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.260+0000 7f6128c00640 1 --2- 172.21.15.100:0/1939858237 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f610c065150 0x7f610c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:31.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.260+0000 7f6128c00640 1 -- 172.21.15.100:0/1939858237 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f61240a3840 con 0x7f612c155df0 2024-08-17T02:46:31.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.260+0000 7f6131a00640 1 --2- 172.21.15.100:0/1939858237 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f610c065150 0x7f610c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:31.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.261+0000 7f6131a00640 1 --2- 172.21.15.100:0/1939858237 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f610c065150 0x7f610c067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f612c0cab40 tx=0x7f6120009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:31.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.264+0000 7f6128c00640 1 -- 172.21.15.100:0/1939858237 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6124071920 con 0x7f612c155df0 2024-08-17T02:46:31.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.435+0000 7f6134400640 1 -- 172.21.15.100:0/1939858237 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f612c15a000 con 0x7f612c155df0 2024-08-17T02:46:31.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.436+0000 7f6128c00640 1 -- 172.21.15.100:0/1939858237 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f6124074f40 con 0x7f612c155df0 2024-08-17T02:46:31.437 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:31.437 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":32,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:46:30.114068+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:28.081485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:29.108765+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:31.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.438+0000 7f6134400640 1 -- 172.21.15.100:0/1939858237 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f610c065150 msgr2=0x7f610c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:31.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.438+0000 7f6134400640 1 --2- 172.21.15.100:0/1939858237 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f610c065150 0x7f610c067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f612c0cab40 tx=0x7f6120009040 comp rx=0 tx=0).stop 2024-08-17T02:46:31.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.438+0000 7f6134400640 1 -- 172.21.15.100:0/1939858237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f612c155df0 msgr2=0x7f612c0acac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.438+0000 7f6134400640 1 --2- 172.21.15.100:0/1939858237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f612c155df0 0x7f612c0acac0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f61240099f0 tx=0x7f612403a000 comp rx=0 tx=0).stop 2024-08-17T02:46:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.438+0000 7f6134400640 1 -- 172.21.15.100:0/1939858237 shutdown_connections 2024-08-17T02:46:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.438+0000 7f6134400640 1 --2- 172.21.15.100:0/1939858237 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f610c065150 0x7f610c067600 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.438+0000 7f6134400640 1 --2- 172.21.15.100:0/1939858237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f612c155df0 0x7f612c0acac0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.438+0000 7f6134400640 1 --2- 172.21.15.100:0/1939858237 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f612c155a20 0x7f612c0687b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.438+0000 7f6134400640 1 --2- 172.21.15.100:0/1939858237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f612c06df00 0x7f612c169aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.438+0000 7f6134400640 1 -- 172.21.15.100:0/1939858237 >> 172.21.15.100:0/1939858237 conn(0x7f612c0cb9b0 msgr2=0x7f612c15a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.439+0000 7f6134400640 1 -- 172.21.15.100:0/1939858237 shutdown_connections 2024-08-17T02:46:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.439+0000 7f6134400640 1 -- 172.21.15.100:0/1939858237 wait complete. 2024-08-17T02:46:31.455 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:46:31.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.605+0000 7fc9c4600640 1 Processor -- start 2024-08-17T02:46:31.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.605+0000 7fc9c4600640 1 -- start start 2024-08-17T02:46:31.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.606+0000 7fc9c4600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc9bc155a80 0x7fc9bc06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:31.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.606+0000 7fc9c4600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9bc1598f0 con 0x7fc9bc0c7db0 2024-08-17T02:46:31.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.606+0000 7fc9c4600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9bc159bd0 con 0x7fc9bc0c92e0 2024-08-17T02:46:31.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.606+0000 7fc9c4600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9bc159eb0 con 0x7fc9bc155a80 2024-08-17T02:46:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.606+0000 7fc9c1200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc9bc0c7db0 0x7fc9bc0c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42082/0 (socket says 172.21.15.100:42082) 2024-08-17T02:46:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.607+0000 7fc9c1200640 1 -- 172.21.15.100:0/2898587406 learned_addr learned my addr 172.21.15.100:0/2898587406 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.607+0000 7fc9c1c00640 1 --2- 172.21.15.100:0/2898587406 >> v2:172.21.15.123:3300/0 conn(0x7fc9bc155a80 0x7fc9bc06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.607+0000 7fc9c1c00640 1 -- 172.21.15.100:0/2898587406 >> v1:172.21.15.123:6789/0 conn(0x7fc9bc0c92e0 legacy=0x7fc9bc0aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.607+0000 7fc9bbe00640 1 -- 172.21.15.100:0/2898587406 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455159699 0 0) 0x7fc9bc1598f0 con 0x7fc9bc0c7db0 2024-08-17T02:46:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.607+0000 7fc9c1c00640 1 -- 172.21.15.100:0/2898587406 >> v1:172.21.15.100:6789/0 conn(0x7fc9bc0c7db0 legacy=0x7fc9bc0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:31.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.607+0000 7fc9c1c00640 1 -- 172.21.15.100:0/2898587406 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc15a190 con 0x7fc9bc155a80 2024-08-17T02:46:31.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.608+0000 7fc9c1c00640 1 --2- 172.21.15.100:0/2898587406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9bc155a80 0x7fc9bc06dc00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009850 tx=0x7fc9b00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e77bb43db70151db server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:31.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.608+0000 7fc9bbe00640 1 -- 172.21.15.100:0/2898587406 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0032440 con 0x7fc9bc155a80 2024-08-17T02:46:31.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.609+0000 7fc9bbe00640 1 -- 172.21.15.100:0/2898587406 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b00325a0 con 0x7fc9bc155a80 2024-08-17T02:46:31.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.609+0000 7fc9bbe00640 1 -- 172.21.15.100:0/2898587406 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0032940 con 0x7fc9bc155a80 2024-08-17T02:46:31.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.609+0000 7fc9c4600640 1 -- 172.21.15.100:0/2898587406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9bc155a80 msgr2=0x7fc9bc06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:31.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.609+0000 7fc9c4600640 1 --2- 172.21.15.100:0/2898587406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9bc155a80 0x7fc9bc06dc00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009850 tx=0x7fc9b00090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:31.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.609+0000 7fc9c4600640 1 -- 172.21.15.100:0/2898587406 shutdown_connections 2024-08-17T02:46:31.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.609+0000 7fc9c4600640 1 --2- 172.21.15.100:0/2898587406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9bc155a80 0x7fc9bc06dc00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:31.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.609+0000 7fc9c4600640 1 -- 172.21.15.100:0/2898587406 >> 172.21.15.100:0/2898587406 conn(0x7fc9bc067750 msgr2=0x7fc9bc0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:31.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.609+0000 7fc9c4600640 1 -- 172.21.15.100:0/2898587406 shutdown_connections 2024-08-17T02:46:31.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.609+0000 7fc9c4600640 1 -- 172.21.15.100:0/2898587406 wait complete. 2024-08-17T02:46:31.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.611+0000 7fc9c4600640 1 Processor -- start 2024-08-17T02:46:31.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.611+0000 7fc9c4600640 1 -- start start 2024-08-17T02:46:31.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.612+0000 7fc9c4600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9bc0c7db0 0x7fc9bc148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:31.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.612+0000 7fc9c4600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9bc0c92e0 0x7fc9bc14f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:31.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.612+0000 7fc9c4600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9bc155a80 0x7fc9bc152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:31.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.612+0000 7fc9c4600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc14fbe0 con 0x7fc9bc0c92e0 2024-08-17T02:46:31.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.612+0000 7fc9c4600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc14a7b0 con 0x7fc9bc155a80 2024-08-17T02:46:31.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.612+0000 7fc9c4600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc148cc0 con 0x7fc9bc0c7db0 2024-08-17T02:46:31.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.612+0000 7fc9c1200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9bc0c92e0 0x7fc9bc14f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:31.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.612+0000 7fc9c1200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9bc0c92e0 0x7fc9bc14f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45048/0 (socket says 172.21.15.100:45048) 2024-08-17T02:46:31.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.612+0000 7fc9c1200640 1 -- 172.21.15.100:0/521024801 learned_addr learned my addr 172.21.15.100:0/521024801 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:31.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.612+0000 7fc9c1c00640 1 --2- 172.21.15.100:0/521024801 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9bc0c7db0 0x7fc9bc148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:31.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.612+0000 7fc9c2600640 1 --2- 172.21.15.100:0/521024801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9bc155a80 0x7fc9bc152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:31.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.612+0000 7fc9c1200640 1 -- 172.21.15.100:0/521024801 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9bc0c7db0 msgr2=0x7fc9bc148780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:31.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.612+0000 7fc9c1200640 1 --2- 172.21.15.100:0/521024801 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9bc0c7db0 0x7fc9bc148780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:31.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.612+0000 7fc9c1200640 1 -- 172.21.15.100:0/521024801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9bc155a80 msgr2=0x7fc9bc152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:31.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.612+0000 7fc9c1200640 1 --2- 172.21.15.100:0/521024801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9bc155a80 0x7fc9bc152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:31.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.612+0000 7fc9c1200640 1 -- 172.21.15.100:0/521024801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b0009390 con 0x7fc9bc0c92e0 2024-08-17T02:46:31.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.613+0000 7fc9c1200640 1 --2- 172.21.15.100:0/521024801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9bc0c92e0 0x7fc9bc14f290 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8001eb0 tx=0x7fc9a8007ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:31.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.613+0000 7fc9b8c00640 1 -- 172.21.15.100:0/521024801 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8005aa0 con 0x7fc9bc0c92e0 2024-08-17T02:46:31.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.613+0000 7fc9b8c00640 1 -- 172.21.15.100:0/521024801 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a8005c20 con 0x7fc9bc0c92e0 2024-08-17T02:46:31.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.613+0000 7fc9b8c00640 1 -- 172.21.15.100:0/521024801 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8007340 con 0x7fc9bc0c92e0 2024-08-17T02:46:31.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.613+0000 7fc9c4600640 1 -- 172.21.15.100:0/521024801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9bc149e80 con 0x7fc9bc0c92e0 2024-08-17T02:46:31.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.613+0000 7fc9c4600640 1 -- 172.21.15.100:0/521024801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc14a440 con 0x7fc9bc0c92e0 2024-08-17T02:46:31.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.614+0000 7fc9c4600640 1 -- 172.21.15.100:0/521024801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9bc071050 con 0x7fc9bc0c92e0 2024-08-17T02:46:31.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.615+0000 7fc9b8c00640 1 -- 172.21.15.100:0/521024801 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc9a801b400 con 0x7fc9bc0c92e0 2024-08-17T02:46:31.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.616+0000 7fc9b8c00640 1 --2- 172.21.15.100:0/521024801 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc99c065180 0x7fc99c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:31.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.616+0000 7fc9b8c00640 1 -- 172.21.15.100:0/521024801 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc9a8081d80 con 0x7fc9bc0c92e0 2024-08-17T02:46:31.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.616+0000 7fc9c1c00640 1 --2- 172.21.15.100:0/521024801 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc99c065180 0x7fc99c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:31.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.617+0000 7fc9c1c00640 1 --2- 172.21.15.100:0/521024801 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc99c065180 0x7fc99c067630 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0034000 tx=0x7fc9b0032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:31.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.620+0000 7fc9b8c00640 1 -- 172.21.15.100:0/521024801 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc9a804fed0 con 0x7fc9bc0c92e0 2024-08-17T02:46:31.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:31.837+0000 7fc9c4600640 1 -- 172.21.15.100:0/521024801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc9bc06aa10 con 0x7fc9bc0c92e0 2024-08-17T02:46:32.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.732+0000 7fc9b8c00640 1 -- 172.21.15.100:0/521024801 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc9a80534f0 con 0x7fc9bc0c92e0 2024-08-17T02:46:32.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.734+0000 7fc9c4600640 1 -- 172.21.15.100:0/521024801 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc99c065180 msgr2=0x7fc99c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:32.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.734+0000 7fc9c4600640 1 --2- 172.21.15.100:0/521024801 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc99c065180 0x7fc99c067630 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0034000 tx=0x7fc9b0032000 comp rx=0 tx=0).stop 2024-08-17T02:46:32.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.734+0000 7fc9c4600640 1 -- 172.21.15.100:0/521024801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9bc0c92e0 msgr2=0x7fc9bc14f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:32.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.734+0000 7fc9c4600640 1 --2- 172.21.15.100:0/521024801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9bc0c92e0 0x7fc9bc14f290 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8001eb0 tx=0x7fc9a8007ce0 comp rx=0 tx=0).stop 2024-08-17T02:46:32.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.734+0000 7fc9c4600640 1 -- 172.21.15.100:0/521024801 shutdown_connections 2024-08-17T02:46:32.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.734+0000 7fc9c4600640 1 --2- 172.21.15.100:0/521024801 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc99c065180 0x7fc99c067630 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:32.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.734+0000 7fc9c4600640 1 --2- 172.21.15.100:0/521024801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9bc155a80 0x7fc9bc152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:32.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.734+0000 7fc9c4600640 1 --2- 172.21.15.100:0/521024801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9bc0c92e0 0x7fc9bc14f290 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:32.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.734+0000 7fc9c4600640 1 --2- 172.21.15.100:0/521024801 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9bc0c7db0 0x7fc9bc148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:32.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.735+0000 7fc9c4600640 1 -- 172.21.15.100:0/521024801 >> 172.21.15.100:0/521024801 conn(0x7fc9bc067750 msgr2=0x7fc9bc0ca2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:32.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.735+0000 7fc9c4600640 1 -- 172.21.15.100:0/521024801 shutdown_connections 2024-08-17T02:46:32.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.735+0000 7fc9c4600640 1 -- 172.21.15.100:0/521024801 wait complete. 2024-08-17T02:46:32.752 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:46:32.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.906+0000 7fd7ce400640 1 Processor -- start 2024-08-17T02:46:32.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.906+0000 7fd7ce400640 1 -- start start 2024-08-17T02:46:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.908+0000 7fd7ce400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd7c8155a80 0x7fd7c806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.908+0000 7fd7ce400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c81598f0 con 0x7fd7c80c7db0 2024-08-17T02:46:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.908+0000 7fd7ce400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c8159bd0 con 0x7fd7c80c92e0 2024-08-17T02:46:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.908+0000 7fd7ce400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c8159eb0 con 0x7fd7c8155a80 2024-08-17T02:46:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.908+0000 7fd7c6a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd7c80c7db0 0x7fd7c80c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42096/0 (socket says 172.21.15.100:42096) 2024-08-17T02:46:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.908+0000 7fd7c6a00640 1 -- 172.21.15.100:0/3789589877 learned_addr learned my addr 172.21.15.100:0/3789589877 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.908+0000 7fd7c7400640 1 --2- 172.21.15.100:0/3789589877 >> v2:172.21.15.123:3300/0 conn(0x7fd7c8155a80 0x7fd7c806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:32.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.908+0000 7fd7c6000640 1 -- 172.21.15.100:0/3789589877 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350262292 0 0) 0x7fd7c81598f0 con 0x7fd7c80c7db0 2024-08-17T02:46:32.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.908+0000 7fd7c6000640 1 -- 172.21.15.100:0/3789589877 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7ac0034e0 con 0x7fd7c80c7db0 2024-08-17T02:46:32.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.909+0000 7fd7c7400640 1 -- 172.21.15.100:0/3789589877 >> v1:172.21.15.123:6789/0 conn(0x7fd7c80c92e0 legacy=0x7fd7c80aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:32.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.909+0000 7fd7c7400640 1 -- 172.21.15.100:0/3789589877 >> v1:172.21.15.100:6789/0 conn(0x7fd7c80c7db0 legacy=0x7fd7c80c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:32.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.909+0000 7fd7c7400640 1 -- 172.21.15.100:0/3789589877 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c815a190 con 0x7fd7c8155a80 2024-08-17T02:46:32.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.910+0000 7fd7c7400640 1 --2- 172.21.15.100:0/3789589877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c8155a80 0x7fd7c806dc00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009850 tx=0x7fd7b80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=737de060cc363dc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:32.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.910+0000 7fd7c6000640 1 -- 172.21.15.100:0/3789589877 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8032440 con 0x7fd7c8155a80 2024-08-17T02:46:32.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.910+0000 7fd7c6000640 1 -- 172.21.15.100:0/3789589877 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b80325a0 con 0x7fd7c8155a80 2024-08-17T02:46:32.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.910+0000 7fd7c6000640 1 -- 172.21.15.100:0/3789589877 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8032980 con 0x7fd7c8155a80 2024-08-17T02:46:32.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.910+0000 7fd7ce400640 1 -- 172.21.15.100:0/3789589877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c8155a80 msgr2=0x7fd7c806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:32.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.910+0000 7fd7ce400640 1 --2- 172.21.15.100:0/3789589877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c8155a80 0x7fd7c806dc00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009850 tx=0x7fd7b80090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:32.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.911+0000 7fd7ce400640 1 -- 172.21.15.100:0/3789589877 shutdown_connections 2024-08-17T02:46:32.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.911+0000 7fd7ce400640 1 --2- 172.21.15.100:0/3789589877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c8155a80 0x7fd7c806dc00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:32.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.911+0000 7fd7ce400640 1 -- 172.21.15.100:0/3789589877 >> 172.21.15.100:0/3789589877 conn(0x7fd7c8067750 msgr2=0x7fd7c80c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:32.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.911+0000 7fd7ce400640 1 -- 172.21.15.100:0/3789589877 shutdown_connections 2024-08-17T02:46:32.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.911+0000 7fd7ce400640 1 -- 172.21.15.100:0/3789589877 wait complete. 2024-08-17T02:46:32.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.912+0000 7fd7ce400640 1 Processor -- start 2024-08-17T02:46:32.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.912+0000 7fd7ce400640 1 -- start start 2024-08-17T02:46:32.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.913+0000 7fd7ce400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c80c7db0 0x7fd7c8157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:32.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.913+0000 7fd7ce400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd7c80c92e0 0x7fd7c8168f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:32.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.913+0000 7fd7ce400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7c8155a80 0x7fd7c81492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:32.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.913+0000 7fd7ce400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c8158410 con 0x7fd7c8155a80 2024-08-17T02:46:32.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.913+0000 7fd7ce400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c816c530 con 0x7fd7c80c7db0 2024-08-17T02:46:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.913+0000 7fd7ce400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c816c7d0 con 0x7fd7c80c92e0 2024-08-17T02:46:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.914+0000 7fd7c7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7c8155a80 0x7fd7c81492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.914+0000 7fd7c7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7c8155a80 0x7fd7c81492f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45052/0 (socket says 172.21.15.100:45052) 2024-08-17T02:46:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.914+0000 7fd7c7e00640 1 -- 172.21.15.100:0/4193560461 learned_addr learned my addr 172.21.15.100:0/4193560461 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.914+0000 7fd7c7400640 1 --2- 172.21.15.100:0/4193560461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c80c7db0 0x7fd7c8157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.914+0000 7fd7c6a00640 1 --2- 172.21.15.100:0/4193560461 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd7c80c92e0 0x7fd7c8168f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.914+0000 7fd7c7e00640 1 -- 172.21.15.100:0/4193560461 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd7c80c92e0 msgr2=0x7fd7c8168f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.914+0000 7fd7c7e00640 1 --2- 172.21.15.100:0/4193560461 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd7c80c92e0 0x7fd7c8168f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.914+0000 7fd7c7e00640 1 -- 172.21.15.100:0/4193560461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c80c7db0 msgr2=0x7fd7c8157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.914+0000 7fd7c7e00640 1 --2- 172.21.15.100:0/4193560461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c80c7db0 0x7fd7c8157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.914+0000 7fd7c7e00640 1 -- 172.21.15.100:0/4193560461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b8009390 con 0x7fd7c8155a80 2024-08-17T02:46:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.914+0000 7fd7c7e00640 1 --2- 172.21.15.100:0/4193560461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7c8155a80 0x7fd7c81492f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd7c000c860 tx=0x7fd7c0001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:32.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.915+0000 7fd7bea00640 1 -- 172.21.15.100:0/4193560461 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c000ce50 con 0x7fd7c8155a80 2024-08-17T02:46:32.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.915+0000 7fd7bea00640 1 -- 172.21.15.100:0/4193560461 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c000a8e0 con 0x7fd7c8155a80 2024-08-17T02:46:32.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.915+0000 7fd7bea00640 1 -- 172.21.15.100:0/4193560461 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c000aca0 con 0x7fd7c8155a80 2024-08-17T02:46:32.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.915+0000 7fd7ce400640 1 -- 172.21.15.100:0/4193560461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c8169440 con 0x7fd7c8155a80 2024-08-17T02:46:32.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.915+0000 7fd7ce400640 1 -- 172.21.15.100:0/4193560461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c81699d0 con 0x7fd7c8155a80 2024-08-17T02:46:32.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.916+0000 7fd7ce400640 1 -- 172.21.15.100:0/4193560461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c8071050 con 0x7fd7c8155a80 2024-08-17T02:46:32.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.916+0000 7fd7bea00640 1 -- 172.21.15.100:0/4193560461 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd7c0012630 con 0x7fd7c8155a80 2024-08-17T02:46:32.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.917+0000 7fd7bea00640 1 --2- 172.21.15.100:0/4193560461 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd7a8065150 0x7fd7a8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:32.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.917+0000 7fd7bea00640 1 -- 172.21.15.100:0/4193560461 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd7c00826e0 con 0x7fd7c8155a80 2024-08-17T02:46:32.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.917+0000 7fd7c7400640 1 --2- 172.21.15.100:0/4193560461 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd7a8065150 0x7fd7a8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:32.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.918+0000 7fd7c7400640 1 --2- 172.21.15.100:0/4193560461 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd7a8065150 0x7fd7a8067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8034000 tx=0x7fd7b8032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:32.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:32.922+0000 7fd7bea00640 1 -- 172.21.15.100:0/4193560461 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd7c00507b0 con 0x7fd7c8155a80 2024-08-17T02:46:33.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.130+0000 7fd7ce400640 1 -- 172.21.15.100:0/4193560461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd7c816c910 con 0x7fd7c8155a80 2024-08-17T02:46:33.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.738+0000 7fd7bea00640 1 -- 172.21.15.100:0/4193560461 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd7c0053dd0 con 0x7fd7c8155a80 2024-08-17T02:46:33.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.740+0000 7fd7ce400640 1 -- 172.21.15.100:0/4193560461 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd7a8065150 msgr2=0x7fd7a8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:33.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.740+0000 7fd7ce400640 1 --2- 172.21.15.100:0/4193560461 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd7a8065150 0x7fd7a8067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8034000 tx=0x7fd7b8032000 comp rx=0 tx=0).stop 2024-08-17T02:46:33.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.740+0000 7fd7ce400640 1 -- 172.21.15.100:0/4193560461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7c8155a80 msgr2=0x7fd7c81492f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:33.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.740+0000 7fd7ce400640 1 --2- 172.21.15.100:0/4193560461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7c8155a80 0x7fd7c81492f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd7c000c860 tx=0x7fd7c0001690 comp rx=0 tx=0).stop 2024-08-17T02:46:33.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.740+0000 7fd7ce400640 1 -- 172.21.15.100:0/4193560461 shutdown_connections 2024-08-17T02:46:33.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.740+0000 7fd7ce400640 1 --2- 172.21.15.100:0/4193560461 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd7a8065150 0x7fd7a8067600 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:33.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.740+0000 7fd7ce400640 1 --2- 172.21.15.100:0/4193560461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7c8155a80 0x7fd7c81492f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:33.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.740+0000 7fd7ce400640 1 --2- 172.21.15.100:0/4193560461 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd7c80c92e0 0x7fd7c8168f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:33.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.740+0000 7fd7ce400640 1 --2- 172.21.15.100:0/4193560461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c80c7db0 0x7fd7c8157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:33.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.740+0000 7fd7ce400640 1 -- 172.21.15.100:0/4193560461 >> 172.21.15.100:0/4193560461 conn(0x7fd7c8067750 msgr2=0x7fd7c8069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:33.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.741+0000 7fd7ce400640 1 -- 172.21.15.100:0/4193560461 shutdown_connections 2024-08-17T02:46:33.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.741+0000 7fd7ce400640 1 -- 172.21.15.100:0/4193560461 wait complete. 2024-08-17T02:46:33.757 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:46:33.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.904+0000 7f4c19c00640 1 Processor -- start 2024-08-17T02:46:33.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.904+0000 7f4c19c00640 1 -- start start 2024-08-17T02:46:33.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.906+0000 7f4c19c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4c14155550 0x7f4c140aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:33.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.906+0000 7f4c19c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c140afc10 con 0x7f4c1406e080 2024-08-17T02:46:33.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.906+0000 7f4c19c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c140af000 con 0x7f4c14155180 2024-08-17T02:46:33.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.906+0000 7f4c19c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c140af2e0 con 0x7f4c14155550 2024-08-17T02:46:33.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.906+0000 7f4c0a000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4c14155550 0x7f4c140aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:33.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.906+0000 7f4c0a000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4c14155550 0x7f4c140aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45054/0 (socket says 172.21.15.100:45054) 2024-08-17T02:46:33.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.906+0000 7f4c0a000640 1 -- 172.21.15.100:0/2470875989 learned_addr learned my addr 172.21.15.100:0/2470875989 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:33.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.906+0000 7f4c0a000640 1 -- 172.21.15.100:0/2470875989 >> v1:172.21.15.123:6789/0 conn(0x7f4c14155180 legacy=0x7f4c140ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:33.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.906+0000 7f4c0a000640 1 -- 172.21.15.100:0/2470875989 >> v1:172.21.15.100:6789/0 conn(0x7f4c1406e080 legacy=0x7f4c1406e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:33.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.906+0000 7f4c0a000640 1 -- 172.21.15.100:0/2470875989 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c140af5c0 con 0x7f4c14155550 2024-08-17T02:46:33.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.907+0000 7f4c0a000640 1 --2- 172.21.15.100:0/2470875989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c14155550 0x7f4c140aea20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc009910 tx=0x7f4bfc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08cd313f8bab002 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:33.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.908+0000 7f4c12000640 1 -- 172.21.15.100:0/2470875989 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc02ae70 con 0x7f4c14155550 2024-08-17T02:46:33.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.908+0000 7f4c12000640 1 -- 172.21.15.100:0/2470875989 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc032440 con 0x7f4c14155550 2024-08-17T02:46:33.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.908+0000 7f4c12000640 1 -- 172.21.15.100:0/2470875989 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc032820 con 0x7f4c14155550 2024-08-17T02:46:33.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.908+0000 7f4c19c00640 1 -- 172.21.15.100:0/2470875989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c14155550 msgr2=0x7f4c140aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:33.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.908+0000 7f4c19c00640 1 --2- 172.21.15.100:0/2470875989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c14155550 0x7f4c140aea20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc009910 tx=0x7f4bfc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:33.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.908+0000 7f4c19c00640 1 -- 172.21.15.100:0/2470875989 shutdown_connections 2024-08-17T02:46:33.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.908+0000 7f4c19c00640 1 --2- 172.21.15.100:0/2470875989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c14155550 0x7f4c140aea20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:33.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.908+0000 7f4c19c00640 1 -- 172.21.15.100:0/2470875989 >> 172.21.15.100:0/2470875989 conn(0x7f4c140cb9b0 msgr2=0x7f4c140cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:33.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.908+0000 7f4c19c00640 1 -- 172.21.15.100:0/2470875989 shutdown_connections 2024-08-17T02:46:33.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.908+0000 7f4c19c00640 1 -- 172.21.15.100:0/2470875989 wait complete. 2024-08-17T02:46:33.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.910+0000 7f4c19c00640 1 Processor -- start 2024-08-17T02:46:33.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.910+0000 7f4c19c00640 1 -- start start 2024-08-17T02:46:33.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.911+0000 7f4c19c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c1406e080 0x7f4c14152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:33.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.911+0000 7f4c19c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c14155180 0x7f4c14150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:33.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.911+0000 7f4c19c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c14155550 0x7f4c1416c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:33.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.911+0000 7f4c19c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1416c520 con 0x7f4c14155180 2024-08-17T02:46:33.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.911+0000 7f4c19c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c14169440 con 0x7f4c14155550 2024-08-17T02:46:33.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.911+0000 7f4c19c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c14169720 con 0x7f4c1406e080 2024-08-17T02:46:33.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.911+0000 7f4c0a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c14155180 0x7f4c14150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:33.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.911+0000 7f4c0a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c14155180 0x7f4c14150e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45058/0 (socket says 172.21.15.100:45058) 2024-08-17T02:46:33.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.911+0000 7f4c0a000640 1 -- 172.21.15.100:0/1971864077 learned_addr learned my addr 172.21.15.100:0/1971864077 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:33.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.911+0000 7f4c12a00640 1 --2- 172.21.15.100:0/1971864077 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c1406e080 0x7f4c14152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:33.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.911+0000 7f4c13400640 1 --2- 172.21.15.100:0/1971864077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c14155550 0x7f4c1416c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:33.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.911+0000 7f4c0a000640 1 -- 172.21.15.100:0/1971864077 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c1406e080 msgr2=0x7f4c14152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:33.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.911+0000 7f4c0a000640 1 --2- 172.21.15.100:0/1971864077 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c1406e080 0x7f4c14152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:33.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.911+0000 7f4c0a000640 1 -- 172.21.15.100:0/1971864077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c14155550 msgr2=0x7f4c1416c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:33.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.911+0000 7f4c0a000640 1 --2- 172.21.15.100:0/1971864077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c14155550 0x7f4c1416c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:33.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.911+0000 7f4c0a000640 1 -- 172.21.15.100:0/1971864077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bfc009450 con 0x7f4c14155180 2024-08-17T02:46:33.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.911+0000 7f4c12a00640 1 --2- 172.21.15.100:0/1971864077 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c1406e080 0x7f4c14152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:33.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.911+0000 7f4c13400640 1 --2- 172.21.15.100:0/1971864077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c14155550 0x7f4c1416c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:33.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.912+0000 7f4c0a000640 1 --2- 172.21.15.100:0/1971864077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c14155180 0x7f4c14150e20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc009910 tx=0x7f4bfc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:33.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.912+0000 7f4c0aa00640 1 -- 172.21.15.100:0/1971864077 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc031de0 con 0x7f4c14155180 2024-08-17T02:46:33.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.912+0000 7f4c0aa00640 1 -- 172.21.15.100:0/1971864077 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc03d420 con 0x7f4c14155180 2024-08-17T02:46:33.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.912+0000 7f4c19c00640 1 -- 172.21.15.100:0/1971864077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c14169a00 con 0x7f4c14155180 2024-08-17T02:46:33.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.912+0000 7f4c0aa00640 1 -- 172.21.15.100:0/1971864077 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc03d7e0 con 0x7f4c14155180 2024-08-17T02:46:33.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.912+0000 7f4c19c00640 1 -- 172.21.15.100:0/1971864077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c14152bb0 con 0x7f4c14155180 2024-08-17T02:46:33.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.913+0000 7f4c19c00640 1 -- 172.21.15.100:0/1971864077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c14152da0 con 0x7f4c14155180 2024-08-17T02:46:33.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.914+0000 7f4c0aa00640 1 -- 172.21.15.100:0/1971864077 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4bfc039040 con 0x7f4c14155180 2024-08-17T02:46:33.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.915+0000 7f4c0aa00640 1 --2- 172.21.15.100:0/1971864077 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4bf0065150 0x7f4bf0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:33.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.915+0000 7f4c0aa00640 1 -- 172.21.15.100:0/1971864077 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4bfc0a2bc0 con 0x7f4c14155180 2024-08-17T02:46:33.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.915+0000 7f4c12a00640 1 --2- 172.21.15.100:0/1971864077 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4bf0065150 0x7f4bf0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:33.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.915+0000 7f4c12a00640 1 --2- 172.21.15.100:0/1971864077 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4bf0065150 0x7f4bf0067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4c040027e0 tx=0x7f4c04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:33.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:33.919+0000 7f4c0aa00640 1 -- 172.21.15.100:0/1971864077 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4bfc070be0 con 0x7f4c14155180 2024-08-17T02:46:34.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.127+0000 7f4c19c00640 1 -- 172.21.15.100:0/1971864077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c14152da0 con 0x7f4c14155180 2024-08-17T02:46:34.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.128+0000 7f4c0aa00640 1 -- 172.21.15.100:0/1971864077 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4609 (secure 0 0 0) 0x7f4bfc037090 con 0x7f4c14155180 2024-08-17T02:46:34.129 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:34.129 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1972998642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1972998642},{"type":"v1","addr":"172.21.15.100:6836","nonce":1972998642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3961484077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3961484077},{"type":"v1","addr":"172.21.15.100:6837","nonce":3961484077}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4885,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/1763367135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1763367135},{"type":"v1","addr":"172.21.15.123:6834","nonce":1763367135}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:30.114385+0000","modified":"2024-08-17T02:46:33.731841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1541092259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":1541092259},{"type":"v1","addr":"172.21.15.123:6835","nonce":1541092259}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:46:34.129 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 16 2024-08-17T02:46:34.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.130+0000 7f4c19c00640 1 -- 172.21.15.100:0/1971864077 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4bf0065150 msgr2=0x7f4bf0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.130+0000 7f4c19c00640 1 --2- 172.21.15.100:0/1971864077 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4bf0065150 0x7f4bf0067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4c040027e0 tx=0x7f4c04009040 comp rx=0 tx=0).stop 2024-08-17T02:46:34.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.130+0000 7f4c19c00640 1 -- 172.21.15.100:0/1971864077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c14155180 msgr2=0x7f4c14150e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.130+0000 7f4c19c00640 1 --2- 172.21.15.100:0/1971864077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c14155180 0x7f4c14150e20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc009910 tx=0x7f4bfc032000 comp rx=0 tx=0).stop 2024-08-17T02:46:34.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.130+0000 7f4c19c00640 1 -- 172.21.15.100:0/1971864077 shutdown_connections 2024-08-17T02:46:34.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.130+0000 7f4c19c00640 1 --2- 172.21.15.100:0/1971864077 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4bf0065150 0x7f4bf0067600 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.130+0000 7f4c19c00640 1 --2- 172.21.15.100:0/1971864077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c14155550 0x7f4c1416c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.130+0000 7f4c19c00640 1 --2- 172.21.15.100:0/1971864077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c14155180 0x7f4c14150e20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.130+0000 7f4c19c00640 1 --2- 172.21.15.100:0/1971864077 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4c1406e080 0x7f4c14152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.130+0000 7f4c19c00640 1 -- 172.21.15.100:0/1971864077 >> 172.21.15.100:0/1971864077 conn(0x7f4c140cb9b0 msgr2=0x7f4c140ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:34.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.131+0000 7f4c19c00640 1 -- 172.21.15.100:0/1971864077 shutdown_connections 2024-08-17T02:46:34.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.131+0000 7f4c19c00640 1 -- 172.21.15.100:0/1971864077 wait complete. 2024-08-17T02:46:34.147 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:34.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.293+0000 7f784fa00640 1 Processor -- start 2024-08-17T02:46:34.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.293+0000 7f784fa00640 1 -- start start 2024-08-17T02:46:34.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.294+0000 7f784fa00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7848155a20 0x7f78480adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.294+0000 7f784fa00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f784806df00 0x7f78480ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.294+0000 7f784fa00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7848156670 con 0x7f7848155df0 2024-08-17T02:46:34.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.294+0000 7f784fa00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78480b0350 con 0x7f784806df00 2024-08-17T02:46:34.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.294+0000 7f784fa00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784806e5e0 con 0x7f7848155a20 2024-08-17T02:46:34.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.295+0000 7f7847e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7848155df0 0x7f784806d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42116/0 (socket says 172.21.15.100:42116) 2024-08-17T02:46:34.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.295+0000 7f7847e00640 1 -- 172.21.15.100:0/3401627872 learned_addr learned my addr 172.21.15.100:0/3401627872 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:34.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.295+0000 7f784d000640 1 --2- 172.21.15.100:0/3401627872 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7848155a20 0x7f78480adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.295+0000 7f784da00640 1 --2- 172.21.15.100:0/3401627872 >> v2:172.21.15.123:3300/0 conn(0x7f784806df00 0x7f78480ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.295+0000 7f7847400640 1 -- 172.21.15.100:0/3401627872 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031192901 0 0) 0x7f7848156670 con 0x7f7848155df0 2024-08-17T02:46:34.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.295+0000 7f7847400640 1 -- 172.21.15.100:0/3401627872 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78300034e0 con 0x7f7848155df0 2024-08-17T02:46:34.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.295+0000 7f7847400640 1 -- 172.21.15.100:0/3401627872 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3886539787 0 0) 0x7f78300034e0 con 0x7f7848155df0 2024-08-17T02:46:34.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f7847400640 1 -- 172.21.15.100:0/3401627872 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7848155a20 msgr2=0x7f78480adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:34.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f7847400640 1 --2- 172.21.15.100:0/3401627872 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7848155a20 0x7f78480adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f7847400640 1 -- 172.21.15.100:0/3401627872 >> v2:172.21.15.123:3300/0 conn(0x7f784806df00 msgr2=0x7f78480ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:34.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f7847400640 1 --2- 172.21.15.100:0/3401627872 >> v2:172.21.15.123:3300/0 conn(0x7f784806df00 0x7f78480ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f7847400640 1 -- 172.21.15.100:0/3401627872 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784806e8c0 con 0x7f7848155df0 2024-08-17T02:46:34.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f7847400640 1 -- 172.21.15.100:0/3401627872 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1817143124 0 0) 0x7f7834001470 con 0x7f7848155df0 2024-08-17T02:46:34.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f7847400640 1 -- 172.21.15.100:0/3401627872 >> v1:172.21.15.100:6789/0 conn(0x7f7848155df0 legacy=0x7f784806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f7847400640 1 --2- 172.21.15.100:0/3401627872 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f78300039d0 0x7f7830003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f7847400640 1 --2- 172.21.15.100:0/3401627872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7830004780 0x7f7830004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f7847400640 1 --2- 172.21.15.100:0/3401627872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7830005130 0x7f783000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f7847400640 1 -- 172.21.15.100:0/3401627872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784806e5e0 con 0x7f7830004780 2024-08-17T02:46:34.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f7847400640 1 -- 172.21.15.100:0/3401627872 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78300045f0 con 0x7f7830005130 2024-08-17T02:46:34.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f7847400640 1 -- 172.21.15.100:0/3401627872 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783000e1a0 con 0x7f78300039d0 2024-08-17T02:46:34.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f7847e00640 1 --2- 172.21.15.100:0/3401627872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7830004780 0x7f7830004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f784d000640 1 --2- 172.21.15.100:0/3401627872 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f78300039d0 0x7f7830003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f784da00640 1 --2- 172.21.15.100:0/3401627872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7830005130 0x7f783000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f7847e00640 1 -- 172.21.15.100:0/3401627872 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f78300039d0 msgr2=0x7f7830003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:34.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f7847e00640 1 --2- 172.21.15.100:0/3401627872 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f78300039d0 0x7f7830003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f7847e00640 1 -- 172.21.15.100:0/3401627872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7830005130 msgr2=0x7f783000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:34.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f7847e00640 1 --2- 172.21.15.100:0/3401627872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7830005130 0x7f783000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.296+0000 7f7847e00640 1 -- 172.21.15.100:0/3401627872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78300034e0 con 0x7f7830004780 2024-08-17T02:46:34.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.297+0000 7f7847e00640 1 --2- 172.21.15.100:0/3401627872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7830004780 0x7f7830004bf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f783400c2a0 tx=0x7f7834001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6030a38eb1c2dd9a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:34.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.298+0000 7f7847400640 1 -- 172.21.15.100:0/3401627872 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7834005890 con 0x7f7830004780 2024-08-17T02:46:34.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.298+0000 7f7847400640 1 -- 172.21.15.100:0/3401627872 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7834005a30 con 0x7f7830004780 2024-08-17T02:46:34.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.298+0000 7f7847400640 1 -- 172.21.15.100:0/3401627872 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7834005e70 con 0x7f7830004780 2024-08-17T02:46:34.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.298+0000 7f784fa00640 1 -- 172.21.15.100:0/3401627872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7830004780 msgr2=0x7f7830004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.298+0000 7f784fa00640 1 --2- 172.21.15.100:0/3401627872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7830004780 0x7f7830004bf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f783400c2a0 tx=0x7f7834001e90 comp rx=0 tx=0).stop 2024-08-17T02:46:34.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.298+0000 7f784da00640 1 -- 172.21.15.100:0/3401627872 reap_dead start 2024-08-17T02:46:34.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.298+0000 7f784fa00640 1 -- 172.21.15.100:0/3401627872 shutdown_connections 2024-08-17T02:46:34.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.298+0000 7f784fa00640 1 -- 172.21.15.100:0/3401627872 >> 172.21.15.100:0/3401627872 conn(0x7f78480cb9b0 msgr2=0x7f78480cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:34.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.298+0000 7f784fa00640 1 -- 172.21.15.100:0/3401627872 shutdown_connections 2024-08-17T02:46:34.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.298+0000 7f784fa00640 1 -- 172.21.15.100:0/3401627872 wait complete. 2024-08-17T02:46:34.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.300+0000 7f784fa00640 1 Processor -- start 2024-08-17T02:46:34.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.300+0000 7f784fa00640 1 -- start start 2024-08-17T02:46:34.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.300+0000 7f784fa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7830004780 0x7f7848150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.300+0000 7f784fa00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f78480c20b0 0x7f7848168e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.301+0000 7f784fa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78480c3730 0x7f78480c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.301+0000 7f784fa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78480c2f70 con 0x7f78480c3730 2024-08-17T02:46:34.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.301+0000 7f784fa00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7848150e50 con 0x7f7830004780 2024-08-17T02:46:34.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.301+0000 7f784fa00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7848169770 con 0x7f78480c20b0 2024-08-17T02:46:34.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.301+0000 7f784da00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78480c3730 0x7f78480c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.301+0000 7f784da00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78480c3730 0x7f78480c3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45074/0 (socket says 172.21.15.100:45074) 2024-08-17T02:46:34.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.301+0000 7f784da00640 1 -- 172.21.15.100:0/1977677801 learned_addr learned my addr 172.21.15.100:0/1977677801 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:34.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.301+0000 7f784d000640 1 --2- 172.21.15.100:0/1977677801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7830004780 0x7f7848150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.301+0000 7f7847e00640 1 --2- 172.21.15.100:0/1977677801 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f78480c20b0 0x7f7848168e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.301+0000 7f784da00640 1 -- 172.21.15.100:0/1977677801 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f78480c20b0 msgr2=0x7f7848168e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.301+0000 7f784da00640 1 --2- 172.21.15.100:0/1977677801 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f78480c20b0 0x7f7848168e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.301+0000 7f784da00640 1 -- 172.21.15.100:0/1977677801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7830004780 msgr2=0x7f7848150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.301+0000 7f784da00640 1 --2- 172.21.15.100:0/1977677801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7830004780 0x7f7848150910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.301+0000 7f784da00640 1 -- 172.21.15.100:0/1977677801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7848169a50 con 0x7f78480c3730 2024-08-17T02:46:34.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.301+0000 7f784d000640 1 --2- 172.21.15.100:0/1977677801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7830004780 0x7f7848150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:34.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.301+0000 7f7847e00640 1 --2- 172.21.15.100:0/1977677801 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f78480c20b0 0x7f7848168e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:34.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.301+0000 7f784da00640 1 --2- 172.21.15.100:0/1977677801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78480c3730 0x7f78480c3b80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f78480cc600 tx=0x7f784000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:34.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.302+0000 7f783be00640 1 -- 172.21.15.100:0/1977677801 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784000e040 con 0x7f78480c3730 2024-08-17T02:46:34.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.302+0000 7f783be00640 1 -- 172.21.15.100:0/1977677801 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784000f040 con 0x7f78480c3730 2024-08-17T02:46:34.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.302+0000 7f784fa00640 1 -- 172.21.15.100:0/1977677801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78480c3210 con 0x7f78480c3730 2024-08-17T02:46:34.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.302+0000 7f783be00640 1 -- 172.21.15.100:0/1977677801 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840015920 con 0x7f78480c3730 2024-08-17T02:46:34.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.302+0000 7f784fa00640 1 -- 172.21.15.100:0/1977677801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7848169340 con 0x7f78480c3730 2024-08-17T02:46:34.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.303+0000 7f784fa00640 1 -- 172.21.15.100:0/1977677801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78480c3400 con 0x7f78480c3730 2024-08-17T02:46:34.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.303+0000 7f783be00640 1 -- 172.21.15.100:0/1977677801 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7840015cd0 con 0x7f78480c3730 2024-08-17T02:46:34.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.304+0000 7f783be00640 1 --2- 172.21.15.100:0/1977677801 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7828065150 0x7f7828067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.304+0000 7f783be00640 1 -- 172.21.15.100:0/1977677801 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7840082650 con 0x7f78480c3730 2024-08-17T02:46:34.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.304+0000 7f784d000640 1 --2- 172.21.15.100:0/1977677801 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7828065150 0x7f7828067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.305+0000 7f784d000640 1 --2- 172.21.15.100:0/1977677801 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7828065150 0x7f7828067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f783c006e70 tx=0x7f783c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:34.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.308+0000 7f783be00640 1 -- 172.21.15.100:0/1977677801 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7840050730 con 0x7f78480c3730 2024-08-17T02:46:34.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.482+0000 7f784fa00640 1 -- 172.21.15.100:0/1977677801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7848064db0 con 0x7f78480c3730 2024-08-17T02:46:34.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.483+0000 7f783be00640 1 -- 172.21.15.100:0/1977677801 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f7840053d50 con 0x7f78480c3730 2024-08-17T02:46:34.484 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:34.484 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":33,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:46:31.703079+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:28.081485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:29.108765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:34.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.485+0000 7f784fa00640 1 -- 172.21.15.100:0/1977677801 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7828065150 msgr2=0x7f7828067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.485+0000 7f784fa00640 1 --2- 172.21.15.100:0/1977677801 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7828065150 0x7f7828067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f783c006e70 tx=0x7f783c008040 comp rx=0 tx=0).stop 2024-08-17T02:46:34.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.485+0000 7f784fa00640 1 -- 172.21.15.100:0/1977677801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78480c3730 msgr2=0x7f78480c3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.485+0000 7f784fa00640 1 --2- 172.21.15.100:0/1977677801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78480c3730 0x7f78480c3b80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f78480cc600 tx=0x7f784000b040 comp rx=0 tx=0).stop 2024-08-17T02:46:34.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.485+0000 7f784fa00640 1 -- 172.21.15.100:0/1977677801 shutdown_connections 2024-08-17T02:46:34.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.485+0000 7f784fa00640 1 --2- 172.21.15.100:0/1977677801 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7828065150 0x7f7828067600 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.485+0000 7f784fa00640 1 --2- 172.21.15.100:0/1977677801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78480c3730 0x7f78480c3b80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.485+0000 7f784fa00640 1 --2- 172.21.15.100:0/1977677801 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f78480c20b0 0x7f7848168e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.485+0000 7f784fa00640 1 --2- 172.21.15.100:0/1977677801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7830004780 0x7f7848150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.485+0000 7f784fa00640 1 -- 172.21.15.100:0/1977677801 >> 172.21.15.100:0/1977677801 conn(0x7f78480cb9b0 msgr2=0x7f78481581e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:34.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.485+0000 7f784fa00640 1 -- 172.21.15.100:0/1977677801 shutdown_connections 2024-08-17T02:46:34.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.485+0000 7f784fa00640 1 -- 172.21.15.100:0/1977677801 wait complete. 2024-08-17T02:46:34.502 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:46:34.502 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:46:34.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.650+0000 7ff50e600640 1 Processor -- start 2024-08-17T02:46:34.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.650+0000 7ff50e600640 1 -- start start 2024-08-17T02:46:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.651+0000 7ff50e600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff50815c230 0x7ff50806be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.651+0000 7ff50e600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff50815c600 0x7ff50806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.651+0000 7ff50e600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff508066cd0 0x7ff508067130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.651+0000 7ff50e600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff508067670 con 0x7ff50815c600 2024-08-17T02:46:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.651+0000 7ff50e600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff50806b9d0 con 0x7ff508066cd0 2024-08-17T02:46:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.651+0000 7ff50e600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5080aad80 con 0x7ff50815c230 2024-08-17T02:46:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.651+0000 7ff506a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff50815c600 0x7ff50806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.651+0000 7ff506a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff50815c600 0x7ff50806e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45082/0 (socket says 172.21.15.100:45082) 2024-08-17T02:46:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.652+0000 7ff506a00640 1 -- 172.21.15.100:0/2029501808 learned_addr learned my addr 172.21.15.100:0/2029501808 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.652+0000 7ff507e00640 1 --2- 172.21.15.100:0/2029501808 >> v2:172.21.15.123:3300/0 conn(0x7ff508066cd0 0x7ff508067130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.652+0000 7ff507400640 1 --2- 172.21.15.100:0/2029501808 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff50815c230 0x7ff50806be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.652+0000 7ff506a00640 1 -- 172.21.15.100:0/2029501808 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff50815c230 msgr2=0x7ff50806be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.652+0000 7ff506a00640 1 --2- 172.21.15.100:0/2029501808 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff50815c230 0x7ff50806be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.652+0000 7ff506a00640 1 -- 172.21.15.100:0/2029501808 >> v2:172.21.15.123:3300/0 conn(0x7ff508066cd0 msgr2=0x7ff508067130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.652+0000 7ff506a00640 1 --2- 172.21.15.100:0/2029501808 >> v2:172.21.15.123:3300/0 conn(0x7ff508066cd0 0x7ff508067130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.652+0000 7ff506a00640 1 -- 172.21.15.100:0/2029501808 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5080ab060 con 0x7ff50815c600 2024-08-17T02:46:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.652+0000 7ff507400640 1 --2- 172.21.15.100:0/2029501808 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff50815c230 0x7ff50806be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:34.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.653+0000 7ff506a00640 1 --2- 172.21.15.100:0/2029501808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815c600 0x7ff50806e4e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff508069340 tx=0x7ff4f40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf77479e8224349d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:34.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.653+0000 7ff506000640 1 -- 172.21.15.100:0/2029501808 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f402add0 con 0x7ff50815c600 2024-08-17T02:46:34.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.653+0000 7ff506000640 1 -- 172.21.15.100:0/2029501808 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f4032440 con 0x7ff50815c600 2024-08-17T02:46:34.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.653+0000 7ff506000640 1 -- 172.21.15.100:0/2029501808 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4032820 con 0x7ff50815c600 2024-08-17T02:46:34.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.654+0000 7ff50e600640 1 -- 172.21.15.100:0/2029501808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815c600 msgr2=0x7ff50806e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.654+0000 7ff50e600640 1 --2- 172.21.15.100:0/2029501808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815c600 0x7ff50806e4e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff508069340 tx=0x7ff4f40091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.654+0000 7ff50e600640 1 -- 172.21.15.100:0/2029501808 shutdown_connections 2024-08-17T02:46:34.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.654+0000 7ff50e600640 1 --2- 172.21.15.100:0/2029501808 >> v2:172.21.15.123:3300/0 conn(0x7ff508066cd0 0x7ff508067130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.654+0000 7ff50e600640 1 --2- 172.21.15.100:0/2029501808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815c600 0x7ff50806e4e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.654+0000 7ff50e600640 1 --2- 172.21.15.100:0/2029501808 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff50815c230 0x7ff50806be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.654+0000 7ff50e600640 1 -- 172.21.15.100:0/2029501808 >> 172.21.15.100:0/2029501808 conn(0x7ff50806d8f0 msgr2=0x7ff50806dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:34.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.654+0000 7ff50e600640 1 -- 172.21.15.100:0/2029501808 shutdown_connections 2024-08-17T02:46:34.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.654+0000 7ff50e600640 1 -- 172.21.15.100:0/2029501808 wait complete. 2024-08-17T02:46:34.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.655+0000 7ff50e600640 1 Processor -- start 2024-08-17T02:46:34.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.655+0000 7ff50e600640 1 -- start start 2024-08-17T02:46:34.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.656+0000 7ff50e600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff508066cd0 0x7ff508157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.656+0000 7ff50e600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff50815c230 0x7ff50815ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.656+0000 7ff50e600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815c600 0x7ff5080cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.656+0000 7ff50e600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50815d440 con 0x7ff50815c600 2024-08-17T02:46:34.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.656+0000 7ff50e600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50815d720 con 0x7ff508066cd0 2024-08-17T02:46:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.656+0000 7ff50e600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50815da00 con 0x7ff50815c230 2024-08-17T02:46:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.657+0000 7ff507e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815c600 0x7ff5080cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.657+0000 7ff507e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815c600 0x7ff5080cb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45090/0 (socket says 172.21.15.100:45090) 2024-08-17T02:46:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.657+0000 7ff507e00640 1 -- 172.21.15.100:0/1613223768 learned_addr learned my addr 172.21.15.100:0/1613223768 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.657+0000 7ff506a00640 1 --2- 172.21.15.100:0/1613223768 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff50815c230 0x7ff50815ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.657+0000 7ff507400640 1 --2- 172.21.15.100:0/1613223768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff508066cd0 0x7ff508157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.657+0000 7ff507e00640 1 -- 172.21.15.100:0/1613223768 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff50815c230 msgr2=0x7ff50815ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.657+0000 7ff507e00640 1 --2- 172.21.15.100:0/1613223768 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff50815c230 0x7ff50815ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.657+0000 7ff507e00640 1 -- 172.21.15.100:0/1613223768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff508066cd0 msgr2=0x7ff508157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.657+0000 7ff507e00640 1 --2- 172.21.15.100:0/1613223768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff508066cd0 0x7ff508157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.657+0000 7ff507e00640 1 -- 172.21.15.100:0/1613223768 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f4009450 con 0x7ff50815c600 2024-08-17T02:46:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.657+0000 7ff506a00640 1 --2- 172.21.15.100:0/1613223768 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff50815c230 0x7ff50815ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.657+0000 7ff507e00640 1 --2- 172.21.15.100:0/1613223768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815c600 0x7ff5080cb2b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff500009fa0 tx=0x7ff500009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:34.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.657+0000 7ff4fea00640 1 -- 172.21.15.100:0/1613223768 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50000ee60 con 0x7ff50815c600 2024-08-17T02:46:34.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.657+0000 7ff4fea00640 1 -- 172.21.15.100:0/1613223768 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff500014420 con 0x7ff50815c600 2024-08-17T02:46:34.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.657+0000 7ff4fea00640 1 -- 172.21.15.100:0/1613223768 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5000147e0 con 0x7ff50815c600 2024-08-17T02:46:34.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.658+0000 7ff50e600640 1 -- 172.21.15.100:0/1613223768 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50815dce0 con 0x7ff50815c600 2024-08-17T02:46:34.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.658+0000 7ff50e600640 1 -- 172.21.15.100:0/1613223768 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff508157a50 con 0x7ff50815c600 2024-08-17T02:46:34.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.659+0000 7ff50e600640 1 -- 172.21.15.100:0/1613223768 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50815e1e0 con 0x7ff50815c600 2024-08-17T02:46:34.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.659+0000 7ff4fea00640 1 -- 172.21.15.100:0/1613223768 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff500014b50 con 0x7ff50815c600 2024-08-17T02:46:34.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.660+0000 7ff4fea00640 1 --2- 172.21.15.100:0/1613223768 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff4e8065150 0x7ff4e8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.660+0000 7ff4fea00640 1 -- 172.21.15.100:0/1613223768 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff500082ce0 con 0x7ff50815c600 2024-08-17T02:46:34.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.660+0000 7ff507400640 1 --2- 172.21.15.100:0/1613223768 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff4e8065150 0x7ff4e8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.661+0000 7ff507400640 1 --2- 172.21.15.100:0/1613223768 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff4e8065150 0x7ff4e8067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800ab30 tx=0x7ff4f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:34.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.664+0000 7ff4fea00640 1 -- 172.21.15.100:0/1613223768 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff500050d80 con 0x7ff50815c600 2024-08-17T02:46:34.687 INFO:tasks.ceph.mds.b.smithi123.stderr:2024-08-17T02:46:34.687+0000 7f92cfe00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:46:34.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.834+0000 7ff50e600640 1 -- 172.21.15.100:0/1613223768 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff508064db0 con 0x7ff4e8065150 2024-08-17T02:46:34.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.842+0000 7ff4fea00640 1 -- 172.21.15.100:0/1613223768 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253778 (secure 0 0 0) 0x7ff508064db0 con 0x7ff4e8065150 2024-08-17T02:46:34.845 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:34.846 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-08-17T02:46:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.845+0000 7ff50e600640 1 -- 172.21.15.100:0/1613223768 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff4e8065150 msgr2=0x7ff4e8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.845+0000 7ff50e600640 1 --2- 172.21.15.100:0/1613223768 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff4e8065150 0x7ff4e8067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800ab30 tx=0x7ff4f8008040 comp rx=0 tx=0).stop 2024-08-17T02:46:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.845+0000 7ff50e600640 1 -- 172.21.15.100:0/1613223768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815c600 msgr2=0x7ff5080cb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.845+0000 7ff50e600640 1 --2- 172.21.15.100:0/1613223768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815c600 0x7ff5080cb2b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff500009fa0 tx=0x7ff500009900 comp rx=0 tx=0).stop 2024-08-17T02:46:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.845+0000 7ff50e600640 1 -- 172.21.15.100:0/1613223768 shutdown_connections 2024-08-17T02:46:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.845+0000 7ff50e600640 1 --2- 172.21.15.100:0/1613223768 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff4e8065150 0x7ff4e8067600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.845+0000 7ff50e600640 1 --2- 172.21.15.100:0/1613223768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815c600 0x7ff5080cb2b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.845+0000 7ff50e600640 1 --2- 172.21.15.100:0/1613223768 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff50815c230 0x7ff50815ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.845+0000 7ff50e600640 1 --2- 172.21.15.100:0/1613223768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff508066cd0 0x7ff508157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.845+0000 7ff50e600640 1 -- 172.21.15.100:0/1613223768 >> 172.21.15.100:0/1613223768 conn(0x7ff50806d8f0 msgr2=0x7ff508159460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:34.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.845+0000 7ff50e600640 1 -- 172.21.15.100:0/1613223768 shutdown_connections 2024-08-17T02:46:34.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:34.845+0000 7ff50e600640 1 -- 172.21.15.100:0/1613223768 wait complete. 2024-08-17T02:46:34.861 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-08-17T02:46:33.099125+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382580,"kb_used_data":3716,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592140,"statfs":{"total":773094113280,"available":770654351360,"internally_reserved":0,"allocated":3805184,"data_stored":2141529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.403474"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.705821+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:56.692255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.749013+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:35:45.209711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.700402+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:08.121030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.697987+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:47.457054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.710924+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:48.444138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.710004+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:50:32.167618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.701653+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:17.491082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.710086+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:36:56.713833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.700381+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:02:01.829463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.748537+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:35:48.143129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.703851+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:50.933504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.700355+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:35:45.209711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.710112+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:47.457054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.702812+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:35:48.143129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.700947+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:48.880339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.701537+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:50.933504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.703486+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:32.809838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.710202+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:19.114355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.710184+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:08:13.931123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.710102+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:39.923964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.748485+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:29.010448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.705781+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:45:31.024577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.711097+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:39:58.085698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.703870+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:48.880339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.702844+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:29.010448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.748061+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:20:00.364797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.702217+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:20:00.364797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.748059+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:05:22.967368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.701310+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:05:22.967368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.710061+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:57:58.151374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.700347+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:04:35.430933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:29.695663+0000","last_change":"2024-08-17T02:46:29.695663+0000","last_active":"2024-08-17T02:46:29.695663+0000","last_peered":"2024-08-17T02:46:29.695663+0000","last_clean":"2024-08-17T02:46:29.695663+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:29.695663+0000","last_undegraded":"2024-08-17T02:46:29.695663+0000","last_fullsized":"2024-08-17T02:46:29.695663+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:46:28.688919+0000","last_change":"2024-08-17T02:46:28.705847+0000","last_active":"2024-08-17T02:46:28.688919+0000","last_peered":"2024-08-17T02:46:28.688919+0000","last_clean":"2024-08-17T02:46:28.688919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:28.688919+0000","last_undegraded":"2024-08-17T02:46:28.688919+0000","last_fullsized":"2024-08-17T02:46:28.688919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:44.258289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-08-17T02:46:23.896473+0000","last_change":"2024-08-17T02:45:37.011679+0000","last_active":"2024-08-17T02:46:23.896473+0000","last_peered":"2024-08-17T02:46:23.896473+0000","last_clean":"2024-08-17T02:46:23.896473+0000","last_became_active":"2024-08-17T02:45:37.010559+0000","last_became_peered":"2024-08-17T02:45:37.010559+0000","last_unstale":"2024-08-17T02:46:23.896473+0000","last_undegraded":"2024-08-17T02:46:23.896473+0000","last_fullsized":"2024-08-17T02:46:23.896473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:35.708391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:35.708391+0000","last_clean_scrub_stamp":"2024-08-17T02:45:35.708391+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:11.380093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298256,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073584,"statfs":{"total":96636764160,"available":96331350016,"internally_reserved":0,"allocated":913408,"data_stored":706839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":331776,"data_stored":122276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":319488,"data_stored":116471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":319488,"data_stored":116471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]}]},{"osd":3,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":331776,"data_stored":122276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":331776,"data_stored":122276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":331776,"data_stored":122276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298260,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073580,"statfs":{"total":96636764160,"available":96331345920,"internally_reserved":0,"allocated":925696,"data_stored":712644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:46:34.865 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:46:35.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.047+0000 7f0ee2800640 1 Processor -- start 2024-08-17T02:46:35.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.048+0000 7f0ee2800640 1 -- start start 2024-08-17T02:46:35.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.049+0000 7f0ee2800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0edc155900 0x7f0edc155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.049+0000 7f0ee2800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0edc0b0270 0x7f0edc156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.049+0000 7f0ee2800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0edc157690 con 0x7f0edc157b20 2024-08-17T02:46:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.049+0000 7f0ee2800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0edc156a80 con 0x7f0edc0b0270 2024-08-17T02:46:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.049+0000 7f0ee2800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc156d60 con 0x7f0edc155900 2024-08-17T02:46:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.049+0000 7f0ee1e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0edc157b20 0x7f0edc157fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42128/0 (socket says 172.21.15.100:42128) 2024-08-17T02:46:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.049+0000 7f0ee1e00640 1 -- 172.21.15.100:0/2459225211 learned_addr learned my addr 172.21.15.100:0/2459225211 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.049+0000 7f0ee1400640 1 --2- 172.21.15.100:0/2459225211 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0edc155900 0x7f0edc155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.049+0000 7f0ee0a00640 1 --2- 172.21.15.100:0/2459225211 >> v2:172.21.15.123:3300/0 conn(0x7f0edc0b0270 0x7f0edc156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.050+0000 7f0edbe00640 1 -- 172.21.15.100:0/2459225211 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328046613 0 0) 0x7f0edc157690 con 0x7f0edc157b20 2024-08-17T02:46:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.050+0000 7f0edbe00640 1 -- 172.21.15.100:0/2459225211 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec40034e0 con 0x7f0edc157b20 2024-08-17T02:46:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.050+0000 7f0ee1400640 1 -- 172.21.15.100:0/2459225211 >> v2:172.21.15.123:3300/0 conn(0x7f0edc0b0270 msgr2=0x7f0edc156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:35.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.050+0000 7f0ee1400640 1 --2- 172.21.15.100:0/2459225211 >> v2:172.21.15.123:3300/0 conn(0x7f0edc0b0270 0x7f0edc156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.050+0000 7f0ee1400640 1 -- 172.21.15.100:0/2459225211 >> v1:172.21.15.100:6789/0 conn(0x7f0edc157b20 legacy=0x7f0edc157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.050+0000 7f0ee1400640 1 -- 172.21.15.100:0/2459225211 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0edc157040 con 0x7f0edc155900 2024-08-17T02:46:35.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.051+0000 7f0ee1400640 1 --2- 172.21.15.100:0/2459225211 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0edc155900 0x7f0edc155cd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009850 tx=0x7f0ed00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af4179602a0bf6b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:35.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.051+0000 7f0edbe00640 1 -- 172.21.15.100:0/2459225211 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed002ad00 con 0x7f0edc155900 2024-08-17T02:46:35.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.052+0000 7f0edbe00640 1 -- 172.21.15.100:0/2459225211 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed002ae60 con 0x7f0edc155900 2024-08-17T02:46:35.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.052+0000 7f0edbe00640 1 -- 172.21.15.100:0/2459225211 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0032670 con 0x7f0edc155900 2024-08-17T02:46:35.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.052+0000 7f0ee2800640 1 -- 172.21.15.100:0/2459225211 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0edc155900 msgr2=0x7f0edc155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.052+0000 7f0ee2800640 1 --2- 172.21.15.100:0/2459225211 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0edc155900 0x7f0edc155cd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009850 tx=0x7f0ed00090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.052+0000 7f0ee2800640 1 -- 172.21.15.100:0/2459225211 shutdown_connections 2024-08-17T02:46:35.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.052+0000 7f0ee2800640 1 --2- 172.21.15.100:0/2459225211 >> v2:172.21.15.123:3300/0 conn(0x7f0edc0b0270 0x7f0edc156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.052+0000 7f0ee2800640 1 --2- 172.21.15.100:0/2459225211 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0edc155900 0x7f0edc155cd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.052+0000 7f0ee2800640 1 -- 172.21.15.100:0/2459225211 >> 172.21.15.100:0/2459225211 conn(0x7f0edc067750 msgr2=0x7f0edc0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:35.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.052+0000 7f0ee2800640 1 -- 172.21.15.100:0/2459225211 shutdown_connections 2024-08-17T02:46:35.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.052+0000 7f0ee2800640 1 -- 172.21.15.100:0/2459225211 wait complete. 2024-08-17T02:46:35.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.053+0000 7f0ee2800640 1 Processor -- start 2024-08-17T02:46:35.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.054+0000 7f0ee2800640 1 -- start start 2024-08-17T02:46:35.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.054+0000 7f0ee2800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0edc0b0270 0x7f0edc1687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.054+0000 7f0ee2800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0edc155900 0x7f0edc0a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.054+0000 7f0ee2800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0edc157b20 0x7f0edc0a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.054+0000 7f0ee2800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc0acb70 con 0x7f0edc157b20 2024-08-17T02:46:35.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.054+0000 7f0ee2800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc0ab850 con 0x7f0edc155900 2024-08-17T02:46:35.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.054+0000 7f0ee2800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc0abb30 con 0x7f0edc0b0270 2024-08-17T02:46:35.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.055+0000 7f0ee1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0edc157b20 0x7f0edc0a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.055+0000 7f0ee1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0edc157b20 0x7f0edc0a9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45092/0 (socket says 172.21.15.100:45092) 2024-08-17T02:46:35.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.055+0000 7f0ee1e00640 1 -- 172.21.15.100:0/1232062360 learned_addr learned my addr 172.21.15.100:0/1232062360 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:35.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.055+0000 7f0ee1400640 1 --2- 172.21.15.100:0/1232062360 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0edc0b0270 0x7f0edc1687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.055+0000 7f0ee0a00640 1 --2- 172.21.15.100:0/1232062360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0edc155900 0x7f0edc0a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.055+0000 7f0ee1e00640 1 -- 172.21.15.100:0/1232062360 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0edc0b0270 msgr2=0x7f0edc1687e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.055+0000 7f0ee1e00640 1 --2- 172.21.15.100:0/1232062360 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0edc0b0270 0x7f0edc1687e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.055+0000 7f0ee1e00640 1 -- 172.21.15.100:0/1232062360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0edc155900 msgr2=0x7f0edc0a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.055+0000 7f0ee1e00640 1 --2- 172.21.15.100:0/1232062360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0edc155900 0x7f0edc0a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.055+0000 7f0ee1e00640 1 -- 172.21.15.100:0/1232062360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed0009390 con 0x7f0edc157b20 2024-08-17T02:46:35.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.055+0000 7f0ee1400640 1 --2- 172.21.15.100:0/1232062360 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0edc0b0270 0x7f0edc1687e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:35.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.055+0000 7f0ee0a00640 1 --2- 172.21.15.100:0/1232062360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0edc155900 0x7f0edc0a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:35.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.055+0000 7f0ee1e00640 1 --2- 172.21.15.100:0/1232062360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0edc157b20 0x7f0edc0a9e20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4001460 tx=0x7f0ed4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:35.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.056+0000 7f0ed8c00640 1 -- 172.21.15.100:0/1232062360 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed400ce30 con 0x7f0edc157b20 2024-08-17T02:46:35.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.056+0000 7f0ed8c00640 1 -- 172.21.15.100:0/1232062360 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed400a850 con 0x7f0edc157b20 2024-08-17T02:46:35.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.056+0000 7f0ed8c00640 1 -- 172.21.15.100:0/1232062360 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed400ac50 con 0x7f0edc157b20 2024-08-17T02:46:35.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.056+0000 7f0ee2800640 1 -- 172.21.15.100:0/1232062360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0edc0abe10 con 0x7f0edc157b20 2024-08-17T02:46:35.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.056+0000 7f0ee2800640 1 -- 172.21.15.100:0/1232062360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0edc149b20 con 0x7f0edc157b20 2024-08-17T02:46:35.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.057+0000 7f0ee2800640 1 -- 172.21.15.100:0/1232062360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0edc149d70 con 0x7f0edc157b20 2024-08-17T02:46:35.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.058+0000 7f0ed8c00640 1 -- 172.21.15.100:0/1232062360 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0ed4007300 con 0x7f0edc157b20 2024-08-17T02:46:35.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.058+0000 7f0ed8c00640 1 --2- 172.21.15.100:0/1232062360 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0ebc065150 0x7f0ebc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.059+0000 7f0ed8c00640 1 -- 172.21.15.100:0/1232062360 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0ed40825f0 con 0x7f0edc157b20 2024-08-17T02:46:35.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.059+0000 7f0ee1400640 1 --2- 172.21.15.100:0/1232062360 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0ebc065150 0x7f0ebc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.059+0000 7f0ee1400640 1 --2- 172.21.15.100:0/1232062360 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0ebc065150 0x7f0ebc067600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0034000 tx=0x7f0ed0032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:35.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.062+0000 7f0ed8c00640 1 -- 172.21.15.100:0/1232062360 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0ed4050690 con 0x7f0edc157b20 2024-08-17T02:46:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.232+0000 7f0ee2800640 1 -- 172.21.15.100:0/1232062360 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0edc071050 con 0x7f0ebc065150 2024-08-17T02:46:35.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.240+0000 7f0ed8c00640 1 -- 172.21.15.100:0/1232062360 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273955 (secure 0 0 0) 0x7f0edc071050 con 0x7f0ebc065150 2024-08-17T02:46:35.244 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:35.245 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-08-17T02:46:35.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.244+0000 7f0ee2800640 1 -- 172.21.15.100:0/1232062360 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0ebc065150 msgr2=0x7f0ebc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.244+0000 7f0ee2800640 1 --2- 172.21.15.100:0/1232062360 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0ebc065150 0x7f0ebc067600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0034000 tx=0x7f0ed0032000 comp rx=0 tx=0).stop 2024-08-17T02:46:35.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.244+0000 7f0ee2800640 1 -- 172.21.15.100:0/1232062360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0edc157b20 msgr2=0x7f0edc0a9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.244+0000 7f0ee2800640 1 --2- 172.21.15.100:0/1232062360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0edc157b20 0x7f0edc0a9e20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4001460 tx=0x7f0ed4001a40 comp rx=0 tx=0).stop 2024-08-17T02:46:35.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.244+0000 7f0ee2800640 1 -- 172.21.15.100:0/1232062360 shutdown_connections 2024-08-17T02:46:35.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.244+0000 7f0ee2800640 1 --2- 172.21.15.100:0/1232062360 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0ebc065150 0x7f0ebc067600 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.244+0000 7f0ee2800640 1 --2- 172.21.15.100:0/1232062360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0edc157b20 0x7f0edc0a9e20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.244+0000 7f0ee2800640 1 --2- 172.21.15.100:0/1232062360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0edc155900 0x7f0edc0a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.244+0000 7f0ee2800640 1 --2- 172.21.15.100:0/1232062360 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0edc0b0270 0x7f0edc1687e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.244+0000 7f0ee2800640 1 -- 172.21.15.100:0/1232062360 >> 172.21.15.100:0/1232062360 conn(0x7f0edc067750 msgr2=0x7f0edc148700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:35.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.244+0000 7f0ee2800640 1 -- 172.21.15.100:0/1232062360 shutdown_connections 2024-08-17T02:46:35.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.244+0000 7f0ee2800640 1 -- 172.21.15.100:0/1232062360 wait complete. 2024-08-17T02:46:35.259 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-08-17T02:46:35.099461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387148,"kb_used_data":4104,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752587572,"statfs":{"total":773094113280,"available":770649673728,"internally_reserved":0,"allocated":4202496,"data_stored":2318068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000940"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.737833+0000","last_change":"2024-08-17T02:46:30.735807+0000","last_active":"2024-08-17T02:46:30.737833+0000","last_peered":"2024-08-17T02:46:30.737833+0000","last_clean":"2024-08-17T02:46:30.737833+0000","last_became_active":"2024-08-17T02:46:30.735519+0000","last_became_peered":"2024-08-17T02:46:30.735519+0000","last_unstale":"2024-08-17T02:46:30.737833+0000","last_undegraded":"2024-08-17T02:46:30.737833+0000","last_fullsized":"2024-08-17T02:46:30.737833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:36.964725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.740286+0000","last_change":"2024-08-17T02:46:30.735176+0000","last_active":"2024-08-17T02:46:30.740286+0000","last_peered":"2024-08-17T02:46:30.740286+0000","last_clean":"2024-08-17T02:46:30.740286+0000","last_became_active":"2024-08-17T02:46:30.732581+0000","last_became_peered":"2024-08-17T02:46:30.732581+0000","last_unstale":"2024-08-17T02:46:30.740286+0000","last_undegraded":"2024-08-17T02:46:30.740286+0000","last_fullsized":"2024-08-17T02:46:30.740286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:42.677764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.751771+0000","last_change":"2024-08-17T02:46:30.745334+0000","last_active":"2024-08-17T02:46:30.751771+0000","last_peered":"2024-08-17T02:46:30.751771+0000","last_clean":"2024-08-17T02:46:30.751771+0000","last_became_active":"2024-08-17T02:46:30.744695+0000","last_became_peered":"2024-08-17T02:46:30.744695+0000","last_unstale":"2024-08-17T02:46:30.751771+0000","last_undegraded":"2024-08-17T02:46:30.751771+0000","last_fullsized":"2024-08-17T02:46:30.751771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:42.677764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.743248+0000","last_change":"2024-08-17T02:46:30.740582+0000","last_active":"2024-08-17T02:46:30.743248+0000","last_peered":"2024-08-17T02:46:30.743248+0000","last_clean":"2024-08-17T02:46:30.743248+0000","last_became_active":"2024-08-17T02:46:30.739869+0000","last_became_peered":"2024-08-17T02:46:30.739869+0000","last_unstale":"2024-08-17T02:46:30.743248+0000","last_undegraded":"2024-08-17T02:46:30.743248+0000","last_fullsized":"2024-08-17T02:46:30.743248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:50:51.246687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.739225+0000","last_change":"2024-08-17T02:46:30.732895+0000","last_active":"2024-08-17T02:46:30.739225+0000","last_peered":"2024-08-17T02:46:30.739225+0000","last_clean":"2024-08-17T02:46:30.739225+0000","last_became_active":"2024-08-17T02:46:30.732581+0000","last_became_peered":"2024-08-17T02:46:30.732581+0000","last_unstale":"2024-08-17T02:46:30.739225+0000","last_undegraded":"2024-08-17T02:46:30.739225+0000","last_fullsized":"2024-08-17T02:46:30.739225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:32:51.940248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.753341+0000","last_change":"2024-08-17T02:46:30.752463+0000","last_active":"2024-08-17T02:46:30.753341+0000","last_peered":"2024-08-17T02:46:30.753341+0000","last_clean":"2024-08-17T02:46:30.753341+0000","last_became_active":"2024-08-17T02:46:30.752167+0000","last_became_peered":"2024-08-17T02:46:30.752167+0000","last_unstale":"2024-08-17T02:46:30.753341+0000","last_undegraded":"2024-08-17T02:46:30.753341+0000","last_fullsized":"2024-08-17T02:46:30.753341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:19.939226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.746287+0000","last_change":"2024-08-17T02:46:30.736209+0000","last_active":"2024-08-17T02:46:30.746287+0000","last_peered":"2024-08-17T02:46:30.746287+0000","last_clean":"2024-08-17T02:46:30.746287+0000","last_became_active":"2024-08-17T02:46:30.735776+0000","last_became_peered":"2024-08-17T02:46:30.735776+0000","last_unstale":"2024-08-17T02:46:30.746287+0000","last_undegraded":"2024-08-17T02:46:30.746287+0000","last_fullsized":"2024-08-17T02:46:30.746287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:08:17.811527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.751893+0000","last_change":"2024-08-17T02:46:30.747346+0000","last_active":"2024-08-17T02:46:30.751893+0000","last_peered":"2024-08-17T02:46:30.751893+0000","last_clean":"2024-08-17T02:46:30.751893+0000","last_became_active":"2024-08-17T02:46:30.746665+0000","last_became_peered":"2024-08-17T02:46:30.746665+0000","last_unstale":"2024-08-17T02:46:30.751893+0000","last_undegraded":"2024-08-17T02:46:30.751893+0000","last_fullsized":"2024-08-17T02:46:30.751893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:17:11.010963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.743049+0000","last_change":"2024-08-17T02:46:30.740902+0000","last_active":"2024-08-17T02:46:30.743049+0000","last_peered":"2024-08-17T02:46:30.743049+0000","last_clean":"2024-08-17T02:46:30.743049+0000","last_became_active":"2024-08-17T02:46:30.740709+0000","last_became_peered":"2024-08-17T02:46:30.740709+0000","last_unstale":"2024-08-17T02:46:30.743049+0000","last_undegraded":"2024-08-17T02:46:30.743049+0000","last_fullsized":"2024-08-17T02:46:30.743049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:15:57.511442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.743011+0000","last_change":"2024-08-17T02:46:30.734807+0000","last_active":"2024-08-17T02:46:30.743011+0000","last_peered":"2024-08-17T02:46:30.743011+0000","last_clean":"2024-08-17T02:46:30.743011+0000","last_became_active":"2024-08-17T02:46:30.734550+0000","last_became_peered":"2024-08-17T02:46:30.734550+0000","last_unstale":"2024-08-17T02:46:30.743011+0000","last_undegraded":"2024-08-17T02:46:30.743011+0000","last_fullsized":"2024-08-17T02:46:30.743011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:38.743328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.749601+0000","last_change":"2024-08-17T02:46:30.741258+0000","last_active":"2024-08-17T02:46:30.749601+0000","last_peered":"2024-08-17T02:46:30.749601+0000","last_clean":"2024-08-17T02:46:30.749601+0000","last_became_active":"2024-08-17T02:46:30.740987+0000","last_became_peered":"2024-08-17T02:46:30.740987+0000","last_unstale":"2024-08-17T02:46:30.749601+0000","last_undegraded":"2024-08-17T02:46:30.749601+0000","last_fullsized":"2024-08-17T02:46:30.749601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:12.132350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.751687+0000","last_change":"2024-08-17T02:46:30.744064+0000","last_active":"2024-08-17T02:46:30.751687+0000","last_peered":"2024-08-17T02:46:30.751687+0000","last_clean":"2024-08-17T02:46:30.751687+0000","last_became_active":"2024-08-17T02:46:30.743762+0000","last_became_peered":"2024-08-17T02:46:30.743762+0000","last_unstale":"2024-08-17T02:46:30.751687+0000","last_undegraded":"2024-08-17T02:46:30.751687+0000","last_fullsized":"2024-08-17T02:46:30.751687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:11.001906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.726615+0000","last_change":"2024-08-17T02:46:30.724361+0000","last_active":"2024-08-17T02:46:30.726615+0000","last_peered":"2024-08-17T02:46:30.726615+0000","last_clean":"2024-08-17T02:46:30.726615+0000","last_became_active":"2024-08-17T02:46:30.724111+0000","last_became_peered":"2024-08-17T02:46:30.724111+0000","last_unstale":"2024-08-17T02:46:30.726615+0000","last_undegraded":"2024-08-17T02:46:30.726615+0000","last_fullsized":"2024-08-17T02:46:30.726615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:09.127774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.735512+0000","last_change":"2024-08-17T02:46:30.729108+0000","last_active":"2024-08-17T02:46:30.735512+0000","last_peered":"2024-08-17T02:46:30.735512+0000","last_clean":"2024-08-17T02:46:30.735512+0000","last_became_active":"2024-08-17T02:46:30.727900+0000","last_became_peered":"2024-08-17T02:46:30.727900+0000","last_unstale":"2024-08-17T02:46:30.735512+0000","last_undegraded":"2024-08-17T02:46:30.735512+0000","last_fullsized":"2024-08-17T02:46:30.735512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:40:42.215328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.749355+0000","last_change":"2024-08-17T02:46:30.735014+0000","last_active":"2024-08-17T02:46:30.749355+0000","last_peered":"2024-08-17T02:46:30.749355+0000","last_clean":"2024-08-17T02:46:30.749355+0000","last_became_active":"2024-08-17T02:46:30.734741+0000","last_became_peered":"2024-08-17T02:46:30.734741+0000","last_unstale":"2024-08-17T02:46:30.749355+0000","last_undegraded":"2024-08-17T02:46:30.749355+0000","last_fullsized":"2024-08-17T02:46:30.749355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:30:01.669538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.749291+0000","last_change":"2024-08-17T02:46:30.738154+0000","last_active":"2024-08-17T02:46:30.749291+0000","last_peered":"2024-08-17T02:46:30.749291+0000","last_clean":"2024-08-17T02:46:30.749291+0000","last_became_active":"2024-08-17T02:46:30.737914+0000","last_became_peered":"2024-08-17T02:46:30.737914+0000","last_unstale":"2024-08-17T02:46:30.749291+0000","last_undegraded":"2024-08-17T02:46:30.749291+0000","last_fullsized":"2024-08-17T02:46:30.749291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:33:44.481432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.751870+0000","last_change":"2024-08-17T02:46:30.746158+0000","last_active":"2024-08-17T02:46:30.751870+0000","last_peered":"2024-08-17T02:46:30.751870+0000","last_clean":"2024-08-17T02:46:30.751870+0000","last_became_active":"2024-08-17T02:46:30.745715+0000","last_became_peered":"2024-08-17T02:46:30.745715+0000","last_unstale":"2024-08-17T02:46:30.751870+0000","last_undegraded":"2024-08-17T02:46:30.751870+0000","last_fullsized":"2024-08-17T02:46:30.751870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:57:02.666996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.745991+0000","last_change":"2024-08-17T02:46:30.738942+0000","last_active":"2024-08-17T02:46:30.745991+0000","last_peered":"2024-08-17T02:46:30.745991+0000","last_clean":"2024-08-17T02:46:30.745991+0000","last_became_active":"2024-08-17T02:46:30.738478+0000","last_became_peered":"2024-08-17T02:46:30.738478+0000","last_unstale":"2024-08-17T02:46:30.745991+0000","last_undegraded":"2024-08-17T02:46:30.745991+0000","last_fullsized":"2024-08-17T02:46:30.745991+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:13:49.549237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.747164+0000","last_change":"2024-08-17T02:46:30.744411+0000","last_active":"2024-08-17T02:46:30.747164+0000","last_peered":"2024-08-17T02:46:30.747164+0000","last_clean":"2024-08-17T02:46:30.747164+0000","last_became_active":"2024-08-17T02:46:30.743652+0000","last_became_peered":"2024-08-17T02:46:30.743652+0000","last_unstale":"2024-08-17T02:46:30.747164+0000","last_undegraded":"2024-08-17T02:46:30.747164+0000","last_fullsized":"2024-08-17T02:46:30.747164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:46.798682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.736176+0000","last_change":"2024-08-17T02:46:30.728569+0000","last_active":"2024-08-17T02:46:30.736176+0000","last_peered":"2024-08-17T02:46:30.736176+0000","last_clean":"2024-08-17T02:46:30.736176+0000","last_became_active":"2024-08-17T02:46:30.728250+0000","last_became_peered":"2024-08-17T02:46:30.728250+0000","last_unstale":"2024-08-17T02:46:30.736176+0000","last_undegraded":"2024-08-17T02:46:30.736176+0000","last_fullsized":"2024-08-17T02:46:30.736176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:18.497826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.739828+0000","last_change":"2024-08-17T02:46:30.736857+0000","last_active":"2024-08-17T02:46:30.739828+0000","last_peered":"2024-08-17T02:46:30.739828+0000","last_clean":"2024-08-17T02:46:30.739828+0000","last_became_active":"2024-08-17T02:46:30.736570+0000","last_became_peered":"2024-08-17T02:46:30.736570+0000","last_unstale":"2024-08-17T02:46:30.739828+0000","last_undegraded":"2024-08-17T02:46:30.739828+0000","last_fullsized":"2024-08-17T02:46:30.739828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:57:18.615087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.749630+0000","last_change":"2024-08-17T02:46:30.744508+0000","last_active":"2024-08-17T02:46:30.749630+0000","last_peered":"2024-08-17T02:46:30.749630+0000","last_clean":"2024-08-17T02:46:30.749630+0000","last_became_active":"2024-08-17T02:46:30.744243+0000","last_became_peered":"2024-08-17T02:46:30.744243+0000","last_unstale":"2024-08-17T02:46:30.749630+0000","last_undegraded":"2024-08-17T02:46:30.749630+0000","last_fullsized":"2024-08-17T02:46:30.749630+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:18.067973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.735425+0000","last_change":"2024-08-17T02:46:30.729092+0000","last_active":"2024-08-17T02:46:30.735425+0000","last_peered":"2024-08-17T02:46:30.735425+0000","last_clean":"2024-08-17T02:46:30.735425+0000","last_became_active":"2024-08-17T02:46:30.728825+0000","last_became_peered":"2024-08-17T02:46:30.728825+0000","last_unstale":"2024-08-17T02:46:30.735425+0000","last_undegraded":"2024-08-17T02:46:30.735425+0000","last_fullsized":"2024-08-17T02:46:30.735425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:10:07.487610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.733718+0000","last_change":"2024-08-17T02:46:30.723148+0000","last_active":"2024-08-17T02:46:30.733718+0000","last_peered":"2024-08-17T02:46:30.733718+0000","last_clean":"2024-08-17T02:46:30.733718+0000","last_became_active":"2024-08-17T02:46:30.722899+0000","last_became_peered":"2024-08-17T02:46:30.722899+0000","last_unstale":"2024-08-17T02:46:30.733718+0000","last_undegraded":"2024-08-17T02:46:30.733718+0000","last_fullsized":"2024-08-17T02:46:30.733718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:21:47.936899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.741501+0000","last_change":"2024-08-17T02:46:30.734591+0000","last_active":"2024-08-17T02:46:30.741501+0000","last_peered":"2024-08-17T02:46:30.741501+0000","last_clean":"2024-08-17T02:46:30.741501+0000","last_became_active":"2024-08-17T02:46:30.734266+0000","last_became_peered":"2024-08-17T02:46:30.734266+0000","last_unstale":"2024-08-17T02:46:30.741501+0000","last_undegraded":"2024-08-17T02:46:30.741501+0000","last_fullsized":"2024-08-17T02:46:30.741501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:09:11.986729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.744617+0000","last_change":"2024-08-17T02:46:30.738881+0000","last_active":"2024-08-17T02:46:30.744617+0000","last_peered":"2024-08-17T02:46:30.744617+0000","last_clean":"2024-08-17T02:46:30.744617+0000","last_became_active":"2024-08-17T02:46:30.738443+0000","last_became_peered":"2024-08-17T02:46:30.738443+0000","last_unstale":"2024-08-17T02:46:30.744617+0000","last_undegraded":"2024-08-17T02:46:30.744617+0000","last_fullsized":"2024-08-17T02:46:30.744617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:35:28.981348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.740166+0000","last_change":"2024-08-17T02:46:30.732961+0000","last_active":"2024-08-17T02:46:30.740166+0000","last_peered":"2024-08-17T02:46:30.740166+0000","last_clean":"2024-08-17T02:46:30.740166+0000","last_became_active":"2024-08-17T02:46:30.732578+0000","last_became_peered":"2024-08-17T02:46:30.732578+0000","last_unstale":"2024-08-17T02:46:30.740166+0000","last_undegraded":"2024-08-17T02:46:30.740166+0000","last_fullsized":"2024-08-17T02:46:30.740166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:15:57.511442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.725982+0000","last_change":"2024-08-17T02:46:30.717803+0000","last_active":"2024-08-17T02:46:30.725982+0000","last_peered":"2024-08-17T02:46:30.725982+0000","last_clean":"2024-08-17T02:46:30.725982+0000","last_became_active":"2024-08-17T02:46:30.715787+0000","last_became_peered":"2024-08-17T02:46:30.715787+0000","last_unstale":"2024-08-17T02:46:30.725982+0000","last_undegraded":"2024-08-17T02:46:30.725982+0000","last_fullsized":"2024-08-17T02:46:30.725982+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:15:57.511442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.739844+0000","last_change":"2024-08-17T02:46:30.738278+0000","last_active":"2024-08-17T02:46:30.739844+0000","last_peered":"2024-08-17T02:46:30.739844+0000","last_clean":"2024-08-17T02:46:30.739844+0000","last_became_active":"2024-08-17T02:46:30.737886+0000","last_became_peered":"2024-08-17T02:46:30.737886+0000","last_unstale":"2024-08-17T02:46:30.739844+0000","last_undegraded":"2024-08-17T02:46:30.739844+0000","last_fullsized":"2024-08-17T02:46:30.739844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:38.743328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.748933+0000","last_change":"2024-08-17T02:46:30.739354+0000","last_active":"2024-08-17T02:46:30.748933+0000","last_peered":"2024-08-17T02:46:30.748933+0000","last_clean":"2024-08-17T02:46:30.748933+0000","last_became_active":"2024-08-17T02:46:30.738755+0000","last_became_peered":"2024-08-17T02:46:30.738755+0000","last_unstale":"2024-08-17T02:46:30.748933+0000","last_undegraded":"2024-08-17T02:46:30.748933+0000","last_fullsized":"2024-08-17T02:46:30.748933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:40:45.814882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.727420+0000","last_change":"2024-08-17T02:46:30.719699+0000","last_active":"2024-08-17T02:46:30.727420+0000","last_peered":"2024-08-17T02:46:30.727420+0000","last_clean":"2024-08-17T02:46:30.727420+0000","last_became_active":"2024-08-17T02:46:30.719398+0000","last_became_peered":"2024-08-17T02:46:30.719398+0000","last_unstale":"2024-08-17T02:46:30.727420+0000","last_undegraded":"2024-08-17T02:46:30.727420+0000","last_fullsized":"2024-08-17T02:46:30.727420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:19.017338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.749243+0000","last_change":"2024-08-17T02:46:30.735702+0000","last_active":"2024-08-17T02:46:30.749243+0000","last_peered":"2024-08-17T02:46:30.749243+0000","last_clean":"2024-08-17T02:46:30.749243+0000","last_became_active":"2024-08-17T02:46:30.735361+0000","last_became_peered":"2024-08-17T02:46:30.735361+0000","last_unstale":"2024-08-17T02:46:30.749243+0000","last_undegraded":"2024-08-17T02:46:30.749243+0000","last_fullsized":"2024-08-17T02:46:30.749243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:13:39.254576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.735738+0000","last_change":"2024-08-17T02:46:30.730837+0000","last_active":"2024-08-17T02:46:30.735738+0000","last_peered":"2024-08-17T02:46:30.735738+0000","last_clean":"2024-08-17T02:46:30.735738+0000","last_became_active":"2024-08-17T02:46:30.730341+0000","last_became_peered":"2024-08-17T02:46:30.730341+0000","last_unstale":"2024-08-17T02:46:30.735738+0000","last_undegraded":"2024-08-17T02:46:30.735738+0000","last_fullsized":"2024-08-17T02:46:30.735738+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:13:40.872245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.750139+0000","last_change":"2024-08-17T02:46:29.728747+0000","last_active":"2024-08-17T02:46:30.750139+0000","last_peered":"2024-08-17T02:46:30.750139+0000","last_clean":"2024-08-17T02:46:30.750139+0000","last_became_active":"2024-08-17T02:46:29.727501+0000","last_became_peered":"2024-08-17T02:46:29.727501+0000","last_unstale":"2024-08-17T02:46:30.750139+0000","last_undegraded":"2024-08-17T02:46:30.750139+0000","last_fullsized":"2024-08-17T02:46:30.750139+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:56:35.652354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.727968+0000","last_change":"2024-08-17T02:46:30.726551+0000","last_active":"2024-08-17T02:46:30.727968+0000","last_peered":"2024-08-17T02:46:30.727968+0000","last_clean":"2024-08-17T02:46:30.727968+0000","last_became_active":"2024-08-17T02:46:30.726137+0000","last_became_peered":"2024-08-17T02:46:30.726137+0000","last_unstale":"2024-08-17T02:46:30.727968+0000","last_undegraded":"2024-08-17T02:46:30.727968+0000","last_fullsized":"2024-08-17T02:46:30.727968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:50.967221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.735651+0000","last_change":"2024-08-17T02:46:29.726021+0000","last_active":"2024-08-17T02:46:30.735651+0000","last_peered":"2024-08-17T02:46:30.735651+0000","last_clean":"2024-08-17T02:46:30.735651+0000","last_became_active":"2024-08-17T02:46:29.723423+0000","last_became_peered":"2024-08-17T02:46:29.723423+0000","last_unstale":"2024-08-17T02:46:30.735651+0000","last_undegraded":"2024-08-17T02:46:30.735651+0000","last_fullsized":"2024-08-17T02:46:30.735651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:08.121030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.741789+0000","last_change":"2024-08-17T02:46:30.738219+0000","last_active":"2024-08-17T02:46:30.741789+0000","last_peered":"2024-08-17T02:46:30.741789+0000","last_clean":"2024-08-17T02:46:30.741789+0000","last_became_active":"2024-08-17T02:46:30.737968+0000","last_became_peered":"2024-08-17T02:46:30.737968+0000","last_unstale":"2024-08-17T02:46:30.741789+0000","last_undegraded":"2024-08-17T02:46:30.741789+0000","last_fullsized":"2024-08-17T02:46:30.741789+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:49:35.264649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.743930+0000","last_change":"2024-08-17T02:46:29.726159+0000","last_active":"2024-08-17T02:46:30.743930+0000","last_peered":"2024-08-17T02:46:30.743930+0000","last_clean":"2024-08-17T02:46:30.743930+0000","last_became_active":"2024-08-17T02:46:29.725894+0000","last_became_peered":"2024-08-17T02:46:29.725894+0000","last_unstale":"2024-08-17T02:46:30.743930+0000","last_undegraded":"2024-08-17T02:46:30.743930+0000","last_fullsized":"2024-08-17T02:46:30.743930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:35:02.562031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.741436+0000","last_change":"2024-08-17T02:46:30.734047+0000","last_active":"2024-08-17T02:46:30.741436+0000","last_peered":"2024-08-17T02:46:30.741436+0000","last_clean":"2024-08-17T02:46:30.741436+0000","last_became_active":"2024-08-17T02:46:30.733753+0000","last_became_peered":"2024-08-17T02:46:30.733753+0000","last_unstale":"2024-08-17T02:46:30.741436+0000","last_undegraded":"2024-08-17T02:46:30.741436+0000","last_fullsized":"2024-08-17T02:46:30.741436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:40.011623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.732825+0000","last_change":"2024-08-17T02:46:29.725135+0000","last_active":"2024-08-17T02:46:30.732825+0000","last_peered":"2024-08-17T02:46:30.732825+0000","last_clean":"2024-08-17T02:46:30.732825+0000","last_became_active":"2024-08-17T02:46:29.724616+0000","last_became_peered":"2024-08-17T02:46:29.724616+0000","last_unstale":"2024-08-17T02:46:30.732825+0000","last_undegraded":"2024-08-17T02:46:30.732825+0000","last_fullsized":"2024-08-17T02:46:30.732825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:39.923964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.748951+0000","last_change":"2024-08-17T02:46:30.739564+0000","last_active":"2024-08-17T02:46:30.748951+0000","last_peered":"2024-08-17T02:46:30.748951+0000","last_clean":"2024-08-17T02:46:30.748951+0000","last_became_active":"2024-08-17T02:46:30.739086+0000","last_became_peered":"2024-08-17T02:46:30.739086+0000","last_unstale":"2024-08-17T02:46:30.748951+0000","last_undegraded":"2024-08-17T02:46:30.748951+0000","last_fullsized":"2024-08-17T02:46:30.748951+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:23:37.532499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.738099+0000","last_change":"2024-08-17T02:46:29.717681+0000","last_active":"2024-08-17T02:46:30.738099+0000","last_peered":"2024-08-17T02:46:30.738099+0000","last_clean":"2024-08-17T02:46:30.738099+0000","last_became_active":"2024-08-17T02:46:29.717260+0000","last_became_peered":"2024-08-17T02:46:29.717260+0000","last_unstale":"2024-08-17T02:46:30.738099+0000","last_undegraded":"2024-08-17T02:46:30.738099+0000","last_fullsized":"2024-08-17T02:46:30.738099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:02:01.829463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.734027+0000","last_change":"2024-08-17T02:46:30.726179+0000","last_active":"2024-08-17T02:46:30.734027+0000","last_peered":"2024-08-17T02:46:30.734027+0000","last_clean":"2024-08-17T02:46:30.734027+0000","last_became_active":"2024-08-17T02:46:30.725890+0000","last_became_peered":"2024-08-17T02:46:30.725890+0000","last_unstale":"2024-08-17T02:46:30.734027+0000","last_undegraded":"2024-08-17T02:46:30.734027+0000","last_fullsized":"2024-08-17T02:46:30.734027+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:50:51.246687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.739580+0000","last_change":"2024-08-17T02:46:29.726951+0000","last_active":"2024-08-17T02:46:30.739580+0000","last_peered":"2024-08-17T02:46:30.739580+0000","last_clean":"2024-08-17T02:46:30.739580+0000","last_became_active":"2024-08-17T02:46:29.726711+0000","last_became_peered":"2024-08-17T02:46:29.726711+0000","last_unstale":"2024-08-17T02:46:30.739580+0000","last_undegraded":"2024-08-17T02:46:30.739580+0000","last_fullsized":"2024-08-17T02:46:30.739580+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:35:48.143129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.734741+0000","last_change":"2024-08-17T02:46:30.732353+0000","last_active":"2024-08-17T02:46:30.734741+0000","last_peered":"2024-08-17T02:46:30.734741+0000","last_clean":"2024-08-17T02:46:30.734741+0000","last_became_active":"2024-08-17T02:46:30.732075+0000","last_became_peered":"2024-08-17T02:46:30.732075+0000","last_unstale":"2024-08-17T02:46:30.734741+0000","last_undegraded":"2024-08-17T02:46:30.734741+0000","last_fullsized":"2024-08-17T02:46:30.734741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:40.011623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.717495+0000","last_change":"2024-08-17T02:46:29.720865+0000","last_active":"2024-08-17T02:46:30.717495+0000","last_peered":"2024-08-17T02:46:30.717495+0000","last_clean":"2024-08-17T02:46:30.717495+0000","last_became_active":"2024-08-17T02:46:29.720604+0000","last_became_peered":"2024-08-17T02:46:29.720604+0000","last_unstale":"2024-08-17T02:46:30.717495+0000","last_undegraded":"2024-08-17T02:46:30.717495+0000","last_fullsized":"2024-08-17T02:46:30.717495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:42.410529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.746803+0000","last_change":"2024-08-17T02:46:30.745213+0000","last_active":"2024-08-17T02:46:30.746803+0000","last_peered":"2024-08-17T02:46:30.746803+0000","last_clean":"2024-08-17T02:46:30.746803+0000","last_became_active":"2024-08-17T02:46:30.744965+0000","last_became_peered":"2024-08-17T02:46:30.744965+0000","last_unstale":"2024-08-17T02:46:30.746803+0000","last_undegraded":"2024-08-17T02:46:30.746803+0000","last_fullsized":"2024-08-17T02:46:30.746803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:49:35.264649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.731890+0000","last_change":"2024-08-17T02:46:29.724444+0000","last_active":"2024-08-17T02:46:30.731890+0000","last_peered":"2024-08-17T02:46:30.731890+0000","last_clean":"2024-08-17T02:46:30.731890+0000","last_became_active":"2024-08-17T02:46:29.722871+0000","last_became_peered":"2024-08-17T02:46:29.722871+0000","last_unstale":"2024-08-17T02:46:30.731890+0000","last_undegraded":"2024-08-17T02:46:30.731890+0000","last_fullsized":"2024-08-17T02:46:30.731890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:29.010448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.751994+0000","last_change":"2024-08-17T02:46:30.747375+0000","last_active":"2024-08-17T02:46:30.751994+0000","last_peered":"2024-08-17T02:46:30.751994+0000","last_clean":"2024-08-17T02:46:30.751994+0000","last_became_active":"2024-08-17T02:46:30.742414+0000","last_became_peered":"2024-08-17T02:46:30.742414+0000","last_unstale":"2024-08-17T02:46:30.751994+0000","last_undegraded":"2024-08-17T02:46:30.751994+0000","last_fullsized":"2024-08-17T02:46:30.751994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:32.706956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.718320+0000","last_change":"2024-08-17T02:46:29.724226+0000","last_active":"2024-08-17T02:46:30.718320+0000","last_peered":"2024-08-17T02:46:30.718320+0000","last_clean":"2024-08-17T02:46:30.718320+0000","last_became_active":"2024-08-17T02:46:29.723957+0000","last_became_peered":"2024-08-17T02:46:29.723957+0000","last_unstale":"2024-08-17T02:46:30.718320+0000","last_undegraded":"2024-08-17T02:46:30.718320+0000","last_fullsized":"2024-08-17T02:46:30.718320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:57:17.608343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.746071+0000","last_change":"2024-08-17T02:46:30.738821+0000","last_active":"2024-08-17T02:46:30.746071+0000","last_peered":"2024-08-17T02:46:30.746071+0000","last_clean":"2024-08-17T02:46:30.746071+0000","last_became_active":"2024-08-17T02:46:30.738571+0000","last_became_peered":"2024-08-17T02:46:30.738571+0000","last_unstale":"2024-08-17T02:46:30.746071+0000","last_undegraded":"2024-08-17T02:46:30.746071+0000","last_fullsized":"2024-08-17T02:46:30.746071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:30:01.669538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.710298+0000","last_change":"2024-08-17T02:46:29.721802+0000","last_active":"2024-08-17T02:46:30.710298+0000","last_peered":"2024-08-17T02:46:30.710298+0000","last_clean":"2024-08-17T02:46:30.710298+0000","last_became_active":"2024-08-17T02:46:29.721542+0000","last_became_peered":"2024-08-17T02:46:29.721542+0000","last_unstale":"2024-08-17T02:46:30.710298+0000","last_undegraded":"2024-08-17T02:46:30.710298+0000","last_fullsized":"2024-08-17T02:46:30.710298+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:48.880339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.735952+0000","last_change":"2024-08-17T02:46:30.730515+0000","last_active":"2024-08-17T02:46:30.735952+0000","last_peered":"2024-08-17T02:46:30.735952+0000","last_clean":"2024-08-17T02:46:30.735952+0000","last_became_active":"2024-08-17T02:46:30.729608+0000","last_became_peered":"2024-08-17T02:46:30.729608+0000","last_unstale":"2024-08-17T02:46:30.735952+0000","last_undegraded":"2024-08-17T02:46:30.735952+0000","last_fullsized":"2024-08-17T02:46:30.735952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:08.411551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.744415+0000","last_change":"2024-08-17T02:46:29.723393+0000","last_active":"2024-08-17T02:46:30.744415+0000","last_peered":"2024-08-17T02:46:30.744415+0000","last_clean":"2024-08-17T02:46:30.744415+0000","last_became_active":"2024-08-17T02:46:29.722669+0000","last_became_peered":"2024-08-17T02:46:29.722669+0000","last_unstale":"2024-08-17T02:46:30.744415+0000","last_undegraded":"2024-08-17T02:46:30.744415+0000","last_fullsized":"2024-08-17T02:46:30.744415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:17.491082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.751792+0000","last_change":"2024-08-17T02:46:30.745522+0000","last_active":"2024-08-17T02:46:30.751792+0000","last_peered":"2024-08-17T02:46:30.751792+0000","last_clean":"2024-08-17T02:46:30.751792+0000","last_became_active":"2024-08-17T02:46:30.745097+0000","last_became_peered":"2024-08-17T02:46:30.745097+0000","last_unstale":"2024-08-17T02:46:30.751792+0000","last_undegraded":"2024-08-17T02:46:30.751792+0000","last_fullsized":"2024-08-17T02:46:30.751792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:24:33.028465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.748177+0000","last_change":"2024-08-17T02:46:29.725538+0000","last_active":"2024-08-17T02:46:30.748177+0000","last_peered":"2024-08-17T02:46:30.748177+0000","last_clean":"2024-08-17T02:46:30.748177+0000","last_became_active":"2024-08-17T02:46:29.725305+0000","last_became_peered":"2024-08-17T02:46:29.725305+0000","last_unstale":"2024-08-17T02:46:30.748177+0000","last_undegraded":"2024-08-17T02:46:30.748177+0000","last_fullsized":"2024-08-17T02:46:30.748177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:03.526607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.753317+0000","last_change":"2024-08-17T02:46:30.752514+0000","last_active":"2024-08-17T02:46:30.753317+0000","last_peered":"2024-08-17T02:46:30.753317+0000","last_clean":"2024-08-17T02:46:30.753317+0000","last_became_active":"2024-08-17T02:46:30.752268+0000","last_became_peered":"2024-08-17T02:46:30.752268+0000","last_unstale":"2024-08-17T02:46:30.753317+0000","last_undegraded":"2024-08-17T02:46:30.753317+0000","last_fullsized":"2024-08-17T02:46:30.753317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:48.605519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.730899+0000","last_change":"2024-08-17T02:46:29.717249+0000","last_active":"2024-08-17T02:46:30.730899+0000","last_peered":"2024-08-17T02:46:30.730899+0000","last_clean":"2024-08-17T02:46:30.730899+0000","last_became_active":"2024-08-17T02:46:29.716943+0000","last_became_peered":"2024-08-17T02:46:29.716943+0000","last_unstale":"2024-08-17T02:46:30.730899+0000","last_undegraded":"2024-08-17T02:46:30.730899+0000","last_fullsized":"2024-08-17T02:46:30.730899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:20:00.364797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.735887+0000","last_change":"2024-08-17T02:46:30.729648+0000","last_active":"2024-08-17T02:46:30.735887+0000","last_peered":"2024-08-17T02:46:30.735887+0000","last_clean":"2024-08-17T02:46:30.735887+0000","last_became_active":"2024-08-17T02:46:30.727534+0000","last_became_peered":"2024-08-17T02:46:30.727534+0000","last_unstale":"2024-08-17T02:46:30.735887+0000","last_undegraded":"2024-08-17T02:46:30.735887+0000","last_fullsized":"2024-08-17T02:46:30.735887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:32.706956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.715345+0000","last_change":"2024-08-17T02:46:29.725420+0000","last_active":"2024-08-17T02:46:30.715345+0000","last_peered":"2024-08-17T02:46:30.715345+0000","last_clean":"2024-08-17T02:46:30.715345+0000","last_became_active":"2024-08-17T02:46:29.725177+0000","last_became_peered":"2024-08-17T02:46:29.725177+0000","last_unstale":"2024-08-17T02:46:30.715345+0000","last_undegraded":"2024-08-17T02:46:30.715345+0000","last_fullsized":"2024-08-17T02:46:30.715345+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:48.880339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.749225+0000","last_change":"2024-08-17T02:46:30.735655+0000","last_active":"2024-08-17T02:46:30.749225+0000","last_peered":"2024-08-17T02:46:30.749225+0000","last_clean":"2024-08-17T02:46:30.749225+0000","last_became_active":"2024-08-17T02:46:30.735344+0000","last_became_peered":"2024-08-17T02:46:30.735344+0000","last_unstale":"2024-08-17T02:46:30.749225+0000","last_undegraded":"2024-08-17T02:46:30.749225+0000","last_fullsized":"2024-08-17T02:46:30.749225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:57:34.232522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.717554+0000","last_change":"2024-08-17T02:46:29.724113+0000","last_active":"2024-08-17T02:46:30.717554+0000","last_peered":"2024-08-17T02:46:30.717554+0000","last_clean":"2024-08-17T02:46:30.717554+0000","last_became_active":"2024-08-17T02:46:29.723752+0000","last_became_peered":"2024-08-17T02:46:29.723752+0000","last_unstale":"2024-08-17T02:46:30.717554+0000","last_undegraded":"2024-08-17T02:46:30.717554+0000","last_fullsized":"2024-08-17T02:46:30.717554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:13:39.865501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.740151+0000","last_change":"2024-08-17T02:46:30.738314+0000","last_active":"2024-08-17T02:46:30.740151+0000","last_peered":"2024-08-17T02:46:30.740151+0000","last_clean":"2024-08-17T02:46:30.740151+0000","last_became_active":"2024-08-17T02:46:30.738054+0000","last_became_peered":"2024-08-17T02:46:30.738054+0000","last_unstale":"2024-08-17T02:46:30.740151+0000","last_undegraded":"2024-08-17T02:46:30.740151+0000","last_fullsized":"2024-08-17T02:46:30.740151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:38.760243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.744557+0000","last_change":"2024-08-17T02:46:29.723950+0000","last_active":"2024-08-17T02:46:30.744557+0000","last_peered":"2024-08-17T02:46:30.744557+0000","last_clean":"2024-08-17T02:46:30.744557+0000","last_became_active":"2024-08-17T02:46:29.722820+0000","last_became_peered":"2024-08-17T02:46:29.722820+0000","last_unstale":"2024-08-17T02:46:30.744557+0000","last_undegraded":"2024-08-17T02:46:30.744557+0000","last_fullsized":"2024-08-17T02:46:30.744557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:04:20.567073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.751885+0000","last_change":"2024-08-17T02:46:30.746334+0000","last_active":"2024-08-17T02:46:30.751885+0000","last_peered":"2024-08-17T02:46:30.751885+0000","last_clean":"2024-08-17T02:46:30.751885+0000","last_became_active":"2024-08-17T02:46:30.744795+0000","last_became_peered":"2024-08-17T02:46:30.744795+0000","last_unstale":"2024-08-17T02:46:30.751885+0000","last_undegraded":"2024-08-17T02:46:30.751885+0000","last_fullsized":"2024-08-17T02:46:30.751885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:09:11.986729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.734749+0000","last_change":"2024-08-17T02:46:29.723137+0000","last_active":"2024-08-17T02:46:30.734749+0000","last_peered":"2024-08-17T02:46:30.734749+0000","last_clean":"2024-08-17T02:46:30.734749+0000","last_became_active":"2024-08-17T02:46:29.722195+0000","last_became_peered":"2024-08-17T02:46:29.722195+0000","last_unstale":"2024-08-17T02:46:30.734749+0000","last_undegraded":"2024-08-17T02:46:30.734749+0000","last_fullsized":"2024-08-17T02:46:30.734749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:08.121030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.749836+0000","last_change":"2024-08-17T02:46:30.734851+0000","last_active":"2024-08-17T02:46:30.749836+0000","last_peered":"2024-08-17T02:46:30.749836+0000","last_clean":"2024-08-17T02:46:30.749836+0000","last_became_active":"2024-08-17T02:46:30.734379+0000","last_became_peered":"2024-08-17T02:46:30.734379+0000","last_unstale":"2024-08-17T02:46:30.749836+0000","last_undegraded":"2024-08-17T02:46:30.749836+0000","last_fullsized":"2024-08-17T02:46:30.749836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:03.310177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.731117+0000","last_change":"2024-08-17T02:46:29.724260+0000","last_active":"2024-08-17T02:46:30.731117+0000","last_peered":"2024-08-17T02:46:30.731117+0000","last_clean":"2024-08-17T02:46:30.731117+0000","last_became_active":"2024-08-17T02:46:29.723929+0000","last_became_peered":"2024-08-17T02:46:29.723929+0000","last_unstale":"2024-08-17T02:46:30.731117+0000","last_undegraded":"2024-08-17T02:46:30.731117+0000","last_fullsized":"2024-08-17T02:46:30.731117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:05:22.967368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.743100+0000","last_change":"2024-08-17T02:46:30.740066+0000","last_active":"2024-08-17T02:46:30.743100+0000","last_peered":"2024-08-17T02:46:30.743100+0000","last_clean":"2024-08-17T02:46:30.743100+0000","last_became_active":"2024-08-17T02:46:30.739812+0000","last_became_peered":"2024-08-17T02:46:30.739812+0000","last_unstale":"2024-08-17T02:46:30.743100+0000","last_undegraded":"2024-08-17T02:46:30.743100+0000","last_fullsized":"2024-08-17T02:46:30.743100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:18.067973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.732909+0000","last_change":"2024-08-17T02:46:29.714150+0000","last_active":"2024-08-17T02:46:30.732909+0000","last_peered":"2024-08-17T02:46:30.732909+0000","last_clean":"2024-08-17T02:46:30.732909+0000","last_became_active":"2024-08-17T02:46:29.713895+0000","last_became_peered":"2024-08-17T02:46:29.713895+0000","last_unstale":"2024-08-17T02:46:30.732909+0000","last_undegraded":"2024-08-17T02:46:30.732909+0000","last_fullsized":"2024-08-17T02:46:30.732909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:32.809838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.741018+0000","last_change":"2024-08-17T02:46:30.737712+0000","last_active":"2024-08-17T02:46:30.741018+0000","last_peered":"2024-08-17T02:46:30.741018+0000","last_clean":"2024-08-17T02:46:30.741018+0000","last_became_active":"2024-08-17T02:46:30.736706+0000","last_became_peered":"2024-08-17T02:46:30.736706+0000","last_unstale":"2024-08-17T02:46:30.741018+0000","last_undegraded":"2024-08-17T02:46:30.741018+0000","last_fullsized":"2024-08-17T02:46:30.741018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:35:03.568775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.730008+0000","last_change":"2024-08-17T02:46:29.718934+0000","last_active":"2024-08-17T02:46:30.730008+0000","last_peered":"2024-08-17T02:46:30.730008+0000","last_clean":"2024-08-17T02:46:30.730008+0000","last_became_active":"2024-08-17T02:46:29.717540+0000","last_became_peered":"2024-08-17T02:46:29.717540+0000","last_unstale":"2024-08-17T02:46:30.730008+0000","last_undegraded":"2024-08-17T02:46:30.730008+0000","last_fullsized":"2024-08-17T02:46:30.730008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:04:35.430933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.739275+0000","last_change":"2024-08-17T02:46:30.735293+0000","last_active":"2024-08-17T02:46:30.739275+0000","last_peered":"2024-08-17T02:46:30.739275+0000","last_clean":"2024-08-17T02:46:30.739275+0000","last_became_active":"2024-08-17T02:46:30.734378+0000","last_became_peered":"2024-08-17T02:46:30.734378+0000","last_unstale":"2024-08-17T02:46:30.739275+0000","last_undegraded":"2024-08-17T02:46:30.739275+0000","last_fullsized":"2024-08-17T02:46:30.739275+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:02:02.836207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.743542+0000","last_change":"2024-08-17T02:46:29.722368+0000","last_active":"2024-08-17T02:46:30.743542+0000","last_peered":"2024-08-17T02:46:30.743542+0000","last_clean":"2024-08-17T02:46:30.743542+0000","last_became_active":"2024-08-17T02:46:29.722116+0000","last_became_peered":"2024-08-17T02:46:29.722116+0000","last_unstale":"2024-08-17T02:46:30.743542+0000","last_undegraded":"2024-08-17T02:46:30.743542+0000","last_fullsized":"2024-08-17T02:46:30.743542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:02:01.829463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.719363+0000","last_change":"2024-08-17T02:46:30.714189+0000","last_active":"2024-08-17T02:46:30.719363+0000","last_peered":"2024-08-17T02:46:30.719363+0000","last_clean":"2024-08-17T02:46:30.719363+0000","last_became_active":"2024-08-17T02:46:30.713924+0000","last_became_peered":"2024-08-17T02:46:30.713924+0000","last_unstale":"2024-08-17T02:46:30.719363+0000","last_undegraded":"2024-08-17T02:46:30.719363+0000","last_fullsized":"2024-08-17T02:46:30.719363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:04:36.437677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.715785+0000","last_change":"2024-08-17T02:46:29.724945+0000","last_active":"2024-08-17T02:46:30.715785+0000","last_peered":"2024-08-17T02:46:30.715785+0000","last_clean":"2024-08-17T02:46:30.715785+0000","last_became_active":"2024-08-17T02:46:29.724636+0000","last_became_peered":"2024-08-17T02:46:29.724636+0000","last_unstale":"2024-08-17T02:46:30.715785+0000","last_undegraded":"2024-08-17T02:46:30.715785+0000","last_fullsized":"2024-08-17T02:46:30.715785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:05:35.818656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.715768+0000","last_change":"2024-08-17T02:46:30.712541+0000","last_active":"2024-08-17T02:46:30.715768+0000","last_peered":"2024-08-17T02:46:30.715768+0000","last_clean":"2024-08-17T02:46:30.715768+0000","last_became_active":"2024-08-17T02:46:30.712170+0000","last_became_peered":"2024-08-17T02:46:30.712170+0000","last_unstale":"2024-08-17T02:46:30.715768+0000","last_undegraded":"2024-08-17T02:46:30.715768+0000","last_fullsized":"2024-08-17T02:46:30.715768+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:35:46.216455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.730241+0000","last_change":"2024-08-17T02:46:29.725770+0000","last_active":"2024-08-17T02:46:30.730241+0000","last_peered":"2024-08-17T02:46:30.730241+0000","last_clean":"2024-08-17T02:46:30.730241+0000","last_became_active":"2024-08-17T02:46:29.722376+0000","last_became_peered":"2024-08-17T02:46:29.722376+0000","last_unstale":"2024-08-17T02:46:30.730241+0000","last_undegraded":"2024-08-17T02:46:30.730241+0000","last_fullsized":"2024-08-17T02:46:30.730241+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:08.121030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.746264+0000","last_change":"2024-08-17T02:46:30.736016+0000","last_active":"2024-08-17T02:46:30.746264+0000","last_peered":"2024-08-17T02:46:30.746264+0000","last_clean":"2024-08-17T02:46:30.746264+0000","last_became_active":"2024-08-17T02:46:30.735380+0000","last_became_peered":"2024-08-17T02:46:30.735380+0000","last_unstale":"2024-08-17T02:46:30.746264+0000","last_undegraded":"2024-08-17T02:46:30.746264+0000","last_fullsized":"2024-08-17T02:46:30.746264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:38:21.963129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.710933+0000","last_change":"2024-08-17T02:46:29.731978+0000","last_active":"2024-08-17T02:46:30.710933+0000","last_peered":"2024-08-17T02:46:30.710933+0000","last_clean":"2024-08-17T02:46:30.710933+0000","last_became_active":"2024-08-17T02:46:29.731401+0000","last_became_peered":"2024-08-17T02:46:29.731401+0000","last_unstale":"2024-08-17T02:46:30.710933+0000","last_undegraded":"2024-08-17T02:46:30.710933+0000","last_fullsized":"2024-08-17T02:46:30.710933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:35:02.562031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.739134+0000","last_change":"2024-08-17T02:46:30.731058+0000","last_active":"2024-08-17T02:46:30.739134+0000","last_peered":"2024-08-17T02:46:30.739134+0000","last_clean":"2024-08-17T02:46:30.739134+0000","last_became_active":"2024-08-17T02:46:30.729375+0000","last_became_peered":"2024-08-17T02:46:30.729375+0000","last_unstale":"2024-08-17T02:46:30.739134+0000","last_undegraded":"2024-08-17T02:46:30.739134+0000","last_fullsized":"2024-08-17T02:46:30.739134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:49.887083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.745899+0000","last_change":"2024-08-17T02:46:29.725228+0000","last_active":"2024-08-17T02:46:30.745899+0000","last_peered":"2024-08-17T02:46:30.745899+0000","last_clean":"2024-08-17T02:46:30.745899+0000","last_became_active":"2024-08-17T02:46:29.724939+0000","last_became_peered":"2024-08-17T02:46:29.724939+0000","last_unstale":"2024-08-17T02:46:30.745899+0000","last_undegraded":"2024-08-17T02:46:30.745899+0000","last_fullsized":"2024-08-17T02:46:30.745899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:04:35.430933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.749817+0000","last_change":"2024-08-17T02:46:30.734693+0000","last_active":"2024-08-17T02:46:30.749817+0000","last_peered":"2024-08-17T02:46:30.749817+0000","last_clean":"2024-08-17T02:46:30.749817+0000","last_became_active":"2024-08-17T02:46:30.734034+0000","last_became_peered":"2024-08-17T02:46:30.734034+0000","last_unstale":"2024-08-17T02:46:30.749817+0000","last_undegraded":"2024-08-17T02:46:30.749817+0000","last_fullsized":"2024-08-17T02:46:30.749817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:40:42.215328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:46:32.847341+0000","last_change":"2024-08-17T02:46:29.726275+0000","last_active":"2024-08-17T02:46:32.847341+0000","last_peered":"2024-08-17T02:46:32.847341+0000","last_clean":"2024-08-17T02:46:32.847341+0000","last_became_active":"2024-08-17T02:46:29.725563+0000","last_became_peered":"2024-08-17T02:46:29.725563+0000","last_unstale":"2024-08-17T02:46:32.847341+0000","last_undegraded":"2024-08-17T02:46:32.847341+0000","last_fullsized":"2024-08-17T02:46:32.847341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:04:35.430933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.741168+0000","last_change":"2024-08-17T02:46:30.737375+0000","last_active":"2024-08-17T02:46:30.741168+0000","last_peered":"2024-08-17T02:46:30.741168+0000","last_clean":"2024-08-17T02:46:30.741168+0000","last_became_active":"2024-08-17T02:46:30.737146+0000","last_became_peered":"2024-08-17T02:46:30.737146+0000","last_unstale":"2024-08-17T02:46:30.741168+0000","last_undegraded":"2024-08-17T02:46:30.741168+0000","last_fullsized":"2024-08-17T02:46:30.741168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:57:18.615087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.714564+0000","last_change":"2024-08-17T02:46:29.722439+0000","last_active":"2024-08-17T02:46:30.714564+0000","last_peered":"2024-08-17T02:46:30.714564+0000","last_clean":"2024-08-17T02:46:30.714564+0000","last_became_active":"2024-08-17T02:46:29.722172+0000","last_became_peered":"2024-08-17T02:46:29.722172+0000","last_unstale":"2024-08-17T02:46:30.714564+0000","last_undegraded":"2024-08-17T02:46:30.714564+0000","last_fullsized":"2024-08-17T02:46:30.714564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:02:01.829463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.728011+0000","last_change":"2024-08-17T02:46:30.721942+0000","last_active":"2024-08-17T02:46:30.728011+0000","last_peered":"2024-08-17T02:46:30.728011+0000","last_clean":"2024-08-17T02:46:30.728011+0000","last_became_active":"2024-08-17T02:46:30.721697+0000","last_became_peered":"2024-08-17T02:46:30.721697+0000","last_unstale":"2024-08-17T02:46:30.728011+0000","last_undegraded":"2024-08-17T02:46:30.728011+0000","last_fullsized":"2024-08-17T02:46:30.728011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:55:50.020228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.710234+0000","last_change":"2024-08-17T02:46:29.724290+0000","last_active":"2024-08-17T02:46:30.710234+0000","last_peered":"2024-08-17T02:46:30.710234+0000","last_clean":"2024-08-17T02:46:30.710234+0000","last_became_active":"2024-08-17T02:46:29.724040+0000","last_became_peered":"2024-08-17T02:46:29.724040+0000","last_unstale":"2024-08-17T02:46:30.710234+0000","last_undegraded":"2024-08-17T02:46:30.710234+0000","last_fullsized":"2024-08-17T02:46:30.710234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:49:32.809838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.720789+0000","last_change":"2024-08-17T02:46:30.719609+0000","last_active":"2024-08-17T02:46:30.720789+0000","last_peered":"2024-08-17T02:46:30.720789+0000","last_clean":"2024-08-17T02:46:30.720789+0000","last_became_active":"2024-08-17T02:46:30.719300+0000","last_became_peered":"2024-08-17T02:46:30.719300+0000","last_unstale":"2024-08-17T02:46:30.720789+0000","last_undegraded":"2024-08-17T02:46:30.720789+0000","last_fullsized":"2024-08-17T02:46:30.720789+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:04:21.573817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.715552+0000","last_change":"2024-08-17T02:46:29.723365+0000","last_active":"2024-08-17T02:46:30.715552+0000","last_peered":"2024-08-17T02:46:30.715552+0000","last_clean":"2024-08-17T02:46:30.715552+0000","last_became_active":"2024-08-17T02:46:29.723148+0000","last_became_peered":"2024-08-17T02:46:29.723148+0000","last_unstale":"2024-08-17T02:46:30.715552+0000","last_undegraded":"2024-08-17T02:46:30.715552+0000","last_fullsized":"2024-08-17T02:46:30.715552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:35:45.209711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.747202+0000","last_change":"2024-08-17T02:46:30.743938+0000","last_active":"2024-08-17T02:46:30.747202+0000","last_peered":"2024-08-17T02:46:30.747202+0000","last_clean":"2024-08-17T02:46:30.747202+0000","last_became_active":"2024-08-17T02:46:30.740738+0000","last_became_peered":"2024-08-17T02:46:30.740738+0000","last_unstale":"2024-08-17T02:46:30.747202+0000","last_undegraded":"2024-08-17T02:46:30.747202+0000","last_fullsized":"2024-08-17T02:46:30.747202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:24:33.028465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.730342+0000","last_change":"2024-08-17T02:46:29.722747+0000","last_active":"2024-08-17T02:46:30.730342+0000","last_peered":"2024-08-17T02:46:30.730342+0000","last_clean":"2024-08-17T02:46:30.730342+0000","last_became_active":"2024-08-17T02:46:29.722416+0000","last_became_peered":"2024-08-17T02:46:29.722416+0000","last_unstale":"2024-08-17T02:46:30.730342+0000","last_undegraded":"2024-08-17T02:46:30.730342+0000","last_fullsized":"2024-08-17T02:46:30.730342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:35:45.209711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.742767+0000","last_change":"2024-08-17T02:46:30.740996+0000","last_active":"2024-08-17T02:46:30.742767+0000","last_peered":"2024-08-17T02:46:30.742767+0000","last_clean":"2024-08-17T02:46:30.742767+0000","last_became_active":"2024-08-17T02:46:30.739952+0000","last_became_peered":"2024-08-17T02:46:30.739952+0000","last_unstale":"2024-08-17T02:46:30.742767+0000","last_undegraded":"2024-08-17T02:46:30.742767+0000","last_fullsized":"2024-08-17T02:46:30.742767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:48.605519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.720175+0000","last_change":"2024-08-17T02:46:29.731437+0000","last_active":"2024-08-17T02:46:30.720175+0000","last_peered":"2024-08-17T02:46:30.720175+0000","last_clean":"2024-08-17T02:46:30.720175+0000","last_became_active":"2024-08-17T02:46:29.731237+0000","last_became_peered":"2024-08-17T02:46:29.731237+0000","last_unstale":"2024-08-17T02:46:30.720175+0000","last_undegraded":"2024-08-17T02:46:30.720175+0000","last_fullsized":"2024-08-17T02:46:30.720175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:10:06.480866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.751951+0000","last_change":"2024-08-17T02:46:30.749103+0000","last_active":"2024-08-17T02:46:30.751951+0000","last_peered":"2024-08-17T02:46:30.751951+0000","last_clean":"2024-08-17T02:46:30.751951+0000","last_became_active":"2024-08-17T02:46:30.746779+0000","last_became_peered":"2024-08-17T02:46:30.746779+0000","last_unstale":"2024-08-17T02:46:30.751951+0000","last_undegraded":"2024-08-17T02:46:30.751951+0000","last_fullsized":"2024-08-17T02:46:30.751951+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:29.695663+0000","last_clean_scrub_stamp":"2024-08-17T02:46:29.695663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:39:18.201034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.715335+0000","last_change":"2024-08-17T02:46:29.727845+0000","last_active":"2024-08-17T02:46:30.715335+0000","last_peered":"2024-08-17T02:46:30.715335+0000","last_clean":"2024-08-17T02:46:30.715335+0000","last_became_active":"2024-08-17T02:46:29.727543+0000","last_became_peered":"2024-08-17T02:46:29.727543+0000","last_unstale":"2024-08-17T02:46:30.715335+0000","last_undegraded":"2024-08-17T02:46:30.715335+0000","last_fullsized":"2024-08-17T02:46:30.715335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:28.688919+0000","last_clean_scrub_stamp":"2024-08-17T02:46:28.688919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:56:35.637872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:46:30.723462+0000","last_change":"2024-08-17T02:45:37.011679+0000","last_active":"2024-08-17T02:46:30.723462+0000","last_peered":"2024-08-17T02:46:30.723462+0000","last_clean":"2024-08-17T02:46:30.723462+0000","last_became_active":"2024-08-17T02:45:37.010559+0000","last_became_peered":"2024-08-17T02:45:37.010559+0000","last_unstale":"2024-08-17T02:46:30.723462+0000","last_undegraded":"2024-08-17T02:46:30.723462+0000","last_fullsized":"2024-08-17T02:46:30.723462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:35.708391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:35.708391+0000","last_clean_scrub_stamp":"2024-08-17T02:45:35.708391+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:11.380093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302464,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069376,"statfs":{"total":96636764160,"available":96327041024,"internally_reserved":0,"allocated":966656,"data_stored":732040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":376832,"data_stored":142186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":376832,"data_stored":142242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:46:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.60499999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:46:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.69899999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:46:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.78200000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:46:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.753},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.81100000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:46:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.83499999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:46:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":1.0369999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:46:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.98299999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297724,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074116,"statfs":{"total":96636764160,"available":96331894784,"internally_reserved":0,"allocated":376832,"data_stored":141686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:46:33 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.48199999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:46:33 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.56999999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:46:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.54000000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:46:33 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.51800000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:46:33 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.747},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.85699999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:46:33 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70199999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:46:33 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.72499999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":385024,"data_stored":143156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":372736,"data_stored":141652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]}]},{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":385024,"data_stored":143156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":962560,"data_stored":731950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:46:34 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.378}]},{"osd":2,"last update":"Sat Aug 17 02:46:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.46400000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:46:34 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.505}]},{"osd":4,"last update":"Sat Aug 17 02:46:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.60999999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:46:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.53700000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:46:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.59399999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:46:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.624}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:46:35.264 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:46:35.264 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-17T02:46:35.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.452+0000 7fbc4f800640 1 Processor -- start 2024-08-17T02:46:35.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.452+0000 7fbc4f800640 1 -- start start 2024-08-17T02:46:35.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.453+0000 7fbc4f800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbc48150130 0x7fbc480aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.453+0000 7fbc4f800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc4806e5f0 0x7fbc480ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.453+0000 7fbc4f800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc481568b0 con 0x7fbc48156d40 2024-08-17T02:46:35.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.453+0000 7fbc4f800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc48150500 con 0x7fbc48150130 2024-08-17T02:46:35.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.453+0000 7fbc4f800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc48155fc0 con 0x7fbc4806e5f0 2024-08-17T02:46:35.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.453+0000 7fbc4ce00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbc48150130 0x7fbc480aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.454+0000 7fbc4ce00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbc48150130 0x7fbc480aa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45108/0 (socket says 172.21.15.100:45108) 2024-08-17T02:46:35.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.454+0000 7fbc4ce00640 1 -- 172.21.15.100:0/619129977 learned_addr learned my addr 172.21.15.100:0/619129977 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:35.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.454+0000 7fbc4d800640 1 --2- 172.21.15.100:0/619129977 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc4806e5f0 0x7fbc480ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.454+0000 7fbc4ce00640 1 -- 172.21.15.100:0/619129977 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc4806e5f0 msgr2=0x7fbc480ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:35.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.454+0000 7fbc4ce00640 1 --2- 172.21.15.100:0/619129977 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc4806e5f0 0x7fbc480ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.454+0000 7fbc4ce00640 1 -- 172.21.15.100:0/619129977 >> v1:172.21.15.123:6789/0 conn(0x7fbc48156d40 legacy=0x7fbc4806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.454+0000 7fbc4ce00640 1 -- 172.21.15.100:0/619129977 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc480add60 con 0x7fbc48150130 2024-08-17T02:46:35.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.455+0000 7fbc4ce00640 1 --2- 172.21.15.100:0/619129977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc48150130 0x7fbc480aa730 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c009910 tx=0x7fbc3c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d281a91b3663b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:35.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.455+0000 7fbc47400640 1 -- 172.21.15.100:0/619129977 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c02adb0 con 0x7fbc48150130 2024-08-17T02:46:35.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.455+0000 7fbc47400640 1 -- 172.21.15.100:0/619129977 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3c032440 con 0x7fbc48150130 2024-08-17T02:46:35.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.455+0000 7fbc47400640 1 -- 172.21.15.100:0/619129977 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c032820 con 0x7fbc48150130 2024-08-17T02:46:35.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.456+0000 7fbc4f800640 1 -- 172.21.15.100:0/619129977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc48150130 msgr2=0x7fbc480aa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.456+0000 7fbc4f800640 1 --2- 172.21.15.100:0/619129977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc48150130 0x7fbc480aa730 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c009910 tx=0x7fbc3c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.456+0000 7fbc4f800640 1 -- 172.21.15.100:0/619129977 shutdown_connections 2024-08-17T02:46:35.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.456+0000 7fbc4f800640 1 --2- 172.21.15.100:0/619129977 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc4806e5f0 0x7fbc480ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.456+0000 7fbc4f800640 1 --2- 172.21.15.100:0/619129977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc48150130 0x7fbc480aa730 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.456+0000 7fbc4f800640 1 -- 172.21.15.100:0/619129977 >> 172.21.15.100:0/619129977 conn(0x7fbc48067750 msgr2=0x7fbc4806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:35.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.456+0000 7fbc4f800640 1 -- 172.21.15.100:0/619129977 shutdown_connections 2024-08-17T02:46:35.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.456+0000 7fbc4f800640 1 -- 172.21.15.100:0/619129977 wait complete. 2024-08-17T02:46:35.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.457+0000 7fbc4f800640 1 Processor -- start 2024-08-17T02:46:35.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.458+0000 7fbc4f800640 1 -- start start 2024-08-17T02:46:35.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.458+0000 7fbc4f800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc4806e5f0 0x7fbc4815ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.458+0000 7fbc4f800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc48150130 0x7fbc4814e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.458+0000 7fbc4f800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc48156d40 0x7fbc480ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.458+0000 7fbc4f800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc480aa9d0 con 0x7fbc48156d40 2024-08-17T02:46:35.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.458+0000 7fbc4f800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4816d550 con 0x7fbc4806e5f0 2024-08-17T02:46:35.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.458+0000 7fbc4f800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4815a770 con 0x7fbc48150130 2024-08-17T02:46:35.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.459+0000 7fbc4d800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc48156d40 0x7fbc480ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.459+0000 7fbc4d800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc48156d40 0x7fbc480ca6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45116/0 (socket says 172.21.15.100:45116) 2024-08-17T02:46:35.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.459+0000 7fbc4d800640 1 -- 172.21.15.100:0/4286556019 learned_addr learned my addr 172.21.15.100:0/4286556019 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:35.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.459+0000 7fbc4ce00640 1 --2- 172.21.15.100:0/4286556019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc4806e5f0 0x7fbc4815ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.459+0000 7fbc47e00640 1 --2- 172.21.15.100:0/4286556019 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc48150130 0x7fbc4814e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.459+0000 7fbc4d800640 1 -- 172.21.15.100:0/4286556019 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc48150130 msgr2=0x7fbc4814e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.459+0000 7fbc4d800640 1 --2- 172.21.15.100:0/4286556019 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc48150130 0x7fbc4814e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.459+0000 7fbc4d800640 1 -- 172.21.15.100:0/4286556019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc4806e5f0 msgr2=0x7fbc4815ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.459+0000 7fbc4d800640 1 --2- 172.21.15.100:0/4286556019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc4806e5f0 0x7fbc4815ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.459+0000 7fbc4d800640 1 -- 172.21.15.100:0/4286556019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c009450 con 0x7fbc48156d40 2024-08-17T02:46:35.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.459+0000 7fbc4d800640 1 --2- 172.21.15.100:0/4286556019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc48156d40 0x7fbc480ca6f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbc40007f60 tx=0x7fbc400098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:35.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.460+0000 7fbc3be00640 1 -- 172.21.15.100:0/4286556019 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4000ee30 con 0x7fbc48156d40 2024-08-17T02:46:35.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.460+0000 7fbc3be00640 1 -- 172.21.15.100:0/4286556019 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc40014420 con 0x7fbc48156d40 2024-08-17T02:46:35.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.460+0000 7fbc3be00640 1 -- 172.21.15.100:0/4286556019 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc400147e0 con 0x7fbc48156d40 2024-08-17T02:46:35.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.460+0000 7fbc4f800640 1 -- 172.21.15.100:0/4286556019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4816d270 con 0x7fbc48156d40 2024-08-17T02:46:35.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.460+0000 7fbc4f800640 1 -- 172.21.15.100:0/4286556019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4815a400 con 0x7fbc48156d40 2024-08-17T02:46:35.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.461+0000 7fbc4f800640 1 -- 172.21.15.100:0/4286556019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc480710c0 con 0x7fbc48156d40 2024-08-17T02:46:35.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.462+0000 7fbc3be00640 1 -- 172.21.15.100:0/4286556019 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbc40014bd0 con 0x7fbc48156d40 2024-08-17T02:46:35.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.462+0000 7fbc3be00640 1 --2- 172.21.15.100:0/4286556019 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbc28065180 0x7fbc28067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.462+0000 7fbc3be00640 1 -- 172.21.15.100:0/4286556019 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbc40082a80 con 0x7fbc48156d40 2024-08-17T02:46:35.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.463+0000 7fbc4ce00640 1 --2- 172.21.15.100:0/4286556019 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbc28065180 0x7fbc28067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.463+0000 7fbc4ce00640 1 --2- 172.21.15.100:0/4286556019 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbc28065180 0x7fbc28067630 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c034000 tx=0x7fbc3c032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:35.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.467+0000 7fbc3be00640 1 -- 172.21.15.100:0/4286556019 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbc40050b50 con 0x7fbc48156d40 2024-08-17T02:46:35.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.699+0000 7fbc4f800640 1 -- 172.21.15.100:0/4286556019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbc4815a8b0 con 0x7fbc48156d40 2024-08-17T02:46:35.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.703+0000 7fbc3be00640 1 -- 172.21.15.100:0/4286556019 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fbc40009a20 con 0x7fbc48156d40 2024-08-17T02:46:35.703 INFO:teuthology.orchestra.run.smithi100.stderr:updated caps for client.0 2024-08-17T02:46:35.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.705+0000 7fbc4f800640 1 -- 172.21.15.100:0/4286556019 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbc28065180 msgr2=0x7fbc28067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.705+0000 7fbc4f800640 1 --2- 172.21.15.100:0/4286556019 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbc28065180 0x7fbc28067630 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c034000 tx=0x7fbc3c032000 comp rx=0 tx=0).stop 2024-08-17T02:46:35.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.705+0000 7fbc4f800640 1 -- 172.21.15.100:0/4286556019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc48156d40 msgr2=0x7fbc480ca6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.705+0000 7fbc4f800640 1 --2- 172.21.15.100:0/4286556019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc48156d40 0x7fbc480ca6f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbc40007f60 tx=0x7fbc400098e0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.705+0000 7fbc4f800640 1 -- 172.21.15.100:0/4286556019 shutdown_connections 2024-08-17T02:46:35.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.705+0000 7fbc4f800640 1 --2- 172.21.15.100:0/4286556019 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbc28065180 0x7fbc28067630 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.705+0000 7fbc4f800640 1 --2- 172.21.15.100:0/4286556019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc48156d40 0x7fbc480ca6f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.705+0000 7fbc4f800640 1 --2- 172.21.15.100:0/4286556019 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc48150130 0x7fbc4814e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.705+0000 7fbc4f800640 1 --2- 172.21.15.100:0/4286556019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc4806e5f0 0x7fbc4815ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.705+0000 7fbc4f800640 1 -- 172.21.15.100:0/4286556019 >> 172.21.15.100:0/4286556019 conn(0x7fbc48067750 msgr2=0x7fbc4806d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:35.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.705+0000 7fbc4f800640 1 -- 172.21.15.100:0/4286556019 shutdown_connections 2024-08-17T02:46:35.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.705+0000 7fbc4f800640 1 -- 172.21.15.100:0/4286556019 wait complete. 2024-08-17T02:46:35.721 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:46:35.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.869+0000 7fe614a00640 1 Processor -- start 2024-08-17T02:46:35.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.869+0000 7fe614a00640 1 -- start start 2024-08-17T02:46:35.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.870+0000 7fe614a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe6100c7420 0x7fe610096a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.870+0000 7fe614a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6100b18d0 con 0x7fe610158d60 2024-08-17T02:46:35.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.870+0000 7fe614a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6100b0d00 con 0x7fe61015cb30 2024-08-17T02:46:35.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.870+0000 7fe614a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6100b0fa0 con 0x7fe6100c7420 2024-08-17T02:46:35.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.870+0000 7fe60e800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe6100c7420 0x7fe610096a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.871+0000 7fe60e800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe6100c7420 0x7fe610096a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45132/0 (socket says 172.21.15.100:45132) 2024-08-17T02:46:35.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.871+0000 7fe60e800640 1 -- 172.21.15.100:0/3493616438 learned_addr learned my addr 172.21.15.100:0/3493616438 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:35.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.871+0000 7fe60e800640 1 -- 172.21.15.100:0/3493616438 >> v1:172.21.15.123:6789/0 conn(0x7fe61015cb30 legacy=0x7fe6100c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.871+0000 7fe60e800640 1 -- 172.21.15.100:0/3493616438 >> v1:172.21.15.100:6789/0 conn(0x7fe610158d60 legacy=0x7fe6100b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.871+0000 7fe60e800640 1 -- 172.21.15.100:0/3493616438 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6100b1280 con 0x7fe6100c7420 2024-08-17T02:46:35.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.872+0000 7fe60e800640 1 --2- 172.21.15.100:0/3493616438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6100c7420 0x7fe610096a70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe608009f50 tx=0x7fe608009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703801d21920b80e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:35.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.872+0000 7fe60ca00640 1 -- 172.21.15.100:0/3493616438 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608033410 con 0x7fe6100c7420 2024-08-17T02:46:35.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.872+0000 7fe60ca00640 1 -- 172.21.15.100:0/3493616438 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe608033570 con 0x7fe6100c7420 2024-08-17T02:46:35.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.872+0000 7fe60ca00640 1 -- 172.21.15.100:0/3493616438 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608033950 con 0x7fe6100c7420 2024-08-17T02:46:35.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.873+0000 7fe614a00640 1 -- 172.21.15.100:0/3493616438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6100c7420 msgr2=0x7fe610096a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.873+0000 7fe614a00640 1 --2- 172.21.15.100:0/3493616438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6100c7420 0x7fe610096a70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe608009f50 tx=0x7fe608009840 comp rx=0 tx=0).stop 2024-08-17T02:46:35.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.873+0000 7fe614a00640 1 -- 172.21.15.100:0/3493616438 shutdown_connections 2024-08-17T02:46:35.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.873+0000 7fe614a00640 1 --2- 172.21.15.100:0/3493616438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6100c7420 0x7fe610096a70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.873+0000 7fe614a00640 1 -- 172.21.15.100:0/3493616438 >> 172.21.15.100:0/3493616438 conn(0x7fe6100b3040 msgr2=0x7fe6100b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:35.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.873+0000 7fe614a00640 1 -- 172.21.15.100:0/3493616438 shutdown_connections 2024-08-17T02:46:35.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.873+0000 7fe614a00640 1 -- 172.21.15.100:0/3493616438 wait complete. 2024-08-17T02:46:35.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.874+0000 7fe614a00640 1 Processor -- start 2024-08-17T02:46:35.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.874+0000 7fe614a00640 1 -- start start 2024-08-17T02:46:35.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.875+0000 7fe614a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6100c7420 0x7fe6100ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.875+0000 7fe614a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe610158d60 0x7fe610152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.875+0000 7fe614a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe61015cb30 0x7fe6100abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.875+0000 7fe614a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61009a8d0 con 0x7fe610158d60 2024-08-17T02:46:35.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.875+0000 7fe614a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100add00 con 0x7fe61015cb30 2024-08-17T02:46:35.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.875+0000 7fe614a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe610099cc0 con 0x7fe6100c7420 2024-08-17T02:46:35.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.876+0000 7fe60d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe610158d60 0x7fe610152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.876+0000 7fe60d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe610158d60 0x7fe610152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45144/0 (socket says 172.21.15.100:45144) 2024-08-17T02:46:35.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.876+0000 7fe60d400640 1 -- 172.21.15.100:0/4185866070 learned_addr learned my addr 172.21.15.100:0/4185866070 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:35.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.876+0000 7fe60e800640 1 --2- 172.21.15.100:0/4185866070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe61015cb30 0x7fe6100abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.876+0000 7fe60de00640 1 --2- 172.21.15.100:0/4185866070 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6100c7420 0x7fe6100ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.876+0000 7fe60d400640 1 -- 172.21.15.100:0/4185866070 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6100c7420 msgr2=0x7fe6100ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.876+0000 7fe60d400640 1 --2- 172.21.15.100:0/4185866070 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6100c7420 0x7fe6100ad7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.876+0000 7fe60d400640 1 -- 172.21.15.100:0/4185866070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe61015cb30 msgr2=0x7fe6100abb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.876+0000 7fe60d400640 1 --2- 172.21.15.100:0/4185866070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe61015cb30 0x7fe6100abb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.876+0000 7fe60d400640 1 -- 172.21.15.100:0/4185866070 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe608009ae0 con 0x7fe610158d60 2024-08-17T02:46:35.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.876+0000 7fe60e800640 1 --2- 172.21.15.100:0/4185866070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe61015cb30 0x7fe6100abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:35.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.876+0000 7fe60d400640 1 --2- 172.21.15.100:0/4185866070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe610158d60 0x7fe610152840 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00c4c0 tx=0x7fe5fc007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:35.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.876+0000 7fe605600640 1 -- 172.21.15.100:0/4185866070 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc011590 con 0x7fe610158d60 2024-08-17T02:46:35.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.877+0000 7fe605600640 1 -- 172.21.15.100:0/4185866070 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc011710 con 0x7fe610158d60 2024-08-17T02:46:35.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.877+0000 7fe605600640 1 -- 172.21.15.100:0/4185866070 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc011ad0 con 0x7fe610158d60 2024-08-17T02:46:35.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.877+0000 7fe614a00640 1 -- 172.21.15.100:0/4185866070 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe610099fa0 con 0x7fe610158d60 2024-08-17T02:46:35.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.877+0000 7fe614a00640 1 -- 172.21.15.100:0/4185866070 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61009a560 con 0x7fe610158d60 2024-08-17T02:46:35.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.878+0000 7fe614a00640 1 -- 172.21.15.100:0/4185866070 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61009aa40 con 0x7fe610158d60 2024-08-17T02:46:35.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.879+0000 7fe605600640 1 -- 172.21.15.100:0/4185866070 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe5fc01b3b0 con 0x7fe610158d60 2024-08-17T02:46:35.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.880+0000 7fe605600640 1 --2- 172.21.15.100:0/4185866070 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe5f0065150 0x7fe5f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.880+0000 7fe605600640 1 -- 172.21.15.100:0/4185866070 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe5fc081880 con 0x7fe610158d60 2024-08-17T02:46:35.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.880+0000 7fe60de00640 1 --2- 172.21.15.100:0/4185866070 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe5f0065150 0x7fe5f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.880+0000 7fe60de00640 1 --2- 172.21.15.100:0/4185866070 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe5f0065150 0x7fe5f0067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe600007fd0 tx=0x7fe600007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:35.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:35.883+0000 7fe605600640 1 -- 172.21.15.100:0/4185866070 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe5fc04f9d0 con 0x7fe610158d60 2024-08-17T02:46:36.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.090+0000 7fe614a00640 1 -- 172.21.15.100:0/4185866070 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe610064db0 con 0x7fe610158d60 2024-08-17T02:46:36.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.090+0000 7fe605600640 1 -- 172.21.15.100:0/4185866070 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4609 (secure 0 0 0) 0x7fe5fc017070 con 0x7fe610158d60 2024-08-17T02:46:36.091 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:36.091 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1972998642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1972998642},{"type":"v1","addr":"172.21.15.100:6836","nonce":1972998642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3961484077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3961484077},{"type":"v1","addr":"172.21.15.100:6837","nonce":3961484077}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4885,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/1763367135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1763367135},{"type":"v1","addr":"172.21.15.123:6834","nonce":1763367135}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:30.114385+0000","modified":"2024-08-17T02:46:33.731841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1541092259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":1541092259},{"type":"v1","addr":"172.21.15.123:6835","nonce":1541092259}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:46:36.092 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 16 2024-08-17T02:46:36.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.092+0000 7fe614a00640 1 -- 172.21.15.100:0/4185866070 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe5f0065150 msgr2=0x7fe5f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.092+0000 7fe614a00640 1 --2- 172.21.15.100:0/4185866070 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe5f0065150 0x7fe5f0067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe600007fd0 tx=0x7fe600007e30 comp rx=0 tx=0).stop 2024-08-17T02:46:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.092+0000 7fe614a00640 1 -- 172.21.15.100:0/4185866070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe610158d60 msgr2=0x7fe610152840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.092+0000 7fe614a00640 1 --2- 172.21.15.100:0/4185866070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe610158d60 0x7fe610152840 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00c4c0 tx=0x7fe5fc007ef0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.093+0000 7fe614a00640 1 -- 172.21.15.100:0/4185866070 shutdown_connections 2024-08-17T02:46:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.093+0000 7fe614a00640 1 --2- 172.21.15.100:0/4185866070 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe5f0065150 0x7fe5f0067600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.093+0000 7fe614a00640 1 --2- 172.21.15.100:0/4185866070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe61015cb30 0x7fe6100abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.093+0000 7fe614a00640 1 --2- 172.21.15.100:0/4185866070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe610158d60 0x7fe610152840 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.093+0000 7fe614a00640 1 --2- 172.21.15.100:0/4185866070 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6100c7420 0x7fe6100ad7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.093+0000 7fe614a00640 1 -- 172.21.15.100:0/4185866070 >> 172.21.15.100:0/4185866070 conn(0x7fe6100b3040 msgr2=0x7fe610096a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.093+0000 7fe614a00640 1 -- 172.21.15.100:0/4185866070 shutdown_connections 2024-08-17T02:46:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.093+0000 7fe614a00640 1 -- 172.21.15.100:0/4185866070 wait complete. 2024-08-17T02:46:36.511 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:46:30.114385+0000', 'modified': '2024-08-17T02:46:33.731841+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4959}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4959': {'gid': 4959, 'name': 'b', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.123:6835/1541092259', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6833', 'nonce': 1541092259}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 1541092259}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:46:36.511 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:46:36.511 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-08-17T02:46:36.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.659+0000 7fb903a00640 1 Processor -- start 2024-08-17T02:46:36.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.659+0000 7fb903a00640 1 -- start start 2024-08-17T02:46:36.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.660+0000 7fb903a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb8fc155a20 0x7fb8fc0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.660+0000 7fb903a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb8fc06df00 0x7fb8fc0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.660+0000 7fb903a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8fc156670 con 0x7fb8fc155df0 2024-08-17T02:46:36.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.660+0000 7fb903a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8fc0b0350 con 0x7fb8fc06df00 2024-08-17T02:46:36.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.660+0000 7fb903a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8fc06e5e0 con 0x7fb8fc155a20 2024-08-17T02:46:36.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.660+0000 7fb901a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb8fc06df00 0x7fb8fc0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.660+0000 7fb901a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb8fc06df00 0x7fb8fc0ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45152/0 (socket says 172.21.15.100:45152) 2024-08-17T02:46:36.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.660+0000 7fb901a00640 1 -- 172.21.15.100:0/1880003166 learned_addr learned my addr 172.21.15.100:0/1880003166 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:36.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.661+0000 7fb901000640 1 --2- 172.21.15.100:0/1880003166 >> v2:172.21.15.123:3300/0 conn(0x7fb8fc155a20 0x7fb8fc0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.661+0000 7fb901a00640 1 -- 172.21.15.100:0/1880003166 >> v2:172.21.15.123:3300/0 conn(0x7fb8fc155a20 msgr2=0x7fb8fc0adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:36.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.661+0000 7fb901a00640 1 --2- 172.21.15.100:0/1880003166 >> v2:172.21.15.123:3300/0 conn(0x7fb8fc155a20 0x7fb8fc0adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.661+0000 7fb901a00640 1 -- 172.21.15.100:0/1880003166 >> v1:172.21.15.100:6789/0 conn(0x7fb8fc155df0 legacy=0x7fb8fc06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.661+0000 7fb901a00640 1 -- 172.21.15.100:0/1880003166 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8fc06e8c0 con 0x7fb8fc06df00 2024-08-17T02:46:36.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.662+0000 7fb901a00640 1 --2- 172.21.15.100:0/1880003166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8fc06df00 0x7fb8fc0ad9b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc06bc00 tx=0x7fb8f400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246f077858eb395b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:36.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.662+0000 7fb8fbe00640 1 -- 172.21.15.100:0/1880003166 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f400b2e0 con 0x7fb8fc06df00 2024-08-17T02:46:36.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.662+0000 7fb8fbe00640 1 -- 172.21.15.100:0/1880003166 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f400b440 con 0x7fb8fc06df00 2024-08-17T02:46:36.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.662+0000 7fb8fbe00640 1 -- 172.21.15.100:0/1880003166 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4009840 con 0x7fb8fc06df00 2024-08-17T02:46:36.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.662+0000 7fb903a00640 1 -- 172.21.15.100:0/1880003166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8fc06df00 msgr2=0x7fb8fc0ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.662+0000 7fb903a00640 1 --2- 172.21.15.100:0/1880003166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8fc06df00 0x7fb8fc0ad9b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc06bc00 tx=0x7fb8f400ba50 comp rx=0 tx=0).stop 2024-08-17T02:46:36.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.663+0000 7fb903a00640 1 -- 172.21.15.100:0/1880003166 shutdown_connections 2024-08-17T02:46:36.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.663+0000 7fb903a00640 1 --2- 172.21.15.100:0/1880003166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8fc06df00 0x7fb8fc0ad9b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.663+0000 7fb903a00640 1 --2- 172.21.15.100:0/1880003166 >> v2:172.21.15.123:3300/0 conn(0x7fb8fc155a20 0x7fb8fc0adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.663+0000 7fb903a00640 1 -- 172.21.15.100:0/1880003166 >> 172.21.15.100:0/1880003166 conn(0x7fb8fc0cb9b0 msgr2=0x7fb8fc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:36.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.663+0000 7fb903a00640 1 -- 172.21.15.100:0/1880003166 shutdown_connections 2024-08-17T02:46:36.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.663+0000 7fb903a00640 1 -- 172.21.15.100:0/1880003166 wait complete. 2024-08-17T02:46:36.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.664+0000 7fb903a00640 1 Processor -- start 2024-08-17T02:46:36.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.664+0000 7fb903a00640 1 -- start start 2024-08-17T02:46:36.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.665+0000 7fb903a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8fc06df00 0x7fb8fc15d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.665+0000 7fb903a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb8fc155a20 0x7fb8fc1461a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.665+0000 7fb903a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8fc155df0 0x7fb8fc1466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.665+0000 7fb903a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc14e260 con 0x7fb8fc155df0 2024-08-17T02:46:36.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.665+0000 7fb903a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc14e500 con 0x7fb8fc06df00 2024-08-17T02:46:36.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.665+0000 7fb903a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc14e7e0 con 0x7fb8fc155a20 2024-08-17T02:46:36.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.665+0000 7fb901a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8fc155df0 0x7fb8fc1466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.665+0000 7fb901a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8fc155df0 0x7fb8fc1466e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45168/0 (socket says 172.21.15.100:45168) 2024-08-17T02:46:36.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.665+0000 7fb901a00640 1 -- 172.21.15.100:0/3567945294 learned_addr learned my addr 172.21.15.100:0/3567945294 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:36.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.665+0000 7fb901000640 1 --2- 172.21.15.100:0/3567945294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8fc06df00 0x7fb8fc15d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.665+0000 7fb8f3e00640 1 --2- 172.21.15.100:0/3567945294 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb8fc155a20 0x7fb8fc1461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.666+0000 7fb901a00640 1 -- 172.21.15.100:0/3567945294 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb8fc155a20 msgr2=0x7fb8fc1461a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.666+0000 7fb901a00640 1 --2- 172.21.15.100:0/3567945294 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb8fc155a20 0x7fb8fc1461a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.666+0000 7fb901a00640 1 -- 172.21.15.100:0/3567945294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8fc06df00 msgr2=0x7fb8fc15d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.666+0000 7fb901a00640 1 --2- 172.21.15.100:0/3567945294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8fc06df00 0x7fb8fc15d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.666+0000 7fb901a00640 1 -- 172.21.15.100:0/3567945294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f400bcf0 con 0x7fb8fc155df0 2024-08-17T02:46:36.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.666+0000 7fb901000640 1 --2- 172.21.15.100:0/3567945294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8fc06df00 0x7fb8fc15d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:36.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.666+0000 7fb901a00640 1 --2- 172.21.15.100:0/3567945294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8fc155df0 0x7fb8fc1466e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400d1d0 tx=0x7fb8f4039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:36.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.666+0000 7fb8f8c00640 1 -- 172.21.15.100:0/3567945294 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4045460 con 0x7fb8fc155df0 2024-08-17T02:46:36.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.666+0000 7fb8f8c00640 1 -- 172.21.15.100:0/3567945294 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f40455e0 con 0x7fb8fc155df0 2024-08-17T02:46:36.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.666+0000 7fb903a00640 1 -- 172.21.15.100:0/3567945294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8fc14eac0 con 0x7fb8fc155df0 2024-08-17T02:46:36.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.666+0000 7fb8f8c00640 1 -- 172.21.15.100:0/3567945294 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f40459a0 con 0x7fb8fc155df0 2024-08-17T02:46:36.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.667+0000 7fb903a00640 1 -- 172.21.15.100:0/3567945294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8fc15d980 con 0x7fb8fc155df0 2024-08-17T02:46:36.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.668+0000 7fb8f8c00640 1 -- 172.21.15.100:0/3567945294 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb8f403c400 con 0x7fb8fc155df0 2024-08-17T02:46:36.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.669+0000 7fb8f8c00640 1 --2- 172.21.15.100:0/3567945294 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb8d8065150 0x7fb8d8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.669+0000 7fb8f8c00640 1 -- 172.21.15.100:0/3567945294 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb8f40a4560 con 0x7fb8fc155df0 2024-08-17T02:46:36.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.669+0000 7fb901000640 1 --2- 172.21.15.100:0/3567945294 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb8d8065150 0x7fb8d8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.670+0000 7fb901000640 1 --2- 172.21.15.100:0/3567945294 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb8d8065150 0x7fb8d8067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec00bb80 tx=0x7fb8ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:36.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.670+0000 7fb905fd7740 1 Processor -- start 2024-08-17T02:46:36.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.670+0000 7fb905fd7740 1 -- start start 2024-08-17T02:46:36.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.671+0000 7fb905fd7740 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d76a30 0x565321d76e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.671+0000 7fb905fd7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d520a0 0x565321d945d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.671+0000 7fb905fd7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d94b10 0x565321d4b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.671+0000 7fb905fd7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x565321d0c380 con 0x565321d520a0 2024-08-17T02:46:36.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.671+0000 7fb905fd7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x565321cb59e0 con 0x565321d94b10 2024-08-17T02:46:36.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.671+0000 7fb905fd7740 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x565321cb3170 con 0x565321d76a30 2024-08-17T02:46:36.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.671+0000 7fb8f3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d520a0 0x565321d945d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.671+0000 7fb8f3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d520a0 0x565321d945d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45174/0 (socket says 172.21.15.100:45174) 2024-08-17T02:46:36.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.671+0000 7fb8f3e00640 1 -- 172.21.15.100:0/706060929 learned_addr learned my addr 172.21.15.100:0/706060929 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:36.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.671+0000 7fb901000640 1 --2- 172.21.15.100:0/706060929 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d76a30 0x565321d76e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.671+0000 7fb901a00640 1 --2- 172.21.15.100:0/706060929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d94b10 0x565321d4b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.671+0000 7fb8f3e00640 1 -- 172.21.15.100:0/706060929 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d76a30 msgr2=0x565321d76e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:36.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.671+0000 7fb8f3e00640 1 --2- 172.21.15.100:0/706060929 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d76a30 0x565321d76e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.671+0000 7fb8f3e00640 1 -- 172.21.15.100:0/706060929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d94b10 msgr2=0x565321d4b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:36.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.671+0000 7fb8f3e00640 1 --2- 172.21.15.100:0/706060929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d94b10 0x565321d4b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.671+0000 7fb8f3e00640 1 -- 172.21.15.100:0/706060929 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565321c62820 con 0x565321d520a0 2024-08-17T02:46:36.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.671+0000 7fb901000640 1 --2- 172.21.15.100:0/706060929 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d76a30 0x565321d76e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:36.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.672+0000 7fb8f3e00640 1 --2- 172.21.15.100:0/706060929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d520a0 0x565321d945d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4003700 tx=0x7fb8e4007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b2c042460eab45 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:36.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.672+0000 7fb8f0c00640 1 -- 172.21.15.100:0/706060929 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400f7b0 con 0x565321d520a0 2024-08-17T02:46:36.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.672+0000 7fb8f0c00640 1 -- 172.21.15.100:0/706060929 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e400f910 con 0x565321d520a0 2024-08-17T02:46:36.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.672+0000 7fb8f0c00640 1 -- 172.21.15.100:0/706060929 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400fcb0 con 0x565321d520a0 2024-08-17T02:46:36.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.672+0000 7fb905fd7740 1 -- 172.21.15.100:0/706060929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d520a0 msgr2=0x565321d945d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.673+0000 7fb905fd7740 1 --2- 172.21.15.100:0/706060929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d520a0 0x565321d945d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4003700 tx=0x7fb8e4007e30 comp rx=0 tx=0).stop 2024-08-17T02:46:36.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.673+0000 7fb905fd7740 1 -- 172.21.15.100:0/706060929 shutdown_connections 2024-08-17T02:46:36.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.673+0000 7fb905fd7740 1 --2- 172.21.15.100:0/706060929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d94b10 0x565321d4b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.673+0000 7fb905fd7740 1 --2- 172.21.15.100:0/706060929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d520a0 0x565321d945d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.673+0000 7fb905fd7740 1 --2- 172.21.15.100:0/706060929 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d76a30 0x565321d76e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.673+0000 7fb905fd7740 1 -- 172.21.15.100:0/706060929 >> 172.21.15.100:0/706060929 conn(0x565321cea030 msgr2=0x565321d98c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.673+0000 7fb905fd7740 1 -- 172.21.15.100:0/706060929 shutdown_connections 2024-08-17T02:46:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.673+0000 7fb905fd7740 1 -- 172.21.15.100:0/706060929 wait complete. 2024-08-17T02:46:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.673+0000 7fb905fd7740 1 -- start start 2024-08-17T02:46:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.674+0000 7fb905fd7740 1 Processor -- start 2024-08-17T02:46:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.675+0000 7fb905fd7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d520a0 0x565321d78b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.675+0000 7fb905fd7740 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d76a30 0x565321d79a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.675+0000 7fb905fd7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d94b10 0x565321d79f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.675+0000 7fb905fd7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x565321caef60 con 0x565321d94b10 2024-08-17T02:46:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.675+0000 7fb905fd7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x565321c57690 con 0x565321d520a0 2024-08-17T02:46:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.675+0000 7fb905fd7740 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x565321c57330 con 0x565321d76a30 2024-08-17T02:46:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.675+0000 7fb905fd7740 10 client.0 _ll_register_callbacks cb 0x565321c512b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:46:36.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.675+0000 7fb901a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d94b10 0x565321d79f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.675+0000 7fb901a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d94b10 0x565321d79f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45184/0 (socket says 172.21.15.100:45184) 2024-08-17T02:46:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.675+0000 7fb901a00640 1 -- 172.21.15.100:0/415807511 learned_addr learned my addr 172.21.15.100:0/415807511 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.675+0000 7fb8f3e00640 1 --2- 172.21.15.100:0/415807511 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d76a30 0x565321d79a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.675+0000 7fb901000640 1 --2- 172.21.15.100:0/415807511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d520a0 0x565321d78b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.675+0000 7fb901a00640 1 -- 172.21.15.100:0/415807511 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d76a30 msgr2=0x565321d79a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.675+0000 7fb901a00640 1 --2- 172.21.15.100:0/415807511 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d76a30 0x565321d79a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.675+0000 7fb901a00640 1 -- 172.21.15.100:0/415807511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d520a0 msgr2=0x565321d78b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.675+0000 7fb901a00640 1 --2- 172.21.15.100:0/415807511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d520a0 0x565321d78b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.675+0000 7fb901a00640 1 -- 172.21.15.100:0/415807511 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8fc156670 con 0x565321d94b10 2024-08-17T02:46:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.676+0000 7fb901a00640 1 --2- 172.21.15.100:0/415807511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d94b10 0x565321d79f80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb8f402cee0 tx=0x7fb8f40a2940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9bb37335d600aae server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.676+0000 7fb8e9600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-08-17T02:46:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.676+0000 7fb8e9600640 1 -- 172.21.15.100:0/415807511 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4076940 con 0x565321d94b10 2024-08-17T02:46:36.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.676+0000 7fb8e9600640 1 -- 172.21.15.100:0/415807511 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb8f40a2e40 con 0x565321d94b10 2024-08-17T02:46:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.676+0000 7fb905fd7740 1 -- 172.21.15.100:0/415807511 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565321ce2d20 con 0x565321d94b10 2024-08-17T02:46:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.676+0000 7fb8e9600640 1 -- 172.21.15.100:0/415807511 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8f4076240 con 0x565321d94b10 2024-08-17T02:46:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.676+0000 7fb905fd7740 10 client.5127 fetch_fsmap learned FSMap version 16 2024-08-17T02:46:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.676+0000 7fb905fd7740 1 -- 172.21.15.100:0/415807511 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x565321c78ab0 con 0x565321d94b10 2024-08-17T02:46:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.676+0000 7fb8e9600640 1 -- 172.21.15.100:0/415807511 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565321ce2d20 con 0x565321d94b10 2024-08-17T02:46:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.676+0000 7fb8e9600640 1 -- 172.21.15.100:0/415807511 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb8f4030050 con 0x565321d94b10 2024-08-17T02:46:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.676+0000 7fb905fd7740 10 client.5127 fetch_fsmap finished waiting for FSMap version 16 2024-08-17T02:46:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.676+0000 7fb905fd7740 10 client.5127 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-17T02:46:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.676+0000 7fb905fd7740 20 client.5127 populate_metadata read hostname 'smithi100' 2024-08-17T02:46:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.676+0000 7fb905fd7740 1 --2- 172.21.15.100:0/415807511 >> [v2:172.21.15.123:6833/1541092259,v1:172.21.15.123:6835/1541092259] conn(0x565321d73670 0x565321d7cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.676+0000 7fb905fd7740 4 client.5127 mds_command: new command op to 4959 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:46:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.676+0000 7fb905fd7740 1 -- 172.21.15.100:0/415807511 --> [v2:172.21.15.123:6833/1541092259,v1:172.21.15.123:6835/1541092259] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653219b63c0 con 0x565321d73670 2024-08-17T02:46:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.677+0000 7fb901000640 1 --2- 172.21.15.100:0/415807511 >> [v2:172.21.15.123:6833/1541092259,v1:172.21.15.123:6835/1541092259] conn(0x565321d73670 0x565321d7cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.677+0000 7fb901000640 1 --2- 172.21.15.100:0/415807511 >> [v2:172.21.15.123:6833/1541092259,v1:172.21.15.123:6835/1541092259] conn(0x565321d73670 0x565321d7cf80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b89eee4ab1eab82 server_cookie=d172307779d2905f in_seq=0 out_seq=0 2024-08-17T02:46:36.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.677+0000 7fb8e9600640 10 client.5127 ms_handle_connect on v2:172.21.15.123:6833/1541092259 2024-08-17T02:46:36.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.678+0000 7fb8e9600640 1 -- 172.21.15.100:0/415807511 <== mds.0 v2:172.21.15.123:6833/1541092259 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x5653219b63c0 con 0x565321d73670 2024-08-17T02:46:36.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.678+0000 7fb8e9600640 10 client.5127 handle_command_reply: tid=0 2024-08-17T02:46:36.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.678+0000 7fb905fd7740 1 client.5127 shutdown 2024-08-17T02:46:36.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.678+0000 7fb905fd7740 1 -- 172.21.15.100:0/415807511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d94b10 msgr2=0x565321d79f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.678+0000 7fb905fd7740 1 --2- 172.21.15.100:0/415807511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d94b10 0x565321d79f80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb8f402cee0 tx=0x7fb8f40a2940 comp rx=0 tx=0).stop 2024-08-17T02:46:36.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.678+0000 7fb905fd7740 1 -- 172.21.15.100:0/415807511 shutdown_connections 2024-08-17T02:46:36.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.678+0000 7fb905fd7740 1 --2- 172.21.15.100:0/415807511 >> [v2:172.21.15.123:6833/1541092259,v1:172.21.15.123:6835/1541092259] conn(0x565321d73670 0x565321d7cf80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.678+0000 7fb905fd7740 1 --2- 172.21.15.100:0/415807511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d94b10 0x565321d79f80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.678+0000 7fb905fd7740 1 --2- 172.21.15.100:0/415807511 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d76a30 0x565321d79a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.678+0000 7fb8e9600640 0 client.5127 ms_handle_reset on v2:172.21.15.123:6833/1541092259 2024-08-17T02:46:36.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.678+0000 7fb905fd7740 1 --2- 172.21.15.100:0/415807511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d520a0 0x565321d78b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.678+0000 7fb905fd7740 1 -- 172.21.15.100:0/415807511 >> 172.21.15.100:0/415807511 conn(0x565321cea030 msgr2=0x565321d4c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:36.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.678+0000 7fb905fd7740 1 -- 172.21.15.100:0/415807511 shutdown_connections 2024-08-17T02:46:36.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.678+0000 7fb905fd7740 1 -- 172.21.15.100:0/415807511 wait complete. 2024-08-17T02:46:36.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.679+0000 7fb905fd7740 20 client.5127 trim_cache size 0 max 16384 2024-08-17T02:46:36.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.694+0000 7fb905fd7740 1 Processor -- start 2024-08-17T02:46:36.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.694+0000 7fb905fd7740 1 -- start start 2024-08-17T02:46:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.695+0000 7fb905fd7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d520a0 0x565321d49e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.695+0000 7fb905fd7740 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d76a30 0x565321d4a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.695+0000 7fb905fd7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d94b10 0x565321d92040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.695+0000 7fb905fd7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x565321a29f20 con 0x565321d94b10 2024-08-17T02:46:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.695+0000 7fb905fd7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x565321d750d0 con 0x565321d520a0 2024-08-17T02:46:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.695+0000 7fb905fd7740 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x565321c6ff40 con 0x565321d76a30 2024-08-17T02:46:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.695+0000 7fb901a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d94b10 0x565321d92040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.695+0000 7fb901a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d94b10 0x565321d92040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45200/0 (socket says 172.21.15.100:45200) 2024-08-17T02:46:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.695+0000 7fb901a00640 1 -- 172.21.15.100:0/3788626315 learned_addr learned my addr 172.21.15.100:0/3788626315 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.695+0000 7fb8f3e00640 1 --2- 172.21.15.100:0/3788626315 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d76a30 0x565321d4a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.695+0000 7fb901000640 1 --2- 172.21.15.100:0/3788626315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d520a0 0x565321d49e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.696+0000 7fb901a00640 1 -- 172.21.15.100:0/3788626315 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d76a30 msgr2=0x565321d4a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:36.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.696+0000 7fb901a00640 1 --2- 172.21.15.100:0/3788626315 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d76a30 0x565321d4a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.696+0000 7fb901a00640 1 -- 172.21.15.100:0/3788626315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d520a0 msgr2=0x565321d49e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:36.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.696+0000 7fb901a00640 1 --2- 172.21.15.100:0/3788626315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d520a0 0x565321d49e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.696+0000 7fb901a00640 1 -- 172.21.15.100:0/3788626315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565321c7c490 con 0x565321d94b10 2024-08-17T02:46:36.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.696+0000 7fb8f3e00640 1 --2- 172.21.15.100:0/3788626315 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d76a30 0x565321d4a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:36.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.696+0000 7fb901000640 1 --2- 172.21.15.100:0/3788626315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d520a0 0x565321d49e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:36.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.696+0000 7fb901a00640 1 --2- 172.21.15.100:0/3788626315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d94b10 0x565321d92040 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400d1a0 tx=0x7fb8f408c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9bf714cc854450b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:36.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.696+0000 7fb8f1600640 1 -- 172.21.15.100:0/3788626315 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4076240 con 0x565321d94b10 2024-08-17T02:46:36.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.696+0000 7fb8f1600640 1 -- 172.21.15.100:0/3788626315 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f4076940 con 0x565321d94b10 2024-08-17T02:46:36.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.696+0000 7fb8f1600640 1 -- 172.21.15.100:0/3788626315 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4079490 con 0x565321d94b10 2024-08-17T02:46:36.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.696+0000 7fb905fd7740 1 -- 172.21.15.100:0/3788626315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d94b10 msgr2=0x565321d92040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.696+0000 7fb905fd7740 1 --2- 172.21.15.100:0/3788626315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d94b10 0x565321d92040 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400d1a0 tx=0x7fb8f408c000 comp rx=0 tx=0).stop 2024-08-17T02:46:36.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.697+0000 7fb905fd7740 1 -- 172.21.15.100:0/3788626315 shutdown_connections 2024-08-17T02:46:36.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.697+0000 7fb905fd7740 1 --2- 172.21.15.100:0/3788626315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d94b10 0x565321d92040 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.697+0000 7fb905fd7740 1 --2- 172.21.15.100:0/3788626315 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d76a30 0x565321d4a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.697+0000 7fb905fd7740 1 --2- 172.21.15.100:0/3788626315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d520a0 0x565321d49e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.697+0000 7fb905fd7740 1 -- 172.21.15.100:0/3788626315 >> 172.21.15.100:0/3788626315 conn(0x565321cea030 msgr2=0x565321d50e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:36.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.697+0000 7fb905fd7740 1 -- 172.21.15.100:0/3788626315 shutdown_connections 2024-08-17T02:46:36.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.697+0000 7fb905fd7740 1 -- 172.21.15.100:0/3788626315 wait complete. 2024-08-17T02:46:36.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.697+0000 7fb905fd7740 1 -- start start 2024-08-17T02:46:36.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.698+0000 7fb905fd7740 1 Processor -- start 2024-08-17T02:46:36.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.698+0000 7fb905fd7740 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d520a0 0x565321dff730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.698+0000 7fb905fd7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d76a30 0x565321d49e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.698+0000 7fb905fd7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d94b10 0x565321d4a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.698+0000 7fb905fd7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x565321d99290 con 0x565321d76a30 2024-08-17T02:46:36.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.698+0000 7fb905fd7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x565321dffc70 con 0x565321d94b10 2024-08-17T02:46:36.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.698+0000 7fb905fd7740 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x565321d4ef40 con 0x565321d520a0 2024-08-17T02:46:36.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.698+0000 7fb905fd7740 10 client.0 _ll_register_callbacks cb 0x7fb8f400bbf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:46:36.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.699+0000 7fb8f3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d76a30 0x565321d49e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.699+0000 7fb8f3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d76a30 0x565321d49e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45206/0 (socket says 172.21.15.100:45206) 2024-08-17T02:46:36.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.699+0000 7fb901000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d520a0 0x565321dff730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.699+0000 7fb8f3e00640 1 -- 172.21.15.100:0/2336626751 learned_addr learned my addr 172.21.15.100:0/2336626751 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:36.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.699+0000 7fb901a00640 1 --2- 172.21.15.100:0/2336626751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d94b10 0x565321d4a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.699+0000 7fb8f3e00640 1 -- 172.21.15.100:0/2336626751 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d520a0 msgr2=0x565321dff730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:36.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.699+0000 7fb8f3e00640 1 --2- 172.21.15.100:0/2336626751 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d520a0 0x565321dff730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.699+0000 7fb8f3e00640 1 -- 172.21.15.100:0/2336626751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d94b10 msgr2=0x565321d4a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:36.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.699+0000 7fb8f3e00640 1 --2- 172.21.15.100:0/2336626751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d94b10 0x565321d4a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.699+0000 7fb8f3e00640 1 -- 172.21.15.100:0/2336626751 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565321c78ab0 con 0x565321d76a30 2024-08-17T02:46:36.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.699+0000 7fb8f3e00640 1 --2- 172.21.15.100:0/2336626751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d76a30 0x565321d49e20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4014000 tx=0x7fb8e4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65f88eafab1102 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:36.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.699+0000 7fb8e9600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-08-17T02:46:36.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.700+0000 7fb8e9600640 1 -- 172.21.15.100:0/2336626751 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4026070 con 0x565321d76a30 2024-08-17T02:46:36.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.700+0000 7fb8e9600640 1 -- 172.21.15.100:0/2336626751 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb8e4003040 con 0x565321d76a30 2024-08-17T02:46:36.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.700+0000 7fb905fd7740 1 -- 172.21.15.100:0/2336626751 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb8e400f910 con 0x565321d76a30 2024-08-17T02:46:36.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.700+0000 7fb8e9600640 1 -- 172.21.15.100:0/2336626751 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8e400f7b0 con 0x565321d76a30 2024-08-17T02:46:36.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.700+0000 7fb905fd7740 10 client.5133 fetch_fsmap learned FSMap version 16 2024-08-17T02:46:36.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.700+0000 7fb905fd7740 1 -- 172.21.15.100:0/2336626751 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x565321c7c1e0 con 0x565321d76a30 2024-08-17T02:46:36.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.700+0000 7fb8e9600640 1 -- 172.21.15.100:0/2336626751 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e400f910 con 0x565321d76a30 2024-08-17T02:46:36.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.700+0000 7fb8e9600640 1 -- 172.21.15.100:0/2336626751 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb8e4029030 con 0x565321d76a30 2024-08-17T02:46:36.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.700+0000 7fb905fd7740 10 client.5133 fetch_fsmap finished waiting for FSMap version 16 2024-08-17T02:46:36.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.700+0000 7fb905fd7740 10 client.5133 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-17T02:46:36.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.700+0000 7fb905fd7740 20 client.5133 populate_metadata read hostname 'smithi100' 2024-08-17T02:46:36.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.700+0000 7fb905fd7740 1 --2- 172.21.15.100:0/2336626751 >> [v2:172.21.15.123:6833/1541092259,v1:172.21.15.123:6835/1541092259] conn(0x565321d95810 0x565321d95be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.700+0000 7fb905fd7740 4 client.5133 mds_command: new command op to 4959 tid=0[{"prefix": "status"}] 2024-08-17T02:46:36.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.700+0000 7fb905fd7740 1 -- 172.21.15.100:0/2336626751 --> [v2:172.21.15.123:6833/1541092259,v1:172.21.15.123:6835/1541092259] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5653219c76c0 con 0x565321d95810 2024-08-17T02:46:36.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.701+0000 7fb901000640 1 --2- 172.21.15.100:0/2336626751 >> [v2:172.21.15.123:6833/1541092259,v1:172.21.15.123:6835/1541092259] conn(0x565321d95810 0x565321d95be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.701+0000 7fb901000640 1 --2- 172.21.15.100:0/2336626751 >> [v2:172.21.15.123:6833/1541092259,v1:172.21.15.123:6835/1541092259] conn(0x565321d95810 0x565321d95be0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=361b2de18c56627b server_cookie=46102276024da693 in_seq=0 out_seq=0 2024-08-17T02:46:36.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.701+0000 7fb8e9600640 10 client.5133 ms_handle_connect on v2:172.21.15.123:6833/1541092259 2024-08-17T02:46:36.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.701+0000 7fb8e9600640 1 -- 172.21.15.100:0/2336626751 <== mds.0 v2:172.21.15.123:6833/1541092259 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x5653219c76c0 con 0x565321d95810 2024-08-17T02:46:36.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.701+0000 7fb8e9600640 10 client.5133 handle_command_reply: tid=0 2024-08-17T02:46:36.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.702+0000 7fb905fd7740 1 client.5133 shutdown 2024-08-17T02:46:36.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.702+0000 7fb905fd7740 1 -- 172.21.15.100:0/2336626751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d76a30 msgr2=0x565321d49e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.702+0000 7fb905fd7740 1 --2- 172.21.15.100:0/2336626751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d76a30 0x565321d49e20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4014000 tx=0x7fb8e4018000 comp rx=0 tx=0).stop 2024-08-17T02:46:36.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.702+0000 7fb905fd7740 1 -- 172.21.15.100:0/2336626751 shutdown_connections 2024-08-17T02:46:36.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.702+0000 7fb905fd7740 1 --2- 172.21.15.100:0/2336626751 >> [v2:172.21.15.123:6833/1541092259,v1:172.21.15.123:6835/1541092259] conn(0x565321d95810 0x565321d95be0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.702+0000 7fb905fd7740 1 --2- 172.21.15.100:0/2336626751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x565321d94b10 0x565321d4a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.702+0000 7fb905fd7740 1 --2- 172.21.15.100:0/2336626751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565321d76a30 0x565321d49e20 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.702+0000 7fb905fd7740 1 --2- 172.21.15.100:0/2336626751 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x565321d520a0 0x565321dff730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.702+0000 7fb8e9600640 0 client.5133 ms_handle_reset on v2:172.21.15.123:6833/1541092259 2024-08-17T02:46:36.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.702+0000 7fb905fd7740 1 -- 172.21.15.100:0/2336626751 >> 172.21.15.100:0/2336626751 conn(0x565321cea030 msgr2=0x565321d46620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:36.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.702+0000 7fb905fd7740 1 -- 172.21.15.100:0/2336626751 shutdown_connections 2024-08-17T02:46:36.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.702+0000 7fb905fd7740 1 -- 172.21.15.100:0/2336626751 wait complete. 2024-08-17T02:46:36.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.702+0000 7fb905fd7740 20 client.5133 trim_cache size 0 max 16384 2024-08-17T02:46:36.709 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-08-17T02:46:36.709 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "9fea90ef-12b1-4f23-8013-27074825f754", 2024-08-17T02:46:36.709 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-08-17T02:46:36.709 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4959, 2024-08-17T02:46:36.709 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-08-17T02:46:36.709 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-08-17T02:46:36.709 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-08-17T02:46:36.709 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 5.998677474, 2024-08-17T02:46:36.710 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 16, 2024-08-17T02:46:36.710 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 33, 2024-08-17T02:46:36.710 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 33, 2024-08-17T02:46:36.710 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 13.820397471 2024-08-17T02:46:36.710 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-08-17T02:46:36.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.702+0000 7fb903a00640 1 -- 172.21.15.100:0/3567945294 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb8d8065150 msgr2=0x7fb8d8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.702+0000 7fb903a00640 1 --2- 172.21.15.100:0/3567945294 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb8d8065150 0x7fb8d8067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec00bb80 tx=0x7fb8ec008040 comp rx=0 tx=0).stop 2024-08-17T02:46:36.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.703+0000 7fb903a00640 1 -- 172.21.15.100:0/3567945294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8fc155df0 msgr2=0x7fb8fc1466e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.703+0000 7fb903a00640 1 --2- 172.21.15.100:0/3567945294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8fc155df0 0x7fb8fc1466e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400d1d0 tx=0x7fb8f4039000 comp rx=0 tx=0).stop 2024-08-17T02:46:36.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.703+0000 7fb903a00640 1 -- 172.21.15.100:0/3567945294 shutdown_connections 2024-08-17T02:46:36.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.703+0000 7fb903a00640 1 --2- 172.21.15.100:0/3567945294 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb8d8065150 0x7fb8d8067600 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.703+0000 7fb903a00640 1 --2- 172.21.15.100:0/3567945294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8fc155df0 0x7fb8fc1466e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.703+0000 7fb903a00640 1 --2- 172.21.15.100:0/3567945294 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb8fc155a20 0x7fb8fc1461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.703+0000 7fb903a00640 1 --2- 172.21.15.100:0/3567945294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8fc06df00 0x7fb8fc15d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.703+0000 7fb903a00640 1 -- 172.21.15.100:0/3567945294 >> 172.21.15.100:0/3567945294 conn(0x7fb8fc0cb9b0 msgr2=0x7fb8fc06d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:36.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.703+0000 7fb903a00640 1 -- 172.21.15.100:0/3567945294 shutdown_connections 2024-08-17T02:46:36.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.703+0000 7fb903a00640 1 -- 172.21.15.100:0/3567945294 wait complete. 2024-08-17T02:46:36.718 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:46:36.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.865+0000 7f9274a00640 1 Processor -- start 2024-08-17T02:46:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.865+0000 7f9274a00640 1 -- start start 2024-08-17T02:46:36.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.866+0000 7f9274a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f927015c230 0x7f927006be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.866+0000 7f9274a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f927006b9d0 con 0x7f92700aa8f0 2024-08-17T02:46:36.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.866+0000 7f9274a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f927006ebf0 con 0x7f927015c600 2024-08-17T02:46:36.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.866+0000 7f9274a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92700aad80 con 0x7f927015c230 2024-08-17T02:46:36.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.866+0000 7f926e800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f92700aa8f0 0x7f9270066cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56960/0 (socket says 172.21.15.100:56960) 2024-08-17T02:46:36.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.866+0000 7f926e800640 1 -- 172.21.15.100:0/3195521536 learned_addr learned my addr 172.21.15.100:0/3195521536 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:36.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.867+0000 7f926de00640 1 --2- 172.21.15.100:0/3195521536 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f927015c230 0x7f927006be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.867+0000 7f926d400640 1 -- 172.21.15.100:0/3195521536 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476565625 0 0) 0x7f927006b9d0 con 0x7f92700aa8f0 2024-08-17T02:46:36.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.867+0000 7f926d400640 1 -- 172.21.15.100:0/3195521536 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92540034e0 con 0x7f92700aa8f0 2024-08-17T02:46:36.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.867+0000 7f926d400640 1 -- 172.21.15.100:0/3195521536 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659574616 0 0) 0x7f927006ebf0 con 0x7f927015c600 2024-08-17T02:46:36.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.867+0000 7f926d400640 1 -- 172.21.15.100:0/3195521536 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f927006b9d0 con 0x7f927015c600 2024-08-17T02:46:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.867+0000 7f926de00640 1 -- 172.21.15.100:0/3195521536 >> v1:172.21.15.123:6789/0 conn(0x7f927015c600 legacy=0x7f927006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.867+0000 7f926de00640 1 -- 172.21.15.100:0/3195521536 >> v1:172.21.15.100:6789/0 conn(0x7f92700aa8f0 legacy=0x7f9270066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.867+0000 7f926de00640 1 -- 172.21.15.100:0/3195521536 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92700ab060 con 0x7f927015c230 2024-08-17T02:46:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.868+0000 7f926de00640 1 --2- 172.21.15.100:0/3195521536 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f927015c230 0x7f927006be60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9260009880 tx=0x7f92600090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9e62f5286c4b7d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.868+0000 7f926d400640 1 -- 172.21.15.100:0/3195521536 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926002ae10 con 0x7f927015c230 2024-08-17T02:46:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.868+0000 7f926d400640 1 -- 172.21.15.100:0/3195521536 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9260032440 con 0x7f927015c230 2024-08-17T02:46:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.868+0000 7f926d400640 1 -- 172.21.15.100:0/3195521536 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92600327c0 con 0x7f927015c230 2024-08-17T02:46:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.869+0000 7f9274a00640 1 -- 172.21.15.100:0/3195521536 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f927015c230 msgr2=0x7f927006be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.869+0000 7f9274a00640 1 --2- 172.21.15.100:0/3195521536 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f927015c230 0x7f927006be60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9260009880 tx=0x7f92600090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.869+0000 7f9274a00640 1 -- 172.21.15.100:0/3195521536 shutdown_connections 2024-08-17T02:46:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.869+0000 7f9274a00640 1 --2- 172.21.15.100:0/3195521536 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f927015c230 0x7f927006be60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.869+0000 7f9274a00640 1 -- 172.21.15.100:0/3195521536 >> 172.21.15.100:0/3195521536 conn(0x7f927006d8f0 msgr2=0x7f927006dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.869+0000 7f9274a00640 1 -- 172.21.15.100:0/3195521536 shutdown_connections 2024-08-17T02:46:36.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.869+0000 7f9274a00640 1 -- 172.21.15.100:0/3195521536 wait complete. 2024-08-17T02:46:36.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.870+0000 7f9274a00640 1 Processor -- start 2024-08-17T02:46:36.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.871+0000 7f9274a00640 1 -- start start 2024-08-17T02:46:36.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.871+0000 7f9274a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92700aa8f0 0x7f92700ac540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.872+0000 7f9274a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f927015c230 0x7f92700cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.872+0000 7f9274a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f927015c600 0x7f927013db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.872+0000 7f9274a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92700cc310 con 0x7f927015c230 2024-08-17T02:46:36.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.872+0000 7f9274a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92700acc20 con 0x7f92700aa8f0 2024-08-17T02:46:36.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.872+0000 7f9274a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92700acf00 con 0x7f927015c600 2024-08-17T02:46:36.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.872+0000 7f9267e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f927015c230 0x7f92700cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.872+0000 7f9267e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f927015c230 0x7f92700cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50986/0 (socket says 172.21.15.100:50986) 2024-08-17T02:46:36.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.872+0000 7f926de00640 1 --2- 172.21.15.100:0/3271973740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92700aa8f0 0x7f92700ac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.872+0000 7f9267e00640 1 -- 172.21.15.100:0/3271973740 learned_addr learned my addr 172.21.15.100:0/3271973740 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:36.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.872+0000 7f926e800640 1 --2- 172.21.15.100:0/3271973740 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f927015c600 0x7f927013db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.872+0000 7f9267e00640 1 -- 172.21.15.100:0/3271973740 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f927015c600 msgr2=0x7f927013db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.872+0000 7f9267e00640 1 --2- 172.21.15.100:0/3271973740 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f927015c600 0x7f927013db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.872+0000 7f9267e00640 1 -- 172.21.15.100:0/3271973740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92700aa8f0 msgr2=0x7f92700ac540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.872+0000 7f9267e00640 1 --2- 172.21.15.100:0/3271973740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92700aa8f0 0x7f92700ac540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.872+0000 7f9267e00640 1 -- 172.21.15.100:0/3271973740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9260009390 con 0x7f927015c230 2024-08-17T02:46:36.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.873+0000 7f9267e00640 1 --2- 172.21.15.100:0/3271973740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f927015c230 0x7f92700cbdd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f925800c560 tx=0x7f9258007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:36.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.873+0000 7f9265600640 1 -- 172.21.15.100:0/3271973740 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9258011590 con 0x7f927015c230 2024-08-17T02:46:36.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.873+0000 7f9265600640 1 -- 172.21.15.100:0/3271973740 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92580116f0 con 0x7f927015c230 2024-08-17T02:46:36.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.873+0000 7f9265600640 1 -- 172.21.15.100:0/3271973740 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9258011ab0 con 0x7f927015c230 2024-08-17T02:46:36.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.873+0000 7f9274a00640 1 -- 172.21.15.100:0/3271973740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92700ad1e0 con 0x7f927015c230 2024-08-17T02:46:36.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.873+0000 7f9274a00640 1 -- 172.21.15.100:0/3271973740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92700ad7a0 con 0x7f927015c230 2024-08-17T02:46:36.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.874+0000 7f9274a00640 1 -- 172.21.15.100:0/3271973740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92700ad9f0 con 0x7f927015c230 2024-08-17T02:46:36.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.875+0000 7f9265600640 1 -- 172.21.15.100:0/3271973740 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f925801c460 con 0x7f927015c230 2024-08-17T02:46:36.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.875+0000 7f9265600640 1 --2- 172.21.15.100:0/3271973740 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f924c065150 0x7f924c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.876+0000 7f9265600640 1 -- 172.21.15.100:0/3271973740 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9258082080 con 0x7f927015c230 2024-08-17T02:46:36.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.876+0000 7f926de00640 1 --2- 172.21.15.100:0/3271973740 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f924c065150 0x7f924c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.876+0000 7f926de00640 1 --2- 172.21.15.100:0/3271973740 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f924c065150 0x7f924c067600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9260034000 tx=0x7f9260032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:36.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:36.879+0000 7f9265600640 1 -- 172.21.15.100:0/3271973740 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9258050150 con 0x7f927015c230 2024-08-17T02:46:37.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:37.087+0000 7f9274a00640 1 -- 172.21.15.100:0/3271973740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9270064db0 con 0x7f927015c230 2024-08-17T02:46:37.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:37.088+0000 7f9265600640 1 -- 172.21.15.100:0/3271973740 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9258053770 con 0x7f927015c230 2024-08-17T02:46:37.089 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:46:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:37.090+0000 7f9274a00640 1 -- 172.21.15.100:0/3271973740 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f924c065150 msgr2=0x7f924c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:37.090+0000 7f9274a00640 1 --2- 172.21.15.100:0/3271973740 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f924c065150 0x7f924c067600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9260034000 tx=0x7f9260032000 comp rx=0 tx=0).stop 2024-08-17T02:46:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:37.090+0000 7f9274a00640 1 -- 172.21.15.100:0/3271973740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f927015c230 msgr2=0x7f92700cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:37.090+0000 7f9274a00640 1 --2- 172.21.15.100:0/3271973740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f927015c230 0x7f92700cbdd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f925800c560 tx=0x7f9258007d50 comp rx=0 tx=0).stop 2024-08-17T02:46:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:37.090+0000 7f9274a00640 1 -- 172.21.15.100:0/3271973740 shutdown_connections 2024-08-17T02:46:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:37.090+0000 7f9274a00640 1 --2- 172.21.15.100:0/3271973740 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f924c065150 0x7f924c067600 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:37.090+0000 7f9274a00640 1 --2- 172.21.15.100:0/3271973740 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f927015c600 0x7f927013db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:37.090+0000 7f9274a00640 1 --2- 172.21.15.100:0/3271973740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f927015c230 0x7f92700cbdd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:37.090+0000 7f9274a00640 1 --2- 172.21.15.100:0/3271973740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92700aa8f0 0x7f92700ac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:37.090+0000 7f9274a00640 1 -- 172.21.15.100:0/3271973740 >> 172.21.15.100:0/3271973740 conn(0x7f927006d8f0 msgr2=0x7f927015a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:37.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:37.090+0000 7f9274a00640 1 -- 172.21.15.100:0/3271973740 shutdown_connections 2024-08-17T02:46:37.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:37.090+0000 7f9274a00640 1 -- 172.21.15.100:0/3271973740 wait complete. 2024-08-17T02:46:37.106 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:46:37.106 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:46:37.106 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-08-17T02:46:37.106 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:46:37.106 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:46:37.106 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:46:37.106 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:46:37.107 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:46:37.107 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:46:37.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:37.107 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-08-17T02:46:37.144 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:46:37.144 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:46:37.144 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:46:37.144 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:37.144 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-08-17T02:46:37.144 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:37.145 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:37.145 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:37.146 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-08-17T02:46:37.146 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:37.146 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:37.146 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-08-17T02:46:37.146 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:37.147 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:37.147 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:46:37.147 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:37.147 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:46:37.147 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42613sec preferred_lft 42613sec 2024-08-17T02:46:37.147 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-08-17T02:46:37.148 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:37.148 INFO:teuthology.orchestra.run.smithi100.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:46:37.148 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether aa:7d:f7:28:a9:60 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:37.148 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:46:37.148 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:37.148 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::d0b6:78ff:fedc:6b3e/64 scope link 2024-08-17T02:46:37.148 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:37.148 INFO:teuthology.orchestra.run.smithi100.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:46:37.148 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether aa:7d:f7:28:a9:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:46:37.149 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::a87d:f7ff:fe28:a960/64 scope link 2024-08-17T02:46:37.149 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:37.149 INFO:teuthology.orchestra.run.smithi100.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:46:37.149 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether da:b2:3e:14:a8:33 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:46:37.149 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::d8b2:3eff:fe14:a833/64 scope link 2024-08-17T02:46:37.149 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:37.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:37.149 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:46:37.238 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-08-17T02:46:37.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:37.241 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-08-17T02:46:37.277 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-08-17T02:46:37.277 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:46:37.278 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:46:37.278 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:46:37.278 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:46:37.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:37.278 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-08-17T02:46:37.278 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-08-17T02:46:37.278 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:46:37.278 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:46:37.278 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:46:37.279 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-08-17T02:46:37.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:37.422 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-08-17T02:46:37.457 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:46:37.457 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:46:37.457 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:46:37.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:37.458 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-08-17T02:46:37.554 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:46:37.554 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:46:37.589 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:46:37.589 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:46:37.589 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:46:37.665 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:46:37.665 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:46:37.665 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:37.789 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:37.789 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:46:37.816 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:37.816 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:46:37.816 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.123:3300,172.21.15.123:3301" 2024-08-17T02:46:37.816 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with new device syntax: 0@9fea90ef-12b1-4f23-8013-27074825f754.cephfs=/ 2024-08-17T02:46:37.816 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.100:3300/172.21.15.123:3300/172.21.15.123:3301" will pass to kernel 2024-08-17T02:46:37.817 INFO:teuthology.orchestra.run.smithi100.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:46:37.817 INFO:teuthology.orchestra.run.smithi100.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:46:37.817 INFO:teuthology.orchestra.run.smithi100.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:46:37.817 INFO:teuthology.orchestra.run.smithi100.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:46:37.817 INFO:teuthology.orchestra.run.smithi100.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:46:37.821 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:46:37.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:37.821 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:46:37.878 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:46:38.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.024+0000 7efff4600640 1 Processor -- start 2024-08-17T02:46:38.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.025+0000 7efff4600640 1 -- start start 2024-08-17T02:46:38.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.026+0000 7efff4600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7effec155a20 0x7effec0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:38.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.026+0000 7efff4600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7effec155df0 0x7effec0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:38.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.026+0000 7efff4600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec156670 con 0x7effec06d7f0 2024-08-17T02:46:38.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.026+0000 7efff4600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effec0b0350 con 0x7effec155df0 2024-08-17T02:46:38.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.026+0000 7efff4600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec06e5e0 con 0x7effec155a20 2024-08-17T02:46:38.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.026+0000 7efff1200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7effec155df0 0x7effec0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:38.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.026+0000 7efff1200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7effec155df0 0x7effec0ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50998/0 (socket says 172.21.15.100:50998) 2024-08-17T02:46:38.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.026+0000 7efff1200640 1 -- 172.21.15.100:0/175590099 learned_addr learned my addr 172.21.15.100:0/175590099 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:38.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.026+0000 7efff1c00640 1 --2- 172.21.15.100:0/175590099 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7effec155a20 0x7effec0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:38.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.026+0000 7efff1200640 1 -- 172.21.15.100:0/175590099 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7effec155a20 msgr2=0x7effec0adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:38.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.026+0000 7efff1200640 1 --2- 172.21.15.100:0/175590099 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7effec155a20 0x7effec0adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:38.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.026+0000 7efff1200640 1 -- 172.21.15.100:0/175590099 >> v1:172.21.15.100:6789/0 conn(0x7effec06d7f0 legacy=0x7effec0ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:38.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.026+0000 7efff1200640 1 -- 172.21.15.100:0/175590099 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec06e8c0 con 0x7effec155df0 2024-08-17T02:46:38.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.027+0000 7efff1200640 1 --2- 172.21.15.100:0/175590099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effec155df0 0x7effec0ad9b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7effd8009910 tx=0x7effd80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1323ce5cdb2c3f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:38.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.028+0000 7effebe00640 1 -- 172.21.15.100:0/175590099 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd802ae40 con 0x7effec155df0 2024-08-17T02:46:38.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.028+0000 7effebe00640 1 -- 172.21.15.100:0/175590099 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd8032440 con 0x7effec155df0 2024-08-17T02:46:38.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.028+0000 7effebe00640 1 -- 172.21.15.100:0/175590099 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd8032820 con 0x7effec155df0 2024-08-17T02:46:38.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.028+0000 7efff4600640 1 -- 172.21.15.100:0/175590099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effec155df0 msgr2=0x7effec0ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:38.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.028+0000 7efff4600640 1 --2- 172.21.15.100:0/175590099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effec155df0 0x7effec0ad9b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7effd8009910 tx=0x7effd80091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:38.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.028+0000 7efff4600640 1 -- 172.21.15.100:0/175590099 shutdown_connections 2024-08-17T02:46:38.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.028+0000 7efff4600640 1 --2- 172.21.15.100:0/175590099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effec155df0 0x7effec0ad9b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:38.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.028+0000 7efff4600640 1 --2- 172.21.15.100:0/175590099 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7effec155a20 0x7effec0adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:38.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.028+0000 7efff4600640 1 -- 172.21.15.100:0/175590099 >> 172.21.15.100:0/175590099 conn(0x7effec0cb9b0 msgr2=0x7effec0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:38.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.028+0000 7efff4600640 1 -- 172.21.15.100:0/175590099 shutdown_connections 2024-08-17T02:46:38.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.028+0000 7efff4600640 1 -- 172.21.15.100:0/175590099 wait complete. 2024-08-17T02:46:38.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.030+0000 7efff4600640 1 Processor -- start 2024-08-17T02:46:38.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.030+0000 7efff4600640 1 -- start start 2024-08-17T02:46:38.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.031+0000 7efff4600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effec06d7f0 0x7effec0cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:38.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.031+0000 7efff4600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7effec155a20 0x7effec0a9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:38.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.031+0000 7efff4600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effec155df0 0x7effec0c09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:38.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.031+0000 7efff4600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec143d00 con 0x7effec06d7f0 2024-08-17T02:46:38.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.031+0000 7efff4600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec0abb10 con 0x7effec155df0 2024-08-17T02:46:38.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.031+0000 7efff4600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec0cb660 con 0x7effec155a20 2024-08-17T02:46:38.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.031+0000 7efff1c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effec06d7f0 0x7effec0cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:38.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.031+0000 7efff1c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effec06d7f0 0x7effec0cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51002/0 (socket says 172.21.15.100:51002) 2024-08-17T02:46:38.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.031+0000 7efff1c00640 1 -- 172.21.15.100:0/3807702316 learned_addr learned my addr 172.21.15.100:0/3807702316 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:38.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.031+0000 7efff1200640 1 --2- 172.21.15.100:0/3807702316 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7effec155a20 0x7effec0a9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:38.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.031+0000 7efff2600640 1 --2- 172.21.15.100:0/3807702316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effec155df0 0x7effec0c09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:38.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.031+0000 7efff1c00640 1 -- 172.21.15.100:0/3807702316 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7effec155a20 msgr2=0x7effec0a9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:38.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.031+0000 7efff1c00640 1 --2- 172.21.15.100:0/3807702316 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7effec155a20 0x7effec0a9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:38.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.031+0000 7efff1c00640 1 -- 172.21.15.100:0/3807702316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effec155df0 msgr2=0x7effec0c09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:38.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.031+0000 7efff1c00640 1 --2- 172.21.15.100:0/3807702316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effec155df0 0x7effec0c09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:38.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.031+0000 7efff1c00640 1 -- 172.21.15.100:0/3807702316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd8009450 con 0x7effec06d7f0 2024-08-17T02:46:38.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.032+0000 7efff1c00640 1 --2- 172.21.15.100:0/3807702316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effec06d7f0 0x7effec0cb120 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7effe000d890 tx=0x7effe0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:38.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.032+0000 7effe8c00640 1 -- 172.21.15.100:0/3807702316 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe000de20 con 0x7effec06d7f0 2024-08-17T02:46:38.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.032+0000 7effe8c00640 1 -- 172.21.15.100:0/3807702316 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe000b8d0 con 0x7effec06d7f0 2024-08-17T02:46:38.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.032+0000 7effe8c00640 1 -- 172.21.15.100:0/3807702316 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe000bc70 con 0x7effec06d7f0 2024-08-17T02:46:38.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.032+0000 7efff4600640 1 -- 172.21.15.100:0/3807702316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effec0aaf00 con 0x7effec06d7f0 2024-08-17T02:46:38.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.032+0000 7efff4600640 1 -- 172.21.15.100:0/3807702316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effec0ab4c0 con 0x7effec06d7f0 2024-08-17T02:46:38.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.033+0000 7efff4600640 1 -- 172.21.15.100:0/3807702316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effec064db0 con 0x7effec06d7f0 2024-08-17T02:46:38.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.034+0000 7effe8c00640 1 -- 172.21.15.100:0/3807702316 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7effe0014640 con 0x7effec06d7f0 2024-08-17T02:46:38.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.034+0000 7effe8c00640 1 --2- 172.21.15.100:0/3807702316 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7effcc065150 0x7effcc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:38.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.035+0000 7effe8c00640 1 -- 172.21.15.100:0/3807702316 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7effe0082ab0 con 0x7effec06d7f0 2024-08-17T02:46:38.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.035+0000 7efff1200640 1 --2- 172.21.15.100:0/3807702316 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7effcc065150 0x7effcc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:38.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.035+0000 7efff1200640 1 --2- 172.21.15.100:0/3807702316 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7effcc065150 0x7effcc067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7effd8034000 tx=0x7effd8032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:38.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.039+0000 7effe8c00640 1 -- 172.21.15.100:0/3807702316 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7effe0050b90 con 0x7effec06d7f0 2024-08-17T02:46:38.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.250+0000 7efff4600640 1 -- 172.21.15.100:0/3807702316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7effec0ad7f0 con 0x7effec06d7f0 2024-08-17T02:46:38.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.251+0000 7effe8c00640 1 -- 172.21.15.100:0/3807702316 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7effe00541b0 con 0x7effec06d7f0 2024-08-17T02:46:38.252 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:46:38.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.253+0000 7efff4600640 1 -- 172.21.15.100:0/3807702316 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7effcc065150 msgr2=0x7effcc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:38.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.253+0000 7efff4600640 1 --2- 172.21.15.100:0/3807702316 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7effcc065150 0x7effcc067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7effd8034000 tx=0x7effd8032000 comp rx=0 tx=0).stop 2024-08-17T02:46:38.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.253+0000 7efff4600640 1 -- 172.21.15.100:0/3807702316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effec06d7f0 msgr2=0x7effec0cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:38.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.253+0000 7efff4600640 1 --2- 172.21.15.100:0/3807702316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effec06d7f0 0x7effec0cb120 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7effe000d890 tx=0x7effe0008040 comp rx=0 tx=0).stop 2024-08-17T02:46:38.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.253+0000 7efff4600640 1 -- 172.21.15.100:0/3807702316 shutdown_connections 2024-08-17T02:46:38.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.253+0000 7efff4600640 1 --2- 172.21.15.100:0/3807702316 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7effcc065150 0x7effcc067600 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:38.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.253+0000 7efff4600640 1 --2- 172.21.15.100:0/3807702316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effec155df0 0x7effec0c09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:38.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.253+0000 7efff4600640 1 --2- 172.21.15.100:0/3807702316 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7effec155a20 0x7effec0a9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:38.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.253+0000 7efff4600640 1 --2- 172.21.15.100:0/3807702316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effec06d7f0 0x7effec0cb120 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:38.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.253+0000 7efff4600640 1 -- 172.21.15.100:0/3807702316 >> 172.21.15.100:0/3807702316 conn(0x7effec0cb9b0 msgr2=0x7effec157310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:38.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.253+0000 7efff4600640 1 -- 172.21.15.100:0/3807702316 shutdown_connections 2024-08-17T02:46:38.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:38.253+0000 7efff4600640 1 -- 172.21.15.100:0/3807702316 wait complete. 2024-08-17T02:46:38.269 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:46:38.269 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:46:38.269 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-08-17T02:46:38.269 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:46:38.269 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:46:38.269 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:46:38.269 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:46:38.269 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:46:38.269 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:46:38.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:38.270 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-08-17T02:46:38.311 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:46:38.312 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:46:38.312 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:46:38.312 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:38.312 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-08-17T02:46:38.312 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:38.313 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:38.313 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:38.313 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-08-17T02:46:38.313 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:38.313 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:38.313 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-08-17T02:46:38.313 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:38.314 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:38.314 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:46:38.314 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:38.314 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:46:38.314 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42638sec preferred_lft 42638sec 2024-08-17T02:46:38.314 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2024-08-17T02:46:38.315 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:38.315 INFO:teuthology.orchestra.run.smithi123.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:46:38.315 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 3e:c4:8a:6f:87:9d brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:38.315 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:46:38.315 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:38.315 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::dc40:19ff:fe17:cacc/64 scope link 2024-08-17T02:46:38.316 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:38.316 INFO:teuthology.orchestra.run.smithi123.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:46:38.316 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether ca:2c:48:85:0d:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:46:38.316 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::c82c:48ff:fe85:d49/64 scope link 2024-08-17T02:46:38.317 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:38.317 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:46:38.317 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 3e:c4:8a:6f:87:9d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:46:38.317 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::3cc4:8aff:fe6f:879d/64 scope link 2024-08-17T02:46:38.317 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:38.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:38.318 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:46:38.409 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-08-17T02:46:38.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:38.413 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-08-17T02:46:38.450 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-08-17T02:46:38.450 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:46:38.450 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:46:38.451 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:46:38.451 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:46:38.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:38.452 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-08-17T02:46:38.452 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-08-17T02:46:38.452 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:46:38.452 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:46:38.452 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:46:38.452 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-08-17T02:46:38.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:38.596 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-08-17T02:46:38.631 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:46:38.631 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:46:38.631 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:46:38.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:38.631 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-08-17T02:46:38.729 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:46:38.729 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:46:38.766 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:46:38.767 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:46:38.767 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:46:38.843 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:46:38.844 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:46:38.844 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:38.965 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:38.966 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:46:38.992 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:38.992 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:46:38.992 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.123:3300,172.21.15.123:3301" 2024-08-17T02:46:38.993 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with new device syntax: 1@9fea90ef-12b1-4f23-8013-27074825f754.cephfs=/ 2024-08-17T02:46:38.993 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.100:3300/172.21.15.123:3300/172.21.15.123:3301" will pass to kernel 2024-08-17T02:46:38.993 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:46:38.994 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:46:38.994 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:46:38.994 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:46:38.994 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:46:38.997 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:46:38.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:38.998 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:46:39.056 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-17T02:46:39.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.211+0000 7f5ffd800640 1 Processor -- start 2024-08-17T02:46:39.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.211+0000 7f5ffd800640 1 -- start start 2024-08-17T02:46:39.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.212+0000 7f5ffd800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ff80b2bb0 0x7f5ff80b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.212+0000 7f5ffd800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ff815c4b0 0x7f5ff80aac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.212+0000 7f5ffd800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff80d0a80 con 0x7f5ff80b5740 2024-08-17T02:46:39.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.212+0000 7f5ffd800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff80b2130 con 0x7f5ff80b2bb0 2024-08-17T02:46:39.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.212+0000 7f5ffd800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80b23f0 con 0x7f5ff815c4b0 2024-08-17T02:46:39.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.212+0000 7f5ff7e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ff80b2bb0 0x7f5ff80b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.213+0000 7f5ff7e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ff80b2bb0 0x7f5ff80b2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51008/0 (socket says 172.21.15.100:51008) 2024-08-17T02:46:39.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.213+0000 7f5ff7e00640 1 -- 172.21.15.100:0/571362553 learned_addr learned my addr 172.21.15.100:0/571362553 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:39.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.213+0000 7f5ffce00640 1 --2- 172.21.15.100:0/571362553 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ff815c4b0 0x7f5ff80aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.213+0000 7f5ff7e00640 1 -- 172.21.15.100:0/571362553 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ff815c4b0 msgr2=0x7f5ff80aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:39.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.213+0000 7f5ff7e00640 1 --2- 172.21.15.100:0/571362553 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ff815c4b0 0x7f5ff80aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.213+0000 7f5ff7e00640 1 -- 172.21.15.100:0/571362553 >> v1:172.21.15.100:6789/0 conn(0x7f5ff80b5740 legacy=0x7f5ff815bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.213+0000 7f5ff7e00640 1 -- 172.21.15.100:0/571362553 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff80b37a0 con 0x7f5ff80b2bb0 2024-08-17T02:46:39.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.213+0000 7f5ffce00640 1 --2- 172.21.15.100:0/571362553 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ff815c4b0 0x7f5ff80aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:39.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.214+0000 7f5ff7e00640 1 --2- 172.21.15.100:0/571362553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ff80b2bb0 0x7f5ff80b2f80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009f20 tx=0x7f5fe8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217c7ac360cdeb03 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:39.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.214+0000 7f5ff7400640 1 -- 172.21.15.100:0/571362553 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8032450 con 0x7f5ff80b2bb0 2024-08-17T02:46:39.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.214+0000 7f5ff7400640 1 -- 172.21.15.100:0/571362553 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe80325b0 con 0x7f5ff80b2bb0 2024-08-17T02:46:39.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.214+0000 7f5ff7400640 1 -- 172.21.15.100:0/571362553 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8032990 con 0x7f5ff80b2bb0 2024-08-17T02:46:39.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.215+0000 7f5ffd800640 1 -- 172.21.15.100:0/571362553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ff80b2bb0 msgr2=0x7f5ff80b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.215+0000 7f5ffd800640 1 --2- 172.21.15.100:0/571362553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ff80b2bb0 0x7f5ff80b2f80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009f20 tx=0x7f5fe8009840 comp rx=0 tx=0).stop 2024-08-17T02:46:39.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.215+0000 7f5ffd800640 1 -- 172.21.15.100:0/571362553 shutdown_connections 2024-08-17T02:46:39.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.215+0000 7f5ffd800640 1 --2- 172.21.15.100:0/571362553 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ff815c4b0 0x7f5ff80aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.215+0000 7f5ffd800640 1 --2- 172.21.15.100:0/571362553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ff80b2bb0 0x7f5ff80b2f80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.215+0000 7f5ffd800640 1 -- 172.21.15.100:0/571362553 >> 172.21.15.100:0/571362553 conn(0x7f5ff80cfbc0 msgr2=0x7f5ff80cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:39.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.215+0000 7f5ffd800640 1 -- 172.21.15.100:0/571362553 shutdown_connections 2024-08-17T02:46:39.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.215+0000 7f5ffd800640 1 -- 172.21.15.100:0/571362553 wait complete. 2024-08-17T02:46:39.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.216+0000 7f5ffd800640 1 Processor -- start 2024-08-17T02:46:39.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.216+0000 7f5ffd800640 1 -- start start 2024-08-17T02:46:39.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.217+0000 7f5ffd800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ff80b2bb0 0x7f5ff8169050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.217+0000 7f5ffd800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ff80b5740 0x7f5ff8156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.217+0000 7f5ffd800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ff815c4b0 0x7f5ff816cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.217+0000 7f5ffd800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff816c660 con 0x7f5ff815c4b0 2024-08-17T02:46:39.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.217+0000 7f5ffd800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff81698d0 con 0x7f5ff80b2bb0 2024-08-17T02:46:39.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.217+0000 7f5ffd800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff8169bb0 con 0x7f5ff80b5740 2024-08-17T02:46:39.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.218+0000 7f5ffce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ff815c4b0 0x7f5ff816cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.218+0000 7f5ffce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ff815c4b0 0x7f5ff816cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51020/0 (socket says 172.21.15.100:51020) 2024-08-17T02:46:39.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.218+0000 7f5ffce00640 1 -- 172.21.15.100:0/272456750 learned_addr learned my addr 172.21.15.100:0/272456750 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:39.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.218+0000 7f5fef400640 1 --2- 172.21.15.100:0/272456750 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ff80b5740 0x7f5ff8156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.218+0000 7f5ff7e00640 1 --2- 172.21.15.100:0/272456750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ff80b2bb0 0x7f5ff8169050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.218+0000 7f5ffce00640 1 -- 172.21.15.100:0/272456750 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ff80b5740 msgr2=0x7f5ff8156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.218+0000 7f5ffce00640 1 --2- 172.21.15.100:0/272456750 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ff80b5740 0x7f5ff8156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.218+0000 7f5ffce00640 1 -- 172.21.15.100:0/272456750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ff80b2bb0 msgr2=0x7f5ff8169050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.218+0000 7f5ffce00640 1 --2- 172.21.15.100:0/272456750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ff80b2bb0 0x7f5ff8169050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.218+0000 7f5ffce00640 1 -- 172.21.15.100:0/272456750 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe8009ae0 con 0x7f5ff815c4b0 2024-08-17T02:46:39.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.218+0000 7f5ff7e00640 1 --2- 172.21.15.100:0/272456750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ff80b2bb0 0x7f5ff8169050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:39.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.218+0000 7f5ffce00640 1 --2- 172.21.15.100:0/272456750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ff815c4b0 0x7f5ff816cdd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000d890 tx=0x7f5ff0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:39.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.219+0000 7f5fefe00640 1 -- 172.21.15.100:0/272456750 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff000de20 con 0x7f5ff815c4b0 2024-08-17T02:46:39.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.219+0000 7f5fefe00640 1 -- 172.21.15.100:0/272456750 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff00098b0 con 0x7f5ff815c4b0 2024-08-17T02:46:39.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.219+0000 7f5fefe00640 1 -- 172.21.15.100:0/272456750 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0009c70 con 0x7f5ff815c4b0 2024-08-17T02:46:39.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.219+0000 7f5ffd800640 1 -- 172.21.15.100:0/272456750 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff8169e90 con 0x7f5ff815c4b0 2024-08-17T02:46:39.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.219+0000 7f5ffd800640 1 -- 172.21.15.100:0/272456750 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff8169590 con 0x7f5ff815c4b0 2024-08-17T02:46:39.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.220+0000 7f5ffd800640 1 -- 172.21.15.100:0/272456750 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff8071050 con 0x7f5ff815c4b0 2024-08-17T02:46:39.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.221+0000 7f5fefe00640 1 -- 172.21.15.100:0/272456750 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5ff0012630 con 0x7f5ff815c4b0 2024-08-17T02:46:39.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.221+0000 7f5fefe00640 1 --2- 172.21.15.100:0/272456750 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5fd4065150 0x7f5fd4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.221+0000 7f5fefe00640 1 -- 172.21.15.100:0/272456750 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ff0082820 con 0x7f5ff815c4b0 2024-08-17T02:46:39.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.222+0000 7f5ff7e00640 1 --2- 172.21.15.100:0/272456750 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5fd4065150 0x7f5fd4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.222+0000 7f5ff7e00640 1 --2- 172.21.15.100:0/272456750 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5fd4065150 0x7f5fd4067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8034000 tx=0x7f5fe8037000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:39.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.225+0000 7f5fefe00640 1 -- 172.21.15.100:0/272456750 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5ff0050840 con 0x7f5ff815c4b0 2024-08-17T02:46:39.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.435+0000 7f5ffd800640 1 -- 172.21.15.100:0/272456750 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5ff80d0860 con 0x7f5ff815c4b0 2024-08-17T02:46:39.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.763+0000 7f5fefe00640 1 -- 172.21.15.100:0/272456750 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 136+0+0 (secure 0 0 0) 0x7f5ff0053e60 con 0x7f5ff815c4b0 2024-08-17T02:46:39.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.765+0000 7f5ffd800640 1 -- 172.21.15.100:0/272456750 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5fd4065150 msgr2=0x7f5fd4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.765+0000 7f5ffd800640 1 --2- 172.21.15.100:0/272456750 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5fd4065150 0x7f5fd4067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8034000 tx=0x7f5fe8037000 comp rx=0 tx=0).stop 2024-08-17T02:46:39.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.765+0000 7f5ffd800640 1 -- 172.21.15.100:0/272456750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ff815c4b0 msgr2=0x7f5ff816cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.765+0000 7f5ffd800640 1 --2- 172.21.15.100:0/272456750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ff815c4b0 0x7f5ff816cdd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000d890 tx=0x7f5ff0008040 comp rx=0 tx=0).stop 2024-08-17T02:46:39.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.765+0000 7f5ffd800640 1 -- 172.21.15.100:0/272456750 shutdown_connections 2024-08-17T02:46:39.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.765+0000 7f5ffd800640 1 --2- 172.21.15.100:0/272456750 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5fd4065150 0x7f5fd4067600 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.765+0000 7f5ffd800640 1 --2- 172.21.15.100:0/272456750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ff815c4b0 0x7f5ff816cdd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.765+0000 7f5ffd800640 1 --2- 172.21.15.100:0/272456750 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ff80b5740 0x7f5ff8156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.765+0000 7f5ffd800640 1 --2- 172.21.15.100:0/272456750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ff80b2bb0 0x7f5ff8169050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.765+0000 7f5ffd800640 1 -- 172.21.15.100:0/272456750 >> 172.21.15.100:0/272456750 conn(0x7f5ff80cfbc0 msgr2=0x7f5ff8159470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:39.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.765+0000 7f5ffd800640 1 -- 172.21.15.100:0/272456750 shutdown_connections 2024-08-17T02:46:39.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.765+0000 7f5ffd800640 1 -- 172.21.15.100:0/272456750 wait complete. 2024-08-17T02:46:39.781 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:46:39.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.930+0000 7f91ab200640 1 Processor -- start 2024-08-17T02:46:39.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.930+0000 7f91ab200640 1 -- start start 2024-08-17T02:46:39.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.931+0000 7f91ab200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f91a40aea20 0x7f91a40ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.932+0000 7f91ab200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f91a4155180 0x7f91a40acba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.932+0000 7f91ab200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a40afc10 con 0x7f91a4155600 2024-08-17T02:46:39.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.932+0000 7f91ab200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a40aedf0 con 0x7f91a4155180 2024-08-17T02:46:39.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.932+0000 7f91ab200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a40ae5b0 con 0x7f91a40aea20 2024-08-17T02:46:39.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.932+0000 7f91a3400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f91a4155180 0x7f91a40acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.932+0000 7f91a3400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f91a4155180 0x7f91a40acba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51030/0 (socket says 172.21.15.100:51030) 2024-08-17T02:46:39.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.932+0000 7f91a3400640 1 -- 172.21.15.100:0/3763639082 learned_addr learned my addr 172.21.15.100:0/3763639082 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:39.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.932+0000 7f91a3e00640 1 --2- 172.21.15.100:0/3763639082 >> v2:172.21.15.123:3300/0 conn(0x7f91a40aea20 0x7f91a40ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.932+0000 7f91a3400640 1 -- 172.21.15.100:0/3763639082 >> v2:172.21.15.123:3300/0 conn(0x7f91a40aea20 msgr2=0x7f91a40ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:39.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.932+0000 7f91a3400640 1 --2- 172.21.15.100:0/3763639082 >> v2:172.21.15.123:3300/0 conn(0x7f91a40aea20 0x7f91a40ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.932+0000 7f91a3400640 1 -- 172.21.15.100:0/3763639082 >> v1:172.21.15.100:6789/0 conn(0x7f91a4155600 legacy=0x7f91a40ad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.932+0000 7f91a3400640 1 -- 172.21.15.100:0/3763639082 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a40af000 con 0x7f91a4155180 2024-08-17T02:46:39.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.932+0000 7f91a3e00640 1 --2- 172.21.15.100:0/3763639082 >> v2:172.21.15.123:3300/0 conn(0x7f91a40aea20 0x7f91a40ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:39.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.933+0000 7f91a3400640 1 --2- 172.21.15.100:0/3763639082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a4155180 0x7f91a40acba0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f91a406bc00 tx=0x7f91900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf996fa78692977 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:39.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.934+0000 7f91a2a00640 1 -- 172.21.15.100:0/3763639082 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919002adf0 con 0x7f91a4155180 2024-08-17T02:46:39.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.934+0000 7f91a2a00640 1 -- 172.21.15.100:0/3763639082 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9190032440 con 0x7f91a4155180 2024-08-17T02:46:39.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.934+0000 7f91a2a00640 1 -- 172.21.15.100:0/3763639082 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9190032820 con 0x7f91a4155180 2024-08-17T02:46:39.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.934+0000 7f91ab200640 1 -- 172.21.15.100:0/3763639082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a4155180 msgr2=0x7f91a40acba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.934+0000 7f91ab200640 1 --2- 172.21.15.100:0/3763639082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a4155180 0x7f91a40acba0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f91a406bc00 tx=0x7f91900091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.934+0000 7f91ab200640 1 -- 172.21.15.100:0/3763639082 shutdown_connections 2024-08-17T02:46:39.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.934+0000 7f91ab200640 1 --2- 172.21.15.100:0/3763639082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a4155180 0x7f91a40acba0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.934+0000 7f91ab200640 1 --2- 172.21.15.100:0/3763639082 >> v2:172.21.15.123:3300/0 conn(0x7f91a40aea20 0x7f91a40ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.934+0000 7f91ab200640 1 -- 172.21.15.100:0/3763639082 >> 172.21.15.100:0/3763639082 conn(0x7f91a40cb9b0 msgr2=0x7f91a40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:39.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.934+0000 7f91ab200640 1 -- 172.21.15.100:0/3763639082 shutdown_connections 2024-08-17T02:46:39.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.934+0000 7f91ab200640 1 -- 172.21.15.100:0/3763639082 wait complete. 2024-08-17T02:46:39.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.936+0000 7f91ab200640 1 Processor -- start 2024-08-17T02:46:39.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.936+0000 7f91ab200640 1 -- start start 2024-08-17T02:46:39.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.937+0000 7f91ab200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91a40aea20 0x7f91a40c09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.937+0000 7f91ab200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a4155180 0x7f91a4143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.937+0000 7f91ab200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91a4155600 0x7f91a40aac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.937+0000 7f91ab200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a41561c0 con 0x7f91a4155180 2024-08-17T02:46:39.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.937+0000 7f91ab200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a4158240 con 0x7f91a40aea20 2024-08-17T02:46:39.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.937+0000 7f91ab200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a4157630 con 0x7f91a4155600 2024-08-17T02:46:39.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.937+0000 7f91a3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a4155180 0x7f91a4143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.937+0000 7f91a3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a4155180 0x7f91a4143fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51042/0 (socket says 172.21.15.100:51042) 2024-08-17T02:46:39.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.937+0000 7f91a3400640 1 -- 172.21.15.100:0/4061303528 learned_addr learned my addr 172.21.15.100:0/4061303528 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:39.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.937+0000 7f91a3400640 1 -- 172.21.15.100:0/4061303528 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91a4155600 msgr2=0x7f91a40aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.937+0000 7f91a3400640 1 --2- 172.21.15.100:0/4061303528 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91a4155600 0x7f91a40aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.937+0000 7f91a3400640 1 -- 172.21.15.100:0/4061303528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91a40aea20 msgr2=0x7f91a40c09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.938+0000 7f91a3e00640 1 --2- 172.21.15.100:0/4061303528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91a40aea20 0x7f91a40c09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.938+0000 7f91a3400640 1 --2- 172.21.15.100:0/4061303528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91a40aea20 0x7f91a40c09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.938+0000 7f91a3400640 1 -- 172.21.15.100:0/4061303528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9190009450 con 0x7f91a4155180 2024-08-17T02:46:39.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.938+0000 7f91a3e00640 1 --2- 172.21.15.100:0/4061303528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91a40aea20 0x7f91a40c09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:39.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.938+0000 7f91a3400640 1 --2- 172.21.15.100:0/4061303528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a4155180 0x7f91a4143fc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9190009210 tx=0x7f9190032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:39.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.938+0000 7f919b400640 1 -- 172.21.15.100:0/4061303528 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9190031bb0 con 0x7f91a4155180 2024-08-17T02:46:39.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.938+0000 7f919b400640 1 -- 172.21.15.100:0/4061303528 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9190031d30 con 0x7f91a4155180 2024-08-17T02:46:39.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.938+0000 7f919b400640 1 -- 172.21.15.100:0/4061303528 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9190031ea0 con 0x7f91a4155180 2024-08-17T02:46:39.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.938+0000 7f91ab200640 1 -- 172.21.15.100:0/4061303528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a4157910 con 0x7f91a4155180 2024-08-17T02:46:39.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.938+0000 7f91ab200640 1 -- 172.21.15.100:0/4061303528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a4157ed0 con 0x7f91a4155180 2024-08-17T02:46:39.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.939+0000 7f91ab200640 1 -- 172.21.15.100:0/4061303528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a4064db0 con 0x7f91a4155180 2024-08-17T02:46:39.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.940+0000 7f919b400640 1 -- 172.21.15.100:0/4061303528 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9190039040 con 0x7f91a4155180 2024-08-17T02:46:39.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.941+0000 7f919b400640 1 --2- 172.21.15.100:0/4061303528 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9184065150 0x7f9184067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.941+0000 7f919b400640 1 -- 172.21.15.100:0/4061303528 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91900a2340 con 0x7f91a4155180 2024-08-17T02:46:39.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.941+0000 7f91a3e00640 1 --2- 172.21.15.100:0/4061303528 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9184065150 0x7f9184067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.942+0000 7f91a3e00640 1 --2- 172.21.15.100:0/4061303528 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9184065150 0x7f9184067600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9194008a80 tx=0x7f9194008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:39.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:39.945+0000 7f919b400640 1 -- 172.21.15.100:0/4061303528 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9190070360 con 0x7f91a4155180 2024-08-17T02:46:40.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.139+0000 7f91ab200640 1 -- 172.21.15.100:0/4061303528 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f91a4158380 con 0x7f9184065150 2024-08-17T02:46:40.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.141+0000 7f919b400640 1 -- 172.21.15.100:0/4061303528 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f91a4158380 con 0x7f9184065150 2024-08-17T02:46:40.141 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-08-17T02:46:40.141 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:40.142 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephfs" 2024-08-17T02:46:40.142 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:40.142 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-08-17T02:46:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.143+0000 7f91ab200640 1 -- 172.21.15.100:0/4061303528 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9184065150 msgr2=0x7f9184067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.143+0000 7f91ab200640 1 --2- 172.21.15.100:0/4061303528 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9184065150 0x7f9184067600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9194008a80 tx=0x7f9194008040 comp rx=0 tx=0).stop 2024-08-17T02:46:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.143+0000 7f91ab200640 1 -- 172.21.15.100:0/4061303528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a4155180 msgr2=0x7f91a4143fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.143+0000 7f91ab200640 1 --2- 172.21.15.100:0/4061303528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a4155180 0x7f91a4143fc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9190009210 tx=0x7f9190032000 comp rx=0 tx=0).stop 2024-08-17T02:46:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.143+0000 7f91ab200640 1 -- 172.21.15.100:0/4061303528 shutdown_connections 2024-08-17T02:46:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.143+0000 7f91ab200640 1 --2- 172.21.15.100:0/4061303528 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9184065150 0x7f9184067600 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.143+0000 7f91ab200640 1 --2- 172.21.15.100:0/4061303528 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91a4155600 0x7f91a40aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.143+0000 7f91ab200640 1 --2- 172.21.15.100:0/4061303528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a4155180 0x7f91a4143fc0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.143+0000 7f91ab200640 1 --2- 172.21.15.100:0/4061303528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91a40aea20 0x7f91a40c09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.143+0000 7f91ab200640 1 -- 172.21.15.100:0/4061303528 >> 172.21.15.100:0/4061303528 conn(0x7f91a40cb9b0 msgr2=0x7f91a406e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.143+0000 7f91ab200640 1 -- 172.21.15.100:0/4061303528 shutdown_connections 2024-08-17T02:46:40.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.143+0000 7f91ab200640 1 -- 172.21.15.100:0/4061303528 wait complete. 2024-08-17T02:46:40.159 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:46:40.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.309+0000 7f09a8c00640 1 Processor -- start 2024-08-17T02:46:40.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.309+0000 7f09a8c00640 1 -- start start 2024-08-17T02:46:40.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.310+0000 7f09a8c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f09a4155a80 0x7f09a406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.310+0000 7f09a8c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f09a40c7db0 0x7f09a40c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.310+0000 7f09a8c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a41598f0 con 0x7f09a4155e50 2024-08-17T02:46:40.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.310+0000 7f09a8c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a4159bd0 con 0x7f09a4155a80 2024-08-17T02:46:40.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.310+0000 7f09a8c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a4159eb0 con 0x7f09a40c7db0 2024-08-17T02:46:40.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.311+0000 7f09a1400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f09a40c7db0 0x7f09a40c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.311+0000 7f09a1400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f09a40c7db0 0x7f09a40c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:43968/0 (socket says 172.21.15.100:43968) 2024-08-17T02:46:40.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.311+0000 7f09a1400640 1 -- 172.21.15.100:0/2897990732 learned_addr learned my addr 172.21.15.100:0/2897990732 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:40.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.311+0000 7f09a1e00640 1 --2- 172.21.15.100:0/2897990732 >> v2:172.21.15.123:3300/0 conn(0x7f09a4155a80 0x7f09a406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.311+0000 7f09a1400640 1 -- 172.21.15.100:0/2897990732 >> v2:172.21.15.123:3300/0 conn(0x7f09a4155a80 msgr2=0x7f09a406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:40.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.311+0000 7f09a1400640 1 --2- 172.21.15.100:0/2897990732 >> v2:172.21.15.123:3300/0 conn(0x7f09a4155a80 0x7f09a406dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.311+0000 7f09a0a00640 1 -- 172.21.15.100:0/2897990732 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608031041 0 0) 0x7f09a41598f0 con 0x7f09a4155e50 2024-08-17T02:46:40.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.311+0000 7f09a1400640 1 -- 172.21.15.100:0/2897990732 >> v1:172.21.15.123:6789/0 conn(0x7f09a4155e50 legacy=0x7f09a406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.311+0000 7f09a1400640 1 -- 172.21.15.100:0/2897990732 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a415a190 con 0x7f09a40c7db0 2024-08-17T02:46:40.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.312+0000 7f09a1400640 1 --2- 172.21.15.100:0/2897990732 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f09a40c7db0 0x7f09a40c8bd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0990009910 tx=0x7f09900091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=959ad72c7ae05d5d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:40.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.313+0000 7f09a0a00640 1 -- 172.21.15.100:0/2897990732 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099002ae40 con 0x7f09a40c7db0 2024-08-17T02:46:40.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.313+0000 7f09a0a00640 1 -- 172.21.15.100:0/2897990732 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0990032440 con 0x7f09a40c7db0 2024-08-17T02:46:40.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.313+0000 7f09a0a00640 1 -- 172.21.15.100:0/2897990732 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09900327e0 con 0x7f09a40c7db0 2024-08-17T02:46:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.313+0000 7f09a8c00640 1 -- 172.21.15.100:0/2897990732 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f09a40c7db0 msgr2=0x7f09a40c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.313+0000 7f09a8c00640 1 --2- 172.21.15.100:0/2897990732 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f09a40c7db0 0x7f09a40c8bd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0990009910 tx=0x7f09900091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.313+0000 7f09a8c00640 1 -- 172.21.15.100:0/2897990732 shutdown_connections 2024-08-17T02:46:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.313+0000 7f09a8c00640 1 --2- 172.21.15.100:0/2897990732 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f09a40c7db0 0x7f09a40c8bd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.313+0000 7f09a8c00640 1 --2- 172.21.15.100:0/2897990732 >> v2:172.21.15.123:3300/0 conn(0x7f09a4155a80 0x7f09a406dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.313+0000 7f09a8c00640 1 -- 172.21.15.100:0/2897990732 >> 172.21.15.100:0/2897990732 conn(0x7f09a4067750 msgr2=0x7f09a40c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.314+0000 7f09a8c00640 1 -- 172.21.15.100:0/2897990732 shutdown_connections 2024-08-17T02:46:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.314+0000 7f09a8c00640 1 -- 172.21.15.100:0/2897990732 wait complete. 2024-08-17T02:46:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.315+0000 7f09a8c00640 1 Processor -- start 2024-08-17T02:46:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.315+0000 7f09a8c00640 1 -- start start 2024-08-17T02:46:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.316+0000 7f09a8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09a40c7db0 0x7f09a41530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.316+0000 7f09a8c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09a4155a80 0x7f09a414fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.316+0000 7f09a8c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f09a4155e50 0x7f09a40a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.316+0000 7f09a8c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a4156be0 con 0x7f09a40c7db0 2024-08-17T02:46:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.316+0000 7f09a8c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a4156340 con 0x7f09a4155a80 2024-08-17T02:46:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.316+0000 7f09a8c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a41535e0 con 0x7f09a4155e50 2024-08-17T02:46:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.316+0000 7f09a1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09a40c7db0 0x7f09a41530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.316+0000 7f09a1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09a40c7db0 0x7f09a41530a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51048/0 (socket says 172.21.15.100:51048) 2024-08-17T02:46:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.316+0000 7f09a1e00640 1 -- 172.21.15.100:0/1016340562 learned_addr learned my addr 172.21.15.100:0/1016340562 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.316+0000 7f09a1400640 1 --2- 172.21.15.100:0/1016340562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09a4155a80 0x7f09a414fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.317+0000 7f09a2800640 1 --2- 172.21.15.100:0/1016340562 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f09a4155e50 0x7f09a40a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.317+0000 7f09a1e00640 1 -- 172.21.15.100:0/1016340562 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f09a4155e50 msgr2=0x7f09a40a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.317+0000 7f09a1e00640 1 --2- 172.21.15.100:0/1016340562 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f09a4155e50 0x7f09a40a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.317+0000 7f09a1e00640 1 -- 172.21.15.100:0/1016340562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09a4155a80 msgr2=0x7f09a414fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.317+0000 7f09a1e00640 1 --2- 172.21.15.100:0/1016340562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09a4155a80 0x7f09a414fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.317+0000 7f09a1e00640 1 -- 172.21.15.100:0/1016340562 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0990009450 con 0x7f09a40c7db0 2024-08-17T02:46:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.317+0000 7f09a1e00640 1 --2- 172.21.15.100:0/1016340562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09a40c7db0 0x7f09a41530a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f099400ea50 tx=0x7f09940090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.317+0000 7f0999600640 1 -- 172.21.15.100:0/1016340562 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099400c9b0 con 0x7f09a40c7db0 2024-08-17T02:46:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.317+0000 7f0999600640 1 -- 172.21.15.100:0/1016340562 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099400cb10 con 0x7f09a40c7db0 2024-08-17T02:46:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.317+0000 7f09a8c00640 1 -- 172.21.15.100:0/1016340562 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a40c75d0 con 0x7f09a40c7db0 2024-08-17T02:46:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.317+0000 7f0999600640 1 -- 172.21.15.100:0/1016340562 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099400ce90 con 0x7f09a40c7db0 2024-08-17T02:46:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.318+0000 7f09a8c00640 1 -- 172.21.15.100:0/1016340562 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a4156870 con 0x7f09a40c7db0 2024-08-17T02:46:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.319+0000 7f09a8c00640 1 -- 172.21.15.100:0/1016340562 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a4168d00 con 0x7f09a40c7db0 2024-08-17T02:46:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.319+0000 7f0999600640 1 -- 172.21.15.100:0/1016340562 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0994013680 con 0x7f09a40c7db0 2024-08-17T02:46:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.320+0000 7f0999600640 1 --2- 172.21.15.100:0/1016340562 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0984065150 0x7f0984067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.320+0000 7f0999600640 1 -- 172.21.15.100:0/1016340562 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0994082700 con 0x7f09a40c7db0 2024-08-17T02:46:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.320+0000 7f09a1400640 1 --2- 172.21.15.100:0/1016340562 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0984065150 0x7f0984067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.321+0000 7f09a1400640 1 --2- 172.21.15.100:0/1016340562 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0984065150 0x7f0984067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0990034000 tx=0x7f0990032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:40.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.324+0000 7f0999600640 1 -- 172.21.15.100:0/1016340562 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0994050930 con 0x7f09a40c7db0 2024-08-17T02:46:40.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.493+0000 7f09a8c00640 1 -- 172.21.15.100:0/1016340562 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f09a4071050 con 0x7f09a40c7db0 2024-08-17T02:46:40.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.494+0000 7f0999600640 1 -- 172.21.15.100:0/1016340562 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0994053f50 con 0x7f09a40c7db0 2024-08-17T02:46:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.496+0000 7f09a8c00640 1 -- 172.21.15.100:0/1016340562 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0984065150 msgr2=0x7f0984067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.496+0000 7f09a8c00640 1 --2- 172.21.15.100:0/1016340562 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0984065150 0x7f0984067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0990034000 tx=0x7f0990032000 comp rx=0 tx=0).stop 2024-08-17T02:46:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.496+0000 7f09a8c00640 1 -- 172.21.15.100:0/1016340562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09a40c7db0 msgr2=0x7f09a41530a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.496+0000 7f09a8c00640 1 --2- 172.21.15.100:0/1016340562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09a40c7db0 0x7f09a41530a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f099400ea50 tx=0x7f09940090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.496+0000 7f09a8c00640 1 -- 172.21.15.100:0/1016340562 shutdown_connections 2024-08-17T02:46:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.496+0000 7f09a8c00640 1 --2- 172.21.15.100:0/1016340562 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0984065150 0x7f0984067600 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.496+0000 7f09a8c00640 1 --2- 172.21.15.100:0/1016340562 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f09a4155e50 0x7f09a40a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.496+0000 7f09a8c00640 1 --2- 172.21.15.100:0/1016340562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09a4155a80 0x7f09a414fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.496+0000 7f09a8c00640 1 --2- 172.21.15.100:0/1016340562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09a40c7db0 0x7f09a41530a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.496+0000 7f09a8c00640 1 -- 172.21.15.100:0/1016340562 >> 172.21.15.100:0/1016340562 conn(0x7f09a4067750 msgr2=0x7f09a40c98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:40.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.496+0000 7f09a8c00640 1 -- 172.21.15.100:0/1016340562 shutdown_connections 2024-08-17T02:46:40.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.496+0000 7f09a8c00640 1 -- 172.21.15.100:0/1016340562 wait complete. 2024-08-17T02:46:40.512 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000001028572 2024-08-17T02:46:40.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.662+0000 7ff582a00640 1 Processor -- start 2024-08-17T02:46:40.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.662+0000 7ff582a00640 1 -- start start 2024-08-17T02:46:40.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.663+0000 7ff582a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff57c155980 0x7ff57c156f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.663+0000 7ff582a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff57c0af580 0x7ff57c0afa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.663+0000 7ff582a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff57c158400 con 0x7ff57c0a54d0 2024-08-17T02:46:40.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.663+0000 7ff582a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff57c0aff40 con 0x7ff57c155980 2024-08-17T02:46:40.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.663+0000 7ff582a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c1577f0 con 0x7ff57c0af580 2024-08-17T02:46:40.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.663+0000 7ff580a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff57c0af580 0x7ff57c0afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.663+0000 7ff580a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff57c0af580 0x7ff57c0afa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:43988/0 (socket says 172.21.15.100:43988) 2024-08-17T02:46:40.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.663+0000 7ff580a00640 1 -- 172.21.15.100:0/3922191713 learned_addr learned my addr 172.21.15.100:0/3922191713 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:40.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.663+0000 7ff57be00640 1 --2- 172.21.15.100:0/3922191713 >> v2:172.21.15.123:3300/0 conn(0x7ff57c155980 0x7ff57c156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.664+0000 7ff580a00640 1 -- 172.21.15.100:0/3922191713 >> v2:172.21.15.123:3300/0 conn(0x7ff57c155980 msgr2=0x7ff57c156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:40.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.664+0000 7ff580a00640 1 --2- 172.21.15.100:0/3922191713 >> v2:172.21.15.123:3300/0 conn(0x7ff57c155980 0x7ff57c156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.664+0000 7ff580a00640 1 -- 172.21.15.100:0/3922191713 >> v1:172.21.15.123:6789/0 conn(0x7ff57c0a54d0 legacy=0x7ff57c155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.664+0000 7ff580a00640 1 -- 172.21.15.100:0/3922191713 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c157ad0 con 0x7ff57c0af580 2024-08-17T02:46:40.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.664+0000 7ff57be00640 1 --2- 172.21.15.100:0/3922191713 >> v2:172.21.15.123:3300/0 conn(0x7ff57c155980 0x7ff57c156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:40.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.665+0000 7ff580a00640 1 --2- 172.21.15.100:0/3922191713 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff57c0af580 0x7ff57c0afa00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff574009f20 tx=0x7ff574009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62be3710e12b09cc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:40.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.665+0000 7ff57b400640 1 -- 172.21.15.100:0/3922191713 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff574031400 con 0x7ff57c0af580 2024-08-17T02:46:40.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.665+0000 7ff57b400640 1 -- 172.21.15.100:0/3922191713 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57402d050 con 0x7ff57c0af580 2024-08-17T02:46:40.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.665+0000 7ff57b400640 1 -- 172.21.15.100:0/3922191713 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5740317d0 con 0x7ff57c0af580 2024-08-17T02:46:40.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.666+0000 7ff582a00640 1 -- 172.21.15.100:0/3922191713 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff57c0af580 msgr2=0x7ff57c0afa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.666+0000 7ff582a00640 1 --2- 172.21.15.100:0/3922191713 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff57c0af580 0x7ff57c0afa00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff574009f20 tx=0x7ff574009840 comp rx=0 tx=0).stop 2024-08-17T02:46:40.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.666+0000 7ff582a00640 1 -- 172.21.15.100:0/3922191713 shutdown_connections 2024-08-17T02:46:40.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.666+0000 7ff582a00640 1 --2- 172.21.15.100:0/3922191713 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff57c0af580 0x7ff57c0afa00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.666+0000 7ff582a00640 1 --2- 172.21.15.100:0/3922191713 >> v2:172.21.15.123:3300/0 conn(0x7ff57c155980 0x7ff57c156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.666+0000 7ff582a00640 1 -- 172.21.15.100:0/3922191713 >> 172.21.15.100:0/3922191713 conn(0x7ff57c067750 msgr2=0x7ff57c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:40.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.666+0000 7ff582a00640 1 -- 172.21.15.100:0/3922191713 shutdown_connections 2024-08-17T02:46:40.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.666+0000 7ff582a00640 1 -- 172.21.15.100:0/3922191713 wait complete. 2024-08-17T02:46:40.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.668+0000 7ff582a00640 1 Processor -- start 2024-08-17T02:46:40.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.668+0000 7ff582a00640 1 -- start start 2024-08-17T02:46:40.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.669+0000 7ff582a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff57c0a54d0 0x7ff57c1301c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.669+0000 7ff582a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff57c0af580 0x7ff57c147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.669+0000 7ff582a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff57c155980 0x7ff57c1478a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.669+0000 7ff582a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c149800 con 0x7ff57c0af580 2024-08-17T02:46:40.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.669+0000 7ff582a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c149ae0 con 0x7ff57c155980 2024-08-17T02:46:40.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.669+0000 7ff582a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c149dc0 con 0x7ff57c0a54d0 2024-08-17T02:46:40.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.669+0000 7ff573400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff57c0af580 0x7ff57c147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.669+0000 7ff573400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff57c0af580 0x7ff57c147090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51056/0 (socket says 172.21.15.100:51056) 2024-08-17T02:46:40.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.669+0000 7ff573400640 1 -- 172.21.15.100:0/3699721418 learned_addr learned my addr 172.21.15.100:0/3699721418 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:40.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.669+0000 7ff57be00640 1 --2- 172.21.15.100:0/3699721418 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff57c0a54d0 0x7ff57c1301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.669+0000 7ff580a00640 1 --2- 172.21.15.100:0/3699721418 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff57c155980 0x7ff57c1478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.669+0000 7ff573400640 1 -- 172.21.15.100:0/3699721418 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff57c0a54d0 msgr2=0x7ff57c1301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.669+0000 7ff573400640 1 --2- 172.21.15.100:0/3699721418 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff57c0a54d0 0x7ff57c1301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.669+0000 7ff573400640 1 -- 172.21.15.100:0/3699721418 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff57c155980 msgr2=0x7ff57c1478a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.669+0000 7ff573400640 1 --2- 172.21.15.100:0/3699721418 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff57c155980 0x7ff57c1478a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.669+0000 7ff573400640 1 -- 172.21.15.100:0/3699721418 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c009390 con 0x7ff57c0af580 2024-08-17T02:46:40.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.669+0000 7ff57be00640 1 --2- 172.21.15.100:0/3699721418 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff57c0a54d0 0x7ff57c1301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:40.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.670+0000 7ff573400640 1 --2- 172.21.15.100:0/3699721418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff57c0af580 0x7ff57c147090 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff56400c560 tx=0x7ff564007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:40.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.670+0000 7ff573e00640 1 -- 172.21.15.100:0/3699721418 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564011590 con 0x7ff57c0af580 2024-08-17T02:46:40.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.670+0000 7ff573e00640 1 -- 172.21.15.100:0/3699721418 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff564011710 con 0x7ff57c0af580 2024-08-17T02:46:40.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.670+0000 7ff582a00640 1 -- 172.21.15.100:0/3699721418 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff574009ae0 con 0x7ff57c0af580 2024-08-17T02:46:40.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.670+0000 7ff573e00640 1 -- 172.21.15.100:0/3699721418 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564011ad0 con 0x7ff57c0af580 2024-08-17T02:46:40.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.670+0000 7ff582a00640 1 -- 172.21.15.100:0/3699721418 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57c14a380 con 0x7ff57c0af580 2024-08-17T02:46:40.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.671+0000 7ff582a00640 1 -- 172.21.15.100:0/3699721418 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff57c14a570 con 0x7ff57c0af580 2024-08-17T02:46:40.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.672+0000 7ff573e00640 1 -- 172.21.15.100:0/3699721418 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff56401b3b0 con 0x7ff57c0af580 2024-08-17T02:46:40.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.673+0000 7ff573e00640 1 --2- 172.21.15.100:0/3699721418 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff558065180 0x7ff558067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.673+0000 7ff573e00640 1 -- 172.21.15.100:0/3699721418 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff564081a30 con 0x7ff57c0af580 2024-08-17T02:46:40.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.673+0000 7ff57be00640 1 --2- 172.21.15.100:0/3699721418 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff558065180 0x7ff558067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.674+0000 7ff57be00640 1 --2- 172.21.15.100:0/3699721418 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff558065180 0x7ff558067630 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009360 tx=0x7ff56c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:40.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.677+0000 7ff573e00640 1 -- 172.21.15.100:0/3699721418 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff56404fad0 con 0x7ff57c0af580 2024-08-17T02:46:40.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:40.873+0000 7ff582a00640 1 -- 172.21.15.100:0/3699721418 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000001028572", "target": ["mon-mgr", ""]}) v1 -- 0x7ff57c149c50 con 0x7ff558065180 2024-08-17T02:46:43.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.794+0000 7ff573e00640 1 -- 172.21.15.100:0/3699721418 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7ff57c149c50 con 0x7ff558065180 2024-08-17T02:46:43.795 INFO:teuthology.orchestra.run.smithi100.stderr:Volume created successfully (no MDS daemons created) 2024-08-17T02:46:43.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.797+0000 7ff582a00640 1 -- 172.21.15.100:0/3699721418 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff558065180 msgr2=0x7ff558067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.797+0000 7ff582a00640 1 --2- 172.21.15.100:0/3699721418 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff558065180 0x7ff558067630 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009360 tx=0x7ff56c008040 comp rx=0 tx=0).stop 2024-08-17T02:46:43.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.797+0000 7ff582a00640 1 -- 172.21.15.100:0/3699721418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff57c0af580 msgr2=0x7ff57c147090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.797+0000 7ff582a00640 1 --2- 172.21.15.100:0/3699721418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff57c0af580 0x7ff57c147090 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff56400c560 tx=0x7ff564007ef0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.797+0000 7ff582a00640 1 -- 172.21.15.100:0/3699721418 shutdown_connections 2024-08-17T02:46:43.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.797+0000 7ff582a00640 1 --2- 172.21.15.100:0/3699721418 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff558065180 0x7ff558067630 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.797+0000 7ff582a00640 1 --2- 172.21.15.100:0/3699721418 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff57c155980 0x7ff57c1478a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.797+0000 7ff582a00640 1 --2- 172.21.15.100:0/3699721418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff57c0af580 0x7ff57c147090 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.797+0000 7ff582a00640 1 --2- 172.21.15.100:0/3699721418 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff57c0a54d0 0x7ff57c1301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.797+0000 7ff582a00640 1 -- 172.21.15.100:0/3699721418 >> 172.21.15.100:0/3699721418 conn(0x7ff57c067750 msgr2=0x7ff57c06da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:43.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.797+0000 7ff582a00640 1 -- 172.21.15.100:0/3699721418 shutdown_connections 2024-08-17T02:46:43.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.797+0000 7ff582a00640 1 -- 172.21.15.100:0/3699721418 wait complete. 2024-08-17T02:46:43.825 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:46:43.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.978+0000 7f3e51400640 1 Processor -- start 2024-08-17T02:46:43.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.978+0000 7f3e51400640 1 -- start start 2024-08-17T02:46:43.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.979+0000 7f3e51400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3e4c0b1440 0x7f3e4c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.979+0000 7f3e51400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4c0caa80 con 0x7f3e4c1401b0 2024-08-17T02:46:43.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.980+0000 7f3e51400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4c0c9e70 con 0x7f3e4c140580 2024-08-17T02:46:43.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.980+0000 7f3e51400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c0cb450 con 0x7f3e4c0b1440 2024-08-17T02:46:43.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.980+0000 7f3e4a800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3e4c1401b0 0x7f3e4c0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57006/0 (socket says 172.21.15.100:57006) 2024-08-17T02:46:43.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.980+0000 7f3e4a800640 1 -- 172.21.15.100:0/979533095 learned_addr learned my addr 172.21.15.100:0/979533095 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:43.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.980+0000 7f3e41e00640 1 --2- 172.21.15.100:0/979533095 >> v2:172.21.15.123:3300/0 conn(0x7f3e4c0b1440 0x7f3e4c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.980+0000 7f3e49e00640 1 -- 172.21.15.100:0/979533095 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814709589 0 0) 0x7f3e4c0caa80 con 0x7f3e4c1401b0 2024-08-17T02:46:43.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.980+0000 7f3e49e00640 1 -- 172.21.15.100:0/979533095 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e300034e0 con 0x7f3e4c1401b0 2024-08-17T02:46:43.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.980+0000 7f3e49e00640 1 -- 172.21.15.100:0/979533095 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229683264 0 0) 0x7f3e4c0c9e70 con 0x7f3e4c140580 2024-08-17T02:46:43.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.980+0000 7f3e49e00640 1 -- 172.21.15.100:0/979533095 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e4c0caa80 con 0x7f3e4c140580 2024-08-17T02:46:43.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.981+0000 7f3e41e00640 1 -- 172.21.15.100:0/979533095 >> v1:172.21.15.123:6789/0 conn(0x7f3e4c140580 legacy=0x7f3e4c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.981+0000 7f3e41e00640 1 -- 172.21.15.100:0/979533095 >> v1:172.21.15.100:6789/0 conn(0x7f3e4c1401b0 legacy=0x7f3e4c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.981+0000 7f3e49e00640 1 -- 172.21.15.100:0/979533095 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 791495392 0 0) 0x7f3e300034e0 con 0x7f3e4c1401b0 2024-08-17T02:46:43.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.981+0000 7f3e41e00640 1 -- 172.21.15.100:0/979533095 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c0ca150 con 0x7f3e4c0b1440 2024-08-17T02:46:43.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.982+0000 7f3e41e00640 1 --2- 172.21.15.100:0/979533095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e4c0b1440 0x7f3e4c0caf10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009e60 tx=0x7f3e34009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b193d9d1fd5809b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:43.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.982+0000 7f3e49e00640 1 -- 172.21.15.100:0/979533095 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c001470 con 0x7f3e4c0b1440 2024-08-17T02:46:43.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.982+0000 7f3e49e00640 1 -- 172.21.15.100:0/979533095 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3402d050 con 0x7f3e4c0b1440 2024-08-17T02:46:43.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.982+0000 7f3e49e00640 1 -- 172.21.15.100:0/979533095 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34031630 con 0x7f3e4c0b1440 2024-08-17T02:46:43.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.982+0000 7f3e51400640 1 -- 172.21.15.100:0/979533095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e4c0b1440 msgr2=0x7f3e4c0caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.982+0000 7f3e51400640 1 --2- 172.21.15.100:0/979533095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e4c0b1440 0x7f3e4c0caf10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009e60 tx=0x7f3e34009780 comp rx=0 tx=0).stop 2024-08-17T02:46:43.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.982+0000 7f3e51400640 1 -- 172.21.15.100:0/979533095 shutdown_connections 2024-08-17T02:46:43.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.982+0000 7f3e51400640 1 --2- 172.21.15.100:0/979533095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e4c0b1440 0x7f3e4c0caf10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.983+0000 7f3e51400640 1 -- 172.21.15.100:0/979533095 >> 172.21.15.100:0/979533095 conn(0x7f3e4c0cb9b0 msgr2=0x7f3e4c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:43.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.983+0000 7f3e51400640 1 -- 172.21.15.100:0/979533095 shutdown_connections 2024-08-17T02:46:43.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.983+0000 7f3e51400640 1 -- 172.21.15.100:0/979533095 wait complete. 2024-08-17T02:46:43.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.984+0000 7f3e51400640 1 Processor -- start 2024-08-17T02:46:43.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.984+0000 7f3e51400640 1 -- start start 2024-08-17T02:46:43.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.985+0000 7f3e51400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e4c0b1440 0x7f3e4c0ad390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.985+0000 7f3e51400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e4c1401b0 0x7f3e4c168e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.985+0000 7f3e51400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3e4c140580 0x7f3e4c1693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.985+0000 7f3e51400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0a71b0 con 0x7f3e4c0b1440 2024-08-17T02:46:43.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.985+0000 7f3e51400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0ad8d0 con 0x7f3e4c1401b0 2024-08-17T02:46:43.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.985+0000 7f3e51400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c169a50 con 0x7f3e4c140580 2024-08-17T02:46:43.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.985+0000 7f3e4a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e4c0b1440 0x7f3e4c0ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.985+0000 7f3e4a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e4c0b1440 0x7f3e4c0ad390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51062/0 (socket says 172.21.15.100:51062) 2024-08-17T02:46:43.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.985+0000 7f3e4a800640 1 -- 172.21.15.100:0/2822955646 learned_addr learned my addr 172.21.15.100:0/2822955646 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:43.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.985+0000 7f3e41e00640 1 --2- 172.21.15.100:0/2822955646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e4c1401b0 0x7f3e4c168e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.985+0000 7f3e4b200640 1 --2- 172.21.15.100:0/2822955646 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3e4c140580 0x7f3e4c1693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.986+0000 7f3e4a800640 1 -- 172.21.15.100:0/2822955646 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3e4c140580 msgr2=0x7f3e4c1693b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.986+0000 7f3e4a800640 1 --2- 172.21.15.100:0/2822955646 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3e4c140580 0x7f3e4c1693b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.986+0000 7f3e4a800640 1 -- 172.21.15.100:0/2822955646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e4c1401b0 msgr2=0x7f3e4c168e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.986+0000 7f3e4a800640 1 --2- 172.21.15.100:0/2822955646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e4c1401b0 0x7f3e4c168e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.986+0000 7f3e4a800640 1 -- 172.21.15.100:0/2822955646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e34009a20 con 0x7f3e4c0b1440 2024-08-17T02:46:43.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.986+0000 7f3e4a800640 1 --2- 172.21.15.100:0/2822955646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e4c0b1440 0x7f3e4c0ad390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00c990 tx=0x7f3e3c001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:43.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.986+0000 7f3e42a00640 1 -- 172.21.15.100:0/2822955646 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c007360 con 0x7f3e4c0b1440 2024-08-17T02:46:43.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.986+0000 7f3e42a00640 1 -- 172.21.15.100:0/2822955646 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3c0074e0 con 0x7f3e4c0b1440 2024-08-17T02:46:43.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.986+0000 7f3e42a00640 1 -- 172.21.15.100:0/2822955646 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c0049f0 con 0x7f3e4c0b1440 2024-08-17T02:46:43.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.986+0000 7f3e51400640 1 -- 172.21.15.100:0/2822955646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4c169d30 con 0x7f3e4c0b1440 2024-08-17T02:46:43.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.986+0000 7f3e51400640 1 -- 172.21.15.100:0/2822955646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4c0a6e40 con 0x7f3e4c0b1440 2024-08-17T02:46:43.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.988+0000 7f3e51400640 1 -- 172.21.15.100:0/2822955646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4c064db0 con 0x7f3e4c0b1440 2024-08-17T02:46:43.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.988+0000 7f3e42a00640 1 -- 172.21.15.100:0/2822955646 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3e3c00a640 con 0x7f3e4c0b1440 2024-08-17T02:46:43.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.989+0000 7f3e42a00640 1 --2- 172.21.15.100:0/2822955646 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3e28065150 0x7f3e28067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.989+0000 7f3e42a00640 1 -- 172.21.15.100:0/2822955646 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f3e3c081be0 con 0x7f3e4c0b1440 2024-08-17T02:46:43.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.989+0000 7f3e41e00640 1 --2- 172.21.15.100:0/2822955646 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3e28065150 0x7f3e28067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.990+0000 7f3e41e00640 1 --2- 172.21.15.100:0/2822955646 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3e28065150 0x7f3e28067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3e34034000 tx=0x7f3e34037000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:43.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:43.994+0000 7f3e42a00640 1 -- 172.21.15.100:0/2822955646 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3e3c04fa50 con 0x7f3e4c0b1440 2024-08-17T02:46:44.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.191+0000 7f3e51400640 1 -- 172.21.15.100:0/2822955646 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e4c06de50 con 0x7f3e28065150 2024-08-17T02:46:44.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.192+0000 7f3e42a00640 1 -- 172.21.15.100:0/2822955646 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7f3e4c06de50 con 0x7f3e28065150 2024-08-17T02:46:44.193 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-08-17T02:46:44.193 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:44.193 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephfs" 2024-08-17T02:46:44.193 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-08-17T02:46:44.193 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-08-17T02:46:44.193 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "volume_0000000001028572" 2024-08-17T02:46:44.193 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-08-17T02:46:44.193 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-08-17T02:46:44.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.195+0000 7f3e51400640 1 -- 172.21.15.100:0/2822955646 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3e28065150 msgr2=0x7f3e28067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.195+0000 7f3e51400640 1 --2- 172.21.15.100:0/2822955646 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3e28065150 0x7f3e28067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3e34034000 tx=0x7f3e34037000 comp rx=0 tx=0).stop 2024-08-17T02:46:44.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.195+0000 7f3e51400640 1 -- 172.21.15.100:0/2822955646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e4c0b1440 msgr2=0x7f3e4c0ad390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.195+0000 7f3e51400640 1 --2- 172.21.15.100:0/2822955646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e4c0b1440 0x7f3e4c0ad390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00c990 tx=0x7f3e3c001ba0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.195+0000 7f3e51400640 1 -- 172.21.15.100:0/2822955646 shutdown_connections 2024-08-17T02:46:44.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.195+0000 7f3e51400640 1 --2- 172.21.15.100:0/2822955646 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3e28065150 0x7f3e28067600 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.195+0000 7f3e51400640 1 --2- 172.21.15.100:0/2822955646 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3e4c140580 0x7f3e4c1693b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.195+0000 7f3e51400640 1 --2- 172.21.15.100:0/2822955646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e4c1401b0 0x7f3e4c168e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.195+0000 7f3e51400640 1 --2- 172.21.15.100:0/2822955646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e4c0b1440 0x7f3e4c0ad390 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.195+0000 7f3e51400640 1 -- 172.21.15.100:0/2822955646 >> 172.21.15.100:0/2822955646 conn(0x7f3e4c0cb9b0 msgr2=0x7f3e4c0afa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:44.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.195+0000 7f3e51400640 1 -- 172.21.15.100:0/2822955646 shutdown_connections 2024-08-17T02:46:44.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.195+0000 7f3e51400640 1 -- 172.21.15.100:0/2822955646 wait complete. 2024-08-17T02:46:44.211 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-17T02:46:44.224 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:46:44.260 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:46:44.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.365+0000 7f7b17200640 1 Processor -- start 2024-08-17T02:46:44.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.365+0000 7f7b17200640 1 -- start start 2024-08-17T02:46:44.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.366+0000 7f7b17200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7b1815c310 0x7f7b1815d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.366+0000 7f7b17200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b180b0af0 con 0x7f7b180af7d0 2024-08-17T02:46:44.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.366+0000 7f7b17200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b180a9b80 con 0x7f7b1815bf40 2024-08-17T02:46:44.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.366+0000 7f7b17200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1815d6e0 con 0x7f7b1815c310 2024-08-17T02:46:44.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.366+0000 7f7b0d400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7b1815c310 0x7f7b1815d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.366+0000 7f7b0d400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7b1815c310 0x7f7b1815d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51064/0 (socket says 172.21.15.100:51064) 2024-08-17T02:46:44.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.366+0000 7f7b0d400640 1 -- 172.21.15.100:0/657632702 learned_addr learned my addr 172.21.15.100:0/657632702 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:44.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.367+0000 7f7b0d400640 1 -- 172.21.15.100:0/657632702 >> v1:172.21.15.123:6789/0 conn(0x7f7b1815bf40 legacy=0x7f7b18159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.367+0000 7f7b0d400640 1 -- 172.21.15.100:0/657632702 >> v1:172.21.15.100:6789/0 conn(0x7f7b180af7d0 legacy=0x7f7b18066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.367+0000 7f7b0d400640 1 -- 172.21.15.100:0/657632702 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b180afcd0 con 0x7f7b1815c310 2024-08-17T02:46:44.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.368+0000 7f7b0d400640 1 --2- 172.21.15.100:0/657632702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b1815c310 0x7f7b1815d1a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009910 tx=0x7f7b000091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecdb8a84cf5bde8a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:44.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.368+0000 7f7b15400640 1 -- 172.21.15.100:0/657632702 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0002ae60 con 0x7f7b1815c310 2024-08-17T02:46:44.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.368+0000 7f7b15400640 1 -- 172.21.15.100:0/657632702 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b00032440 con 0x7f7b1815c310 2024-08-17T02:46:44.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.368+0000 7f7b15400640 1 -- 172.21.15.100:0/657632702 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b000327e0 con 0x7f7b1815c310 2024-08-17T02:46:44.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.368+0000 7f7b17200640 1 -- 172.21.15.100:0/657632702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b1815c310 msgr2=0x7f7b1815d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.368+0000 7f7b17200640 1 --2- 172.21.15.100:0/657632702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b1815c310 0x7f7b1815d1a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009910 tx=0x7f7b000091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.368+0000 7f7b17200640 1 -- 172.21.15.100:0/657632702 shutdown_connections 2024-08-17T02:46:44.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.368+0000 7f7b17200640 1 --2- 172.21.15.100:0/657632702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b1815c310 0x7f7b1815d1a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.368+0000 7f7b17200640 1 -- 172.21.15.100:0/657632702 >> 172.21.15.100:0/657632702 conn(0x7f7b18067de0 msgr2=0x7f7b180681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:44.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.368+0000 7f7b17200640 1 -- 172.21.15.100:0/657632702 shutdown_connections 2024-08-17T02:46:44.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.369+0000 7f7b17200640 1 -- 172.21.15.100:0/657632702 wait complete. 2024-08-17T02:46:44.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.370+0000 7f7b17200640 1 Processor -- start 2024-08-17T02:46:44.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.370+0000 7f7b17200640 1 -- start start 2024-08-17T02:46:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.371+0000 7f7b17200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b180af7d0 0x7f7b180adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.371+0000 7f7b17200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b1815bf40 0x7f7b18152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.371+0000 7f7b17200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b1815c310 0x7f7b1816caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.371+0000 7f7b17200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b18154130 con 0x7f7b180af7d0 2024-08-17T02:46:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.371+0000 7f7b17200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b18153800 con 0x7f7b1815bf40 2024-08-17T02:46:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.371+0000 7f7b17200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b18153ae0 con 0x7f7b1815c310 2024-08-17T02:46:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.371+0000 7f7b15e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b180af7d0 0x7f7b180adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.371+0000 7f7b15e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b180af7d0 0x7f7b180adbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51068/0 (socket says 172.21.15.100:51068) 2024-08-17T02:46:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.371+0000 7f7b15e00640 1 -- 172.21.15.100:0/2942087558 learned_addr learned my addr 172.21.15.100:0/2942087558 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.372+0000 7f7b0d400640 1 --2- 172.21.15.100:0/2942087558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b1815bf40 0x7f7b18152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.372+0000 7f7b16800640 1 --2- 172.21.15.100:0/2942087558 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b1815c310 0x7f7b1816caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.372+0000 7f7b15e00640 1 -- 172.21.15.100:0/2942087558 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b1815c310 msgr2=0x7f7b1816caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.372+0000 7f7b15e00640 1 --2- 172.21.15.100:0/2942087558 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b1815c310 0x7f7b1816caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.372+0000 7f7b15e00640 1 -- 172.21.15.100:0/2942087558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b1815bf40 msgr2=0x7f7b18152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.372+0000 7f7b15e00640 1 --2- 172.21.15.100:0/2942087558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b1815bf40 0x7f7b18152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.372+0000 7f7b15e00640 1 -- 172.21.15.100:0/2942087558 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b00009450 con 0x7f7b180af7d0 2024-08-17T02:46:44.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.372+0000 7f7b16800640 1 --2- 172.21.15.100:0/2942087558 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b1815c310 0x7f7b1816caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:44.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.372+0000 7f7b15e00640 1 --2- 172.21.15.100:0/2942087558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b180af7d0 0x7f7b180adbd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800c560 tx=0x7f7b08007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:44.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.372+0000 7f7b0e000640 1 -- 172.21.15.100:0/2942087558 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b08011590 con 0x7f7b180af7d0 2024-08-17T02:46:44.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.372+0000 7f7b0e000640 1 -- 172.21.15.100:0/2942087558 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b08011710 con 0x7f7b180af7d0 2024-08-17T02:46:44.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.372+0000 7f7b0e000640 1 -- 172.21.15.100:0/2942087558 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b08011ad0 con 0x7f7b180af7d0 2024-08-17T02:46:44.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.372+0000 7f7b17200640 1 -- 172.21.15.100:0/2942087558 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b18153dc0 con 0x7f7b180af7d0 2024-08-17T02:46:44.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.372+0000 7f7b17200640 1 -- 172.21.15.100:0/2942087558 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b18153280 con 0x7f7b180af7d0 2024-08-17T02:46:44.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.373+0000 7f7b17200640 1 -- 172.21.15.100:0/2942087558 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b180ae330 con 0x7f7b180af7d0 2024-08-17T02:46:44.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.374+0000 7f7b0e000640 1 -- 172.21.15.100:0/2942087558 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7b0801b3b0 con 0x7f7b180af7d0 2024-08-17T02:46:44.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.375+0000 7f7b0e000640 1 --2- 172.21.15.100:0/2942087558 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7af4065150 0x7f7af4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.375+0000 7f7b0e000640 1 -- 172.21.15.100:0/2942087558 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f7b08081e10 con 0x7f7b180af7d0 2024-08-17T02:46:44.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.376+0000 7f7b0d400640 1 --2- 172.21.15.100:0/2942087558 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7af4065150 0x7f7af4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.376+0000 7f7b0d400640 1 --2- 172.21.15.100:0/2942087558 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7af4065150 0x7f7af4067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7b00034000 tx=0x7f7b00032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:44.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.379+0000 7f7b0e000640 1 -- 172.21.15.100:0/2942087558 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7b08085030 con 0x7f7b180af7d0 2024-08-17T02:46:44.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.550+0000 7f7b17200640 1 -- 172.21.15.100:0/2942087558 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7f7b18071050 con 0x7f7b180af7d0 2024-08-17T02:46:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.550+0000 7f7b0e000640 1 -- 172.21.15.100:0/2942087558 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v36) v1 ==== 97+0+8050 (secure 0 0 0) 0x7f7b08017070 con 0x7f7b180af7d0 2024-08-17T02:46:44.551 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:44.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.553+0000 7f7b17200640 1 -- 172.21.15.100:0/2942087558 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7af4065150 msgr2=0x7f7af4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.553+0000 7f7b17200640 1 --2- 172.21.15.100:0/2942087558 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7af4065150 0x7f7af4067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7b00034000 tx=0x7f7b00032000 comp rx=0 tx=0).stop 2024-08-17T02:46:44.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.553+0000 7f7b17200640 1 -- 172.21.15.100:0/2942087558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b180af7d0 msgr2=0x7f7b180adbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.553+0000 7f7b17200640 1 --2- 172.21.15.100:0/2942087558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b180af7d0 0x7f7b180adbd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800c560 tx=0x7f7b08007ef0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.553+0000 7f7b17200640 1 -- 172.21.15.100:0/2942087558 shutdown_connections 2024-08-17T02:46:44.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.553+0000 7f7b17200640 1 --2- 172.21.15.100:0/2942087558 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7af4065150 0x7f7af4067600 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.553+0000 7f7b17200640 1 --2- 172.21.15.100:0/2942087558 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b1815c310 0x7f7b1816caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.553+0000 7f7b17200640 1 --2- 172.21.15.100:0/2942087558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b1815bf40 0x7f7b18152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.553+0000 7f7b17200640 1 --2- 172.21.15.100:0/2942087558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b180af7d0 0x7f7b180adbd0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.553+0000 7f7b17200640 1 -- 172.21.15.100:0/2942087558 >> 172.21.15.100:0/2942087558 conn(0x7f7b18067de0 msgr2=0x7f7b1815b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:44.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.553+0000 7f7b17200640 1 -- 172.21.15.100:0/2942087558 shutdown_connections 2024-08-17T02:46:44.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.553+0000 7f7b17200640 1 -- 172.21.15.100:0/2942087558 wait complete. 2024-08-17T02:46:44.568 INFO:teuthology.orchestra.run.smithi100.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:28.081485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:29.108765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000001028572.meta","create_time":"2024-08-17T02:46:40.913393+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001028572"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000001028572.data","create_time":"2024-08-17T02:46:41.819233+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001028572"}}}] 2024-08-17T02:46:44.568 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000001028572 --format=json 2024-08-17T02:46:44.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.716+0000 7fa251a00640 1 Processor -- start 2024-08-17T02:46:44.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.717+0000 7fa251a00640 1 -- start start 2024-08-17T02:46:44.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.718+0000 7fa251a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa24c0afdd0 0x7fa24c1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.718+0000 7fa251a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24c157690 con 0x7fa24c155900 2024-08-17T02:46:44.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.718+0000 7fa251a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24c156a80 con 0x7fa24c0b0270 2024-08-17T02:46:44.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.718+0000 7fa251a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24c156d60 con 0x7fa24c0afdd0 2024-08-17T02:46:44.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.718+0000 7fa24be00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa24c155900 0x7fa24c155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57032/0 (socket says 172.21.15.100:57032) 2024-08-17T02:46:44.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.718+0000 7fa24be00640 1 -- 172.21.15.100:0/1623340285 learned_addr learned my addr 172.21.15.100:0/1623340285 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:44.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.718+0000 7fa251000640 1 --2- 172.21.15.100:0/1623340285 >> v2:172.21.15.123:3300/0 conn(0x7fa24c0afdd0 0x7fa24c1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.718+0000 7fa24b400640 1 -- 172.21.15.100:0/1623340285 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383017938 0 0) 0x7fa24c157690 con 0x7fa24c155900 2024-08-17T02:46:44.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.719+0000 7fa24b400640 1 -- 172.21.15.100:0/1623340285 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2300034e0 con 0x7fa24c155900 2024-08-17T02:46:44.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.719+0000 7fa24b400640 1 -- 172.21.15.100:0/1623340285 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061044731 0 0) 0x7fa24c156a80 con 0x7fa24c0b0270 2024-08-17T02:46:44.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.719+0000 7fa24b400640 1 -- 172.21.15.100:0/1623340285 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa24c157690 con 0x7fa24c0b0270 2024-08-17T02:46:44.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.719+0000 7fa24b400640 1 -- 172.21.15.100:0/1623340285 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3814070508 0 0) 0x7fa2300034e0 con 0x7fa24c155900 2024-08-17T02:46:44.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.719+0000 7fa24b400640 1 -- 172.21.15.100:0/1623340285 >> v2:172.21.15.123:3300/0 conn(0x7fa24c0afdd0 msgr2=0x7fa24c1563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:44.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.719+0000 7fa24b400640 1 --2- 172.21.15.100:0/1623340285 >> v2:172.21.15.123:3300/0 conn(0x7fa24c0afdd0 0x7fa24c1563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.719+0000 7fa24b400640 1 -- 172.21.15.100:0/1623340285 >> v1:172.21.15.123:6789/0 conn(0x7fa24c0b0270 legacy=0x7fa24c0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.719+0000 7fa24b400640 1 -- 172.21.15.100:0/1623340285 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c157040 con 0x7fa24c155900 2024-08-17T02:46:44.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.719+0000 7fa24b400640 1 -- 172.21.15.100:0/1623340285 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1817143124 0 0) 0x7fa23c001470 con 0x7fa24c155900 2024-08-17T02:46:44.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.719+0000 7fa24b400640 1 -- 172.21.15.100:0/1623340285 >> v1:172.21.15.100:6789/0 conn(0x7fa24c155900 legacy=0x7fa24c155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.719+0000 7fa24b400640 1 --2- 172.21.15.100:0/1623340285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa230003b60 0x7fa230003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.719+0000 7fa24b400640 1 --2- 172.21.15.100:0/1623340285 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa230004780 0x7fa230004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.719+0000 7fa24b400640 1 --2- 172.21.15.100:0/1623340285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa230005130 0x7fa23000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.719+0000 7fa24b400640 1 -- 172.21.15.100:0/1623340285 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c156d60 con 0x7fa230003b60 2024-08-17T02:46:44.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.719+0000 7fa24b400640 1 -- 172.21.15.100:0/1623340285 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23000c0d0 con 0x7fa230005130 2024-08-17T02:46:44.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.719+0000 7fa24b400640 1 -- 172.21.15.100:0/1623340285 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23000c290 con 0x7fa230004780 2024-08-17T02:46:44.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.719+0000 7fa24be00640 1 --2- 172.21.15.100:0/1623340285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa230003b60 0x7fa230003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.719+0000 7fa251000640 1 --2- 172.21.15.100:0/1623340285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa230005130 0x7fa23000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.719+0000 7fa243400640 1 --2- 172.21.15.100:0/1623340285 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa230004780 0x7fa230004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.720+0000 7fa24be00640 1 -- 172.21.15.100:0/1623340285 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa230004780 msgr2=0x7fa230004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:44.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.720+0000 7fa24be00640 1 --2- 172.21.15.100:0/1623340285 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa230004780 0x7fa230004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.720+0000 7fa24be00640 1 -- 172.21.15.100:0/1623340285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa230005130 msgr2=0x7fa23000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:44.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.720+0000 7fa24be00640 1 --2- 172.21.15.100:0/1623340285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa230005130 0x7fa23000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.720+0000 7fa24be00640 1 -- 172.21.15.100:0/1623340285 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2300034e0 con 0x7fa230003b60 2024-08-17T02:46:44.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.720+0000 7fa251000640 1 -- 172.21.15.100:0/1623340285 reap_dead start 2024-08-17T02:46:44.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.721+0000 7fa24be00640 1 --2- 172.21.15.100:0/1623340285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa230003b60 0x7fa230003f50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00c2a0 tx=0x7fa23c001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb017b66d0973461 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:44.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.721+0000 7fa24b400640 1 -- 172.21.15.100:0/1623340285 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c005890 con 0x7fa230003b60 2024-08-17T02:46:44.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.721+0000 7fa24b400640 1 -- 172.21.15.100:0/1623340285 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c005a10 con 0x7fa230003b60 2024-08-17T02:46:44.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.721+0000 7fa24b400640 1 -- 172.21.15.100:0/1623340285 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c005dd0 con 0x7fa230003b60 2024-08-17T02:46:44.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.721+0000 7fa251a00640 1 -- 172.21.15.100:0/1623340285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa230003b60 msgr2=0x7fa230003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.721+0000 7fa251a00640 1 --2- 172.21.15.100:0/1623340285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa230003b60 0x7fa230003f50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00c2a0 tx=0x7fa23c001e10 comp rx=0 tx=0).stop 2024-08-17T02:46:44.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.722+0000 7fa251a00640 1 -- 172.21.15.100:0/1623340285 shutdown_connections 2024-08-17T02:46:44.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.722+0000 7fa251a00640 1 --2- 172.21.15.100:0/1623340285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa230003b60 0x7fa230003f50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.722+0000 7fa251a00640 1 -- 172.21.15.100:0/1623340285 >> 172.21.15.100:0/1623340285 conn(0x7fa24c067750 msgr2=0x7fa24c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:44.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.722+0000 7fa251a00640 1 -- 172.21.15.100:0/1623340285 shutdown_connections 2024-08-17T02:46:44.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.722+0000 7fa251a00640 1 -- 172.21.15.100:0/1623340285 wait complete. 2024-08-17T02:46:44.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.723+0000 7fa251a00640 1 Processor -- start 2024-08-17T02:46:44.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.723+0000 7fa251a00640 1 -- start start 2024-08-17T02:46:44.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.724+0000 7fa251a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa230003b60 0x7fa24c0ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.724+0000 7fa251a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa24c0c93d0 0x7fa24c0a7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.724+0000 7fa251a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa24c0a7b70 0x7fa24c151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.724+0000 7fa251a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c0c8420 con 0x7fa230003b60 2024-08-17T02:46:44.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.724+0000 7fa251a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c0ca940 con 0x7fa24c0a7b70 2024-08-17T02:46:44.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.724+0000 7fa251a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c0a6890 con 0x7fa24c0c93d0 2024-08-17T02:46:44.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.724+0000 7fa24be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa230003b60 0x7fa24c0ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.724+0000 7fa24be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa230003b60 0x7fa24c0ca240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51088/0 (socket says 172.21.15.100:51088) 2024-08-17T02:46:44.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.724+0000 7fa24be00640 1 -- 172.21.15.100:0/1220611294 learned_addr learned my addr 172.21.15.100:0/1220611294 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:44.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.725+0000 7fa251000640 1 --2- 172.21.15.100:0/1220611294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa24c0a7b70 0x7fa24c151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.725+0000 7fa243400640 1 --2- 172.21.15.100:0/1220611294 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa24c0c93d0 0x7fa24c0a7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.725+0000 7fa24be00640 1 -- 172.21.15.100:0/1220611294 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa24c0c93d0 msgr2=0x7fa24c0a7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.725+0000 7fa24be00640 1 --2- 172.21.15.100:0/1220611294 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa24c0c93d0 0x7fa24c0a7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.725+0000 7fa24be00640 1 -- 172.21.15.100:0/1220611294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa24c0a7b70 msgr2=0x7fa24c151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.725+0000 7fa24be00640 1 --2- 172.21.15.100:0/1220611294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa24c0a7b70 0x7fa24c151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.725+0000 7fa24be00640 1 -- 172.21.15.100:0/1220611294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c0c8f40 con 0x7fa230003b60 2024-08-17T02:46:44.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.725+0000 7fa24be00640 1 --2- 172.21.15.100:0/1220611294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa230003b60 0x7fa24c0ca240 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa23c02ac90 tx=0x7fa23c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:44.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.725+0000 7fa243e00640 1 -- 172.21.15.100:0/1220611294 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c03a040 con 0x7fa230003b60 2024-08-17T02:46:44.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.725+0000 7fa243e00640 1 -- 172.21.15.100:0/1220611294 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c007300 con 0x7fa230003b60 2024-08-17T02:46:44.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.725+0000 7fa243e00640 1 -- 172.21.15.100:0/1220611294 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c007680 con 0x7fa230003b60 2024-08-17T02:46:44.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.725+0000 7fa251a00640 1 -- 172.21.15.100:0/1220611294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24c0a7ff0 con 0x7fa230003b60 2024-08-17T02:46:44.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.726+0000 7fa251a00640 1 -- 172.21.15.100:0/1220611294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24c0c88f0 con 0x7fa230003b60 2024-08-17T02:46:44.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.727+0000 7fa251a00640 1 -- 172.21.15.100:0/1220611294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24c0b0a30 con 0x7fa230003b60 2024-08-17T02:46:44.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.727+0000 7fa243e00640 1 -- 172.21.15.100:0/1220611294 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa23c030070 con 0x7fa230003b60 2024-08-17T02:46:44.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.728+0000 7fa243e00640 1 --2- 172.21.15.100:0/1220611294 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa228065150 0x7fa228067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.728+0000 7fa243e00640 1 -- 172.21.15.100:0/1220611294 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fa23c0a2610 con 0x7fa230003b60 2024-08-17T02:46:44.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.729+0000 7fa243400640 1 --2- 172.21.15.100:0/1220611294 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa228065150 0x7fa228067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.729+0000 7fa243400640 1 --2- 172.21.15.100:0/1220611294 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa228065150 0x7fa228067600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa24c1572f0 tx=0x7fa234007ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:44.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.733+0000 7fa243e00640 1 -- 172.21.15.100:0/1220611294 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa24c0b0a30 con 0x7fa230003b60 2024-08-17T02:46:44.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.954+0000 7fa251a00640 1 -- 172.21.15.100:0/1220611294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000001028572", "format": "json"} v 0) v1 -- 0x7fa24c0b0a30 con 0x7fa230003b60 2024-08-17T02:46:44.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.954+0000 7fa243e00640 1 -- 172.21.15.100:0/1220611294 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000001028572", "format": "json"}]=0 v20) v1 ==== 110+0+1847 (secure 0 0 0) 0x7fa24c0b0a30 con 0x7fa230003b60 2024-08-17T02:46:44.955 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:46:44.955 INFO:teuthology.orchestra.run.smithi100.stdout:{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:42.789210+0000","modified":"2024-08-17T02:46:44.792554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4885":{"gid":4885,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.123:6834/1763367135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1763367135},{"type":"v1","addr":"172.21.15.123:6834","nonce":1763367135}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001028572","balancer":"","standby_count_wanted":1},"id":3} 2024-08-17T02:46:44.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.956+0000 7fa251a00640 1 -- 172.21.15.100:0/1220611294 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa228065150 msgr2=0x7fa228067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.956+0000 7fa251a00640 1 --2- 172.21.15.100:0/1220611294 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa228065150 0x7fa228067600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa24c1572f0 tx=0x7fa234007ca0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.956+0000 7fa251a00640 1 -- 172.21.15.100:0/1220611294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa230003b60 msgr2=0x7fa24c0ca240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.956+0000 7fa251a00640 1 --2- 172.21.15.100:0/1220611294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa230003b60 0x7fa24c0ca240 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa23c02ac90 tx=0x7fa23c030000 comp rx=0 tx=0).stop 2024-08-17T02:46:44.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.956+0000 7fa251a00640 1 -- 172.21.15.100:0/1220611294 shutdown_connections 2024-08-17T02:46:44.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.956+0000 7fa251a00640 1 --2- 172.21.15.100:0/1220611294 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa228065150 0x7fa228067600 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.956+0000 7fa251a00640 1 --2- 172.21.15.100:0/1220611294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa24c0a7b70 0x7fa24c151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.956+0000 7fa251a00640 1 --2- 172.21.15.100:0/1220611294 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa24c0c93d0 0x7fa24c0a7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.956+0000 7fa251a00640 1 --2- 172.21.15.100:0/1220611294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa230003b60 0x7fa24c0ca240 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.956+0000 7fa251a00640 1 -- 172.21.15.100:0/1220611294 >> 172.21.15.100:0/1220611294 conn(0x7fa24c067750 msgr2=0x7fa24c0ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:44.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.956+0000 7fa251a00640 1 -- 172.21.15.100:0/1220611294 shutdown_connections 2024-08-17T02:46:44.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:44.957+0000 7fa251a00640 1 -- 172.21.15.100:0/1220611294 wait complete. 2024-08-17T02:46:44.972 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000001028572 --yes-i-really-mean-it 2024-08-17T02:46:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.123+0000 7f25d9e00640 1 Processor -- start 2024-08-17T02:46:45.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.123+0000 7f25d9e00640 1 -- start start 2024-08-17T02:46:45.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.124+0000 7f25d9e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f25d40c4a20 0x7f25d40ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.124+0000 7f25d9e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d40c61d0 con 0x7f25d4158e00 2024-08-17T02:46:45.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.124+0000 7f25d9e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d40c64b0 con 0x7f25d4158a30 2024-08-17T02:46:45.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.124+0000 7f25d9e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d40c5fe0 con 0x7f25d40c4a20 2024-08-17T02:46:45.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.125+0000 7f25d9400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f25d4158e00 0x7f25d40cb370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57048/0 (socket says 172.21.15.100:57048) 2024-08-17T02:46:45.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.125+0000 7f25d9400640 1 -- 172.21.15.100:0/1201105871 learned_addr learned my addr 172.21.15.100:0/1201105871 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:46:45.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.125+0000 7f25d3e00640 1 --2- 172.21.15.100:0/1201105871 >> v2:172.21.15.123:3300/0 conn(0x7f25d40c4a20 0x7f25d40ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.125+0000 7f25d3400640 1 -- 172.21.15.100:0/1201105871 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260388918 0 0) 0x7f25d40c61d0 con 0x7f25d4158e00 2024-08-17T02:46:45.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.125+0000 7f25d3400640 1 -- 172.21.15.100:0/1201105871 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25bc0034e0 con 0x7f25d4158e00 2024-08-17T02:46:45.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.125+0000 7f25d3e00640 1 -- 172.21.15.100:0/1201105871 >> v1:172.21.15.123:6789/0 conn(0x7f25d4158a30 legacy=0x7f25d40c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.125+0000 7f25d3e00640 1 -- 172.21.15.100:0/1201105871 >> v1:172.21.15.100:6789/0 conn(0x7f25d4158e00 legacy=0x7f25d40cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.125+0000 7f25d3e00640 1 -- 172.21.15.100:0/1201105871 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d40c6790 con 0x7f25d40c4a20 2024-08-17T02:46:45.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.126+0000 7f25d3e00640 1 --2- 172.21.15.100:0/1201105871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25d40c4a20 0x7f25d40ce180 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009850 tx=0x7f25c00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7fe4972ef1a71e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.127+0000 7f25d3400640 1 -- 172.21.15.100:0/1201105871 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c002ad90 con 0x7f25d40c4a20 2024-08-17T02:46:45.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.127+0000 7f25d3400640 1 -- 172.21.15.100:0/1201105871 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c0032440 con 0x7f25d40c4a20 2024-08-17T02:46:45.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.127+0000 7f25d3400640 1 -- 172.21.15.100:0/1201105871 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c00327e0 con 0x7f25d40c4a20 2024-08-17T02:46:45.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.127+0000 7f25d9e00640 1 -- 172.21.15.100:0/1201105871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25d40c4a20 msgr2=0x7f25d40ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.127+0000 7f25d9e00640 1 --2- 172.21.15.100:0/1201105871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25d40c4a20 0x7f25d40ce180 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009850 tx=0x7f25c00090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.128+0000 7f25d9e00640 1 -- 172.21.15.100:0/1201105871 shutdown_connections 2024-08-17T02:46:45.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.128+0000 7f25d9e00640 1 --2- 172.21.15.100:0/1201105871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25d40c4a20 0x7f25d40ce180 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.128+0000 7f25d9e00640 1 -- 172.21.15.100:0/1201105871 >> 172.21.15.100:0/1201105871 conn(0x7f25d4098e30 msgr2=0x7f25d406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:45.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.128+0000 7f25d9e00640 1 -- 172.21.15.100:0/1201105871 shutdown_connections 2024-08-17T02:46:45.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.128+0000 7f25d9e00640 1 -- 172.21.15.100:0/1201105871 wait complete. 2024-08-17T02:46:45.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.129+0000 7f25d9e00640 1 Processor -- start 2024-08-17T02:46:45.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.129+0000 7f25d9e00640 1 -- start start 2024-08-17T02:46:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.130+0000 7f25d9e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25d40c4a20 0x7f25d41520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.130+0000 7f25d9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d4158a30 0x7f25d40997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.130+0000 7f25d9e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25d4158e00 0x7f25d4099ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.130+0000 7f25d9e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d4157a40 con 0x7f25d4158a30 2024-08-17T02:46:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.130+0000 7f25d9e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d409c770 con 0x7f25d40c4a20 2024-08-17T02:46:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.130+0000 7f25d9e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d41690a0 con 0x7f25d4158e00 2024-08-17T02:46:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.130+0000 7f25d3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d4158a30 0x7f25d40997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.130+0000 7f25d3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d4158a30 0x7f25d40997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51102/0 (socket says 172.21.15.100:51102) 2024-08-17T02:46:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.130+0000 7f25d3e00640 1 -- 172.21.15.100:0/2820121022 learned_addr learned my addr 172.21.15.100:0/2820121022 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:46:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.131+0000 7f25d9400640 1 --2- 172.21.15.100:0/2820121022 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25d4158e00 0x7f25d4099ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.131+0000 7f25d8a00640 1 --2- 172.21.15.100:0/2820121022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25d40c4a20 0x7f25d41520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.131+0000 7f25d3e00640 1 -- 172.21.15.100:0/2820121022 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25d4158e00 msgr2=0x7f25d4099ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.131+0000 7f25d3e00640 1 --2- 172.21.15.100:0/2820121022 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25d4158e00 0x7f25d4099ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.131+0000 7f25d3e00640 1 -- 172.21.15.100:0/2820121022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25d40c4a20 msgr2=0x7f25d41520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.131+0000 7f25d3e00640 1 --2- 172.21.15.100:0/2820121022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25d40c4a20 0x7f25d41520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.131+0000 7f25d3e00640 1 -- 172.21.15.100:0/2820121022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c0009390 con 0x7f25d4158a30 2024-08-17T02:46:45.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.131+0000 7f25d9400640 1 --2- 172.21.15.100:0/2820121022 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25d4158e00 0x7f25d4099ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:45.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.131+0000 7f25d3e00640 1 --2- 172.21.15.100:0/2820121022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d4158a30 0x7f25d40997a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009850 tx=0x7f25c0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.131+0000 7f25c7e00640 1 -- 172.21.15.100:0/2820121022 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0000d10 con 0x7f25d4158a30 2024-08-17T02:46:45.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.131+0000 7f25c7e00640 1 -- 172.21.15.100:0/2820121022 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c0031e00 con 0x7f25d4158a30 2024-08-17T02:46:45.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.131+0000 7f25d9e00640 1 -- 172.21.15.100:0/2820121022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d4155860 con 0x7f25d4158a30 2024-08-17T02:46:45.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.131+0000 7f25c7e00640 1 -- 172.21.15.100:0/2820121022 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c003d670 con 0x7f25d4158a30 2024-08-17T02:46:45.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.132+0000 7f25d9e00640 1 -- 172.21.15.100:0/2820121022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d4157760 con 0x7f25d4158a30 2024-08-17T02:46:45.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.133+0000 7f25c5600640 1 -- 172.21.15.100:0/2820121022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a8005210 con 0x7f25d4158a30 2024-08-17T02:46:45.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.133+0000 7f25c7e00640 1 -- 172.21.15.100:0/2820121022 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f25c0039040 con 0x7f25d4158a30 2024-08-17T02:46:45.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.134+0000 7f25c7e00640 1 --2- 172.21.15.100:0/2820121022 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f25b4065150 0x7f25b4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.134+0000 7f25c7e00640 1 -- 172.21.15.100:0/2820121022 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f25c00a2ae0 con 0x7f25d4158a30 2024-08-17T02:46:45.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.134+0000 7f25d8a00640 1 --2- 172.21.15.100:0/2820121022 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f25b4065150 0x7f25b4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.135+0000 7f25d8a00640 1 --2- 172.21.15.100:0/2820121022 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f25b4065150 0x7f25b4067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f25c8003ec0 tx=0x7f25c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.138+0000 7f25c7e00640 1 -- 172.21.15.100:0/2820121022 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f25c0070780 con 0x7f25d4158a30 2024-08-17T02:46:45.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:46:45.332+0000 7f25c5600640 1 -- 172.21.15.100:0/2820121022 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000001028572", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f25a8000c60 con 0x7f25b4065150 2024-08-17T02:46:49.688 INFO:tasks.ceph.mds.d.smithi123.stderr:2024-08-17T02:46:49.687+0000 7f2926000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:47:14.387 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:47:14.393 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:47:44.484 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:47:44.490 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:48:14.581 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:48:14.587 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:48:44.718 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:48:44.724 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:48:45.041 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-17T02:48:45.042 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:48:45.042 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:48:45.139 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:48:45.232 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:48:45.232 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:48:45.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:48:45.233 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-17T02:48:45.300 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-08-17T02:48:45.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:48:45.301 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:48:45.338 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:48:45.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:48:45.338 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-08-17T02:48:45.404 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-08-17T02:48:45.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:48:45.405 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:48:45.441 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:48:45.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.588+0000 7fe84a200640 1 Processor -- start 2024-08-17T02:48:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.588+0000 7fe84a200640 1 -- start start 2024-08-17T02:48:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.589+0000 7fe84a200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe844155550 0x7fe8440aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.589+0000 7fe84a200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe84406e080 0x7fe84406e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.589+0000 7fe84a200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8440afc10 con 0x7fe844155180 2024-08-17T02:48:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.589+0000 7fe84a200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84406ea40 con 0x7fe84406e080 2024-08-17T02:48:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.589+0000 7fe84a200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440af000 con 0x7fe844155550 2024-08-17T02:48:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.590+0000 7fe843e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe84406e080 0x7fe84406e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.590+0000 7fe843400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe844155180 0x7fe8440ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.100:37144/0 (socket says 172.21.15.100:37144) 2024-08-17T02:48:45.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.590+0000 7fe843400640 1 -- 172.21.15.100:0/2770209330 learned_addr learned my addr 172.21.15.100:0/2770209330 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:48:45.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.590+0000 7fe842a00640 1 --2- 172.21.15.100:0/2770209330 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe844155550 0x7fe8440aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:45.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.590+0000 7fe842000640 1 -- 172.21.15.100:0/2770209330 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130272045 0 0) 0x7fe8440afc10 con 0x7fe844155180 2024-08-17T02:48:45.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.590+0000 7fe842000640 1 -- 172.21.15.100:0/2770209330 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8280034e0 con 0x7fe844155180 2024-08-17T02:48:45.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.590+0000 7fe843e00640 1 -- 172.21.15.100:0/2770209330 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe844155550 msgr2=0x7fe8440aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:45.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.590+0000 7fe843e00640 1 --2- 172.21.15.100:0/2770209330 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe844155550 0x7fe8440aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:45.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.590+0000 7fe843e00640 1 -- 172.21.15.100:0/2770209330 >> v1:172.21.15.123:6789/0 conn(0x7fe844155180 legacy=0x7fe8440ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:45.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.590+0000 7fe843e00640 1 -- 172.21.15.100:0/2770209330 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8440af2e0 con 0x7fe84406e080 2024-08-17T02:48:45.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.591+0000 7fe843e00640 1 --2- 172.21.15.100:0/2770209330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe84406e080 0x7fe84406e500 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009e60 tx=0x7fe83c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eca68bd921b83c9b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:45.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.591+0000 7fe842000640 1 -- 172.21.15.100:0/2770209330 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c007550 con 0x7fe84406e080 2024-08-17T02:48:45.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.591+0000 7fe842000640 1 -- 172.21.15.100:0/2770209330 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c02d050 con 0x7fe84406e080 2024-08-17T02:48:45.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.591+0000 7fe842000640 1 -- 172.21.15.100:0/2770209330 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c007920 con 0x7fe84406e080 2024-08-17T02:48:45.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.592+0000 7fe84a200640 1 -- 172.21.15.100:0/2770209330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe84406e080 msgr2=0x7fe84406e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:45.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.592+0000 7fe84a200640 1 --2- 172.21.15.100:0/2770209330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe84406e080 0x7fe84406e500 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009e60 tx=0x7fe83c009780 comp rx=0 tx=0).stop 2024-08-17T02:48:45.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.592+0000 7fe84a200640 1 -- 172.21.15.100:0/2770209330 shutdown_connections 2024-08-17T02:48:45.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.592+0000 7fe84a200640 1 --2- 172.21.15.100:0/2770209330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe84406e080 0x7fe84406e500 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:45.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.592+0000 7fe84a200640 1 --2- 172.21.15.100:0/2770209330 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe844155550 0x7fe8440aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:45.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.592+0000 7fe84a200640 1 -- 172.21.15.100:0/2770209330 >> 172.21.15.100:0/2770209330 conn(0x7fe8440cb9b0 msgr2=0x7fe8440cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:45.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.592+0000 7fe84a200640 1 -- 172.21.15.100:0/2770209330 shutdown_connections 2024-08-17T02:48:45.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.592+0000 7fe84a200640 1 -- 172.21.15.100:0/2770209330 wait complete. 2024-08-17T02:48:45.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.593+0000 7fe84a200640 1 Processor -- start 2024-08-17T02:48:45.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.594+0000 7fe84a200640 1 -- start start 2024-08-17T02:48:45.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.594+0000 7fe84a200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe84406e080 0x7fe844146670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:45.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.594+0000 7fe84a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe844155180 0x7fe8440b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:45.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.594+0000 7fe84a200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe844155550 0x7fe8440b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:45.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.595+0000 7fe84a200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84414c490 con 0x7fe844155180 2024-08-17T02:48:45.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.595+0000 7fe84a200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84414aee0 con 0x7fe84406e080 2024-08-17T02:48:45.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.595+0000 7fe84a200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84414b370 con 0x7fe844155550 2024-08-17T02:48:45.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.595+0000 7fe842a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe844155180 0x7fe8440b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:45.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.595+0000 7fe842a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe844155180 0x7fe8440b10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38480/0 (socket says 172.21.15.100:38480) 2024-08-17T02:48:45.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.595+0000 7fe842a00640 1 -- 172.21.15.100:0/1571918853 learned_addr learned my addr 172.21.15.100:0/1571918853 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:45.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.595+0000 7fe843400640 1 --2- 172.21.15.100:0/1571918853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe84406e080 0x7fe844146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:45.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.595+0000 7fe843e00640 1 --2- 172.21.15.100:0/1571918853 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe844155550 0x7fe8440b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:45.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.595+0000 7fe842a00640 1 -- 172.21.15.100:0/1571918853 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe844155550 msgr2=0x7fe8440b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:45.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.595+0000 7fe842a00640 1 --2- 172.21.15.100:0/1571918853 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe844155550 0x7fe8440b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:45.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.595+0000 7fe842a00640 1 -- 172.21.15.100:0/1571918853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe84406e080 msgr2=0x7fe844146670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:45.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.595+0000 7fe842a00640 1 --2- 172.21.15.100:0/1571918853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe84406e080 0x7fe844146670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:45.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.595+0000 7fe842a00640 1 -- 172.21.15.100:0/1571918853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c009a20 con 0x7fe844155180 2024-08-17T02:48:45.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.595+0000 7fe843400640 1 --2- 172.21.15.100:0/1571918853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe84406e080 0x7fe844146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:48:45.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.596+0000 7fe842a00640 1 --2- 172.21.15.100:0/1571918853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe844155180 0x7fe8440b10b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe83000e930 tx=0x7fe8300090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:45.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.596+0000 7fe83aa00640 1 -- 172.21.15.100:0/1571918853 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83000c8e0 con 0x7fe844155180 2024-08-17T02:48:45.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.596+0000 7fe83aa00640 1 -- 172.21.15.100:0/1571918853 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83000ca40 con 0x7fe844155180 2024-08-17T02:48:45.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.596+0000 7fe83aa00640 1 -- 172.21.15.100:0/1571918853 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83000cde0 con 0x7fe844155180 2024-08-17T02:48:45.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.596+0000 7fe84a200640 1 -- 172.21.15.100:0/1571918853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe84414a5b0 con 0x7fe844155180 2024-08-17T02:48:45.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.596+0000 7fe84a200640 1 -- 172.21.15.100:0/1571918853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84414ab70 con 0x7fe844155180 2024-08-17T02:48:45.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.597+0000 7fe84a200640 1 -- 172.21.15.100:0/1571918853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe844064db0 con 0x7fe844155180 2024-08-17T02:48:45.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.598+0000 7fe83aa00640 1 -- 172.21.15.100:0/1571918853 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe830013680 con 0x7fe844155180 2024-08-17T02:48:45.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.598+0000 7fe83aa00640 1 --2- 172.21.15.100:0/1571918853 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe824065150 0x7fe824067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:45.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.599+0000 7fe83aa00640 1 -- 172.21.15.100:0/1571918853 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fe830082a30 con 0x7fe844155180 2024-08-17T02:48:45.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.599+0000 7fe843400640 1 --2- 172.21.15.100:0/1571918853 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe824065150 0x7fe824067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:45.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.599+0000 7fe843400640 1 --2- 172.21.15.100:0/1571918853 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe824065150 0x7fe824067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe834005840 tx=0x7fe834009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:45.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.603+0000 7fe83aa00640 1 -- 172.21.15.100:0/1571918853 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe830050780 con 0x7fe844155180 2024-08-17T02:48:45.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.815+0000 7fe84a200640 1 -- 172.21.15.100:0/1571918853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe84414b020 con 0x7fe844155180 2024-08-17T02:48:45.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.815+0000 7fe83aa00640 1 -- 172.21.15.100:0/1571918853 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5696 (secure 0 0 0) 0x7fe830053da0 con 0x7fe844155180 2024-08-17T02:48:45.817 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:48:45.817 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1972998642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1972998642},{"type":"v1","addr":"172.21.15.100:6836","nonce":1972998642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3961484077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3961484077},{"type":"v1","addr":"172.21.15.100:6837","nonce":3961484077}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:30.114385+0000","modified":"2024-08-17T02:46:33.731841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1541092259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":1541092259},{"type":"v1","addr":"172.21.15.123:6835","nonce":1541092259}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:42.789210+0000","modified":"2024-08-17T02:46:44.792554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4885":{"gid":4885,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.123:6834/1763367135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1763367135},{"type":"v1","addr":"172.21.15.123:6834","nonce":1763367135}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001028572","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:48:45.817 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 20 2024-08-17T02:48:45.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.817+0000 7fe84a200640 1 -- 172.21.15.100:0/1571918853 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe824065150 msgr2=0x7fe824067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:45.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.817+0000 7fe84a200640 1 --2- 172.21.15.100:0/1571918853 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe824065150 0x7fe824067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe834005840 tx=0x7fe834009040 comp rx=0 tx=0).stop 2024-08-17T02:48:45.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.817+0000 7fe84a200640 1 -- 172.21.15.100:0/1571918853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe844155180 msgr2=0x7fe8440b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:45.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.817+0000 7fe84a200640 1 --2- 172.21.15.100:0/1571918853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe844155180 0x7fe8440b10b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe83000e930 tx=0x7fe8300090f0 comp rx=0 tx=0).stop 2024-08-17T02:48:45.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.817+0000 7fe84a200640 1 -- 172.21.15.100:0/1571918853 shutdown_connections 2024-08-17T02:48:45.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.817+0000 7fe84a200640 1 --2- 172.21.15.100:0/1571918853 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe824065150 0x7fe824067600 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:45.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.817+0000 7fe84a200640 1 --2- 172.21.15.100:0/1571918853 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe844155550 0x7fe8440b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:45.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.817+0000 7fe84a200640 1 --2- 172.21.15.100:0/1571918853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe844155180 0x7fe8440b10b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:45.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.817+0000 7fe84a200640 1 --2- 172.21.15.100:0/1571918853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe84406e080 0x7fe844146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:45.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.817+0000 7fe84a200640 1 -- 172.21.15.100:0/1571918853 >> 172.21.15.100:0/1571918853 conn(0x7fe8440cb9b0 msgr2=0x7fe844152ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:45.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.818+0000 7fe84a200640 1 -- 172.21.15.100:0/1571918853 shutdown_connections 2024-08-17T02:48:45.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.818+0000 7fe84a200640 1 -- 172.21.15.100:0/1571918853 wait complete. 2024-08-17T02:48:45.834 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:48:45.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.981+0000 7f9ca2c00640 1 Processor -- start 2024-08-17T02:48:45.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.981+0000 7f9ca2c00640 1 -- start start 2024-08-17T02:48:45.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.982+0000 7f9ca2c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9c9c155a20 0x7f9c9c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:45.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.982+0000 7f9ca2c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c9c155df0 0x7f9c9c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:45.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.982+0000 7f9ca2c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9c9c06d7f0 0x7f9c9c06dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:45.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.982+0000 7f9ca2c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c0b0350 con 0x7f9c9c06d7f0 2024-08-17T02:48:45.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.982+0000 7f9ca2c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c06e1d0 con 0x7f9c9c155a20 2024-08-17T02:48:45.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.982+0000 7f9ca2c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c156670 con 0x7f9c9c155df0 2024-08-17T02:48:45.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.982+0000 7f9ca0c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9c9c06d7f0 0x7f9c9c06dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:45.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.982+0000 7f9ca0c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9c9c06d7f0 0x7f9c9c06dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38488/0 (socket says 172.21.15.100:38488) 2024-08-17T02:48:45.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.982+0000 7f9ca0c00640 1 -- 172.21.15.100:0/3527783596 learned_addr learned my addr 172.21.15.100:0/3527783596 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:45.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.982+0000 7f9c9b400640 1 --2- 172.21.15.100:0/3527783596 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c9c155df0 0x7f9c9c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:45.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.982+0000 7f9c9be00640 1 --2- 172.21.15.100:0/3527783596 >> v2:172.21.15.123:3300/0 conn(0x7f9c9c155a20 0x7f9c9c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:45.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.983+0000 7f9ca0c00640 1 -- 172.21.15.100:0/3527783596 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c9c155df0 msgr2=0x7f9c9c0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:45.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.983+0000 7f9ca0c00640 1 --2- 172.21.15.100:0/3527783596 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c9c155df0 0x7f9c9c0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:45.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.983+0000 7f9ca0c00640 1 -- 172.21.15.100:0/3527783596 >> v2:172.21.15.123:3300/0 conn(0x7f9c9c155a20 msgr2=0x7f9c9c0adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:45.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.983+0000 7f9ca0c00640 1 --2- 172.21.15.100:0/3527783596 >> v2:172.21.15.123:3300/0 conn(0x7f9c9c155a20 0x7f9c9c0adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:45.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.983+0000 7f9ca0c00640 1 -- 172.21.15.100:0/3527783596 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c06e5e0 con 0x7f9c9c06d7f0 2024-08-17T02:48:45.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.984+0000 7f9ca0c00640 1 --2- 172.21.15.100:0/3527783596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c9c06d7f0 0x7f9c9c06dc90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c06bc00 tx=0x7f9c94009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=116a778c03f385fc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:45.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.984+0000 7f9c9aa00640 1 -- 172.21.15.100:0/3527783596 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c94031400 con 0x7f9c9c06d7f0 2024-08-17T02:48:45.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.984+0000 7f9c9aa00640 1 -- 172.21.15.100:0/3527783596 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9402d050 con 0x7f9c9c06d7f0 2024-08-17T02:48:45.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.984+0000 7f9c9aa00640 1 -- 172.21.15.100:0/3527783596 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c940317d0 con 0x7f9c9c06d7f0 2024-08-17T02:48:45.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.985+0000 7f9ca2c00640 1 -- 172.21.15.100:0/3527783596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c9c06d7f0 msgr2=0x7f9c9c06dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:45.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.985+0000 7f9ca2c00640 1 --2- 172.21.15.100:0/3527783596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c9c06d7f0 0x7f9c9c06dc90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c06bc00 tx=0x7f9c94009840 comp rx=0 tx=0).stop 2024-08-17T02:48:45.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.985+0000 7f9ca2c00640 1 -- 172.21.15.100:0/3527783596 shutdown_connections 2024-08-17T02:48:45.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.985+0000 7f9ca2c00640 1 --2- 172.21.15.100:0/3527783596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c9c06d7f0 0x7f9c9c06dc90 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:45.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.985+0000 7f9ca2c00640 1 --2- 172.21.15.100:0/3527783596 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c9c155df0 0x7f9c9c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:45.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.985+0000 7f9ca2c00640 1 --2- 172.21.15.100:0/3527783596 >> v2:172.21.15.123:3300/0 conn(0x7f9c9c155a20 0x7f9c9c0adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:45.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.985+0000 7f9ca2c00640 1 -- 172.21.15.100:0/3527783596 >> 172.21.15.100:0/3527783596 conn(0x7f9c9c0cb9b0 msgr2=0x7f9c9c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:45.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.985+0000 7f9ca2c00640 1 -- 172.21.15.100:0/3527783596 shutdown_connections 2024-08-17T02:48:45.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.985+0000 7f9ca2c00640 1 -- 172.21.15.100:0/3527783596 wait complete. 2024-08-17T02:48:45.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.986+0000 7f9ca2c00640 1 Processor -- start 2024-08-17T02:48:45.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.986+0000 7f9ca2c00640 1 -- start start 2024-08-17T02:48:45.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.987+0000 7f9ca2c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c9c06d7f0 0x7f9c9c06a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:45.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.987+0000 7f9ca2c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c9c155a20 0x7f9c9c14d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:45.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.987+0000 7f9ca2c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c9c155df0 0x7f9c9c153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:45.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.987+0000 7f9ca2c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c06a680 con 0x7f9c9c155df0 2024-08-17T02:48:45.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.987+0000 7f9ca2c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c068840 con 0x7f9c9c155a20 2024-08-17T02:48:45.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.987+0000 7f9ca2c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c16cba0 con 0x7f9c9c06d7f0 2024-08-17T02:48:45.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.987+0000 7f9ca0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c9c155df0 0x7f9c9c153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:45.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.987+0000 7f9ca0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c9c155df0 0x7f9c9c153440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38500/0 (socket says 172.21.15.100:38500) 2024-08-17T02:48:45.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.987+0000 7f9ca0c00640 1 -- 172.21.15.100:0/3056120412 learned_addr learned my addr 172.21.15.100:0/3056120412 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:45.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.988+0000 7f9ca0c00640 1 -- 172.21.15.100:0/3056120412 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c9c06d7f0 msgr2=0x7f9c9c06a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:45.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.988+0000 7f9ca0c00640 1 --2- 172.21.15.100:0/3056120412 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c9c06d7f0 0x7f9c9c06a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:45.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.988+0000 7f9ca0c00640 1 -- 172.21.15.100:0/3056120412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c9c155a20 msgr2=0x7f9c9c14d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:45.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.988+0000 7f9ca0c00640 1 --2- 172.21.15.100:0/3056120412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c9c155a20 0x7f9c9c14d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:45.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.988+0000 7f9ca0c00640 1 -- 172.21.15.100:0/3056120412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c94009ae0 con 0x7f9c9c155df0 2024-08-17T02:48:45.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.988+0000 7f9ca0c00640 1 --2- 172.21.15.100:0/3056120412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c9c155df0 0x7f9c9c153440 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9c9402acb0 tx=0x7f9c94036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:45.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.988+0000 7f9c93400640 1 -- 172.21.15.100:0/3056120412 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c94031880 con 0x7f9c9c155df0 2024-08-17T02:48:45.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.988+0000 7f9c93400640 1 -- 172.21.15.100:0/3056120412 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c94008e50 con 0x7f9c9c155df0 2024-08-17T02:48:45.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.988+0000 7f9c93400640 1 -- 172.21.15.100:0/3056120412 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9403b640 con 0x7f9c9c155df0 2024-08-17T02:48:45.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.988+0000 7f9ca2c00640 1 -- 172.21.15.100:0/3056120412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c9c16ce80 con 0x7f9c9c155df0 2024-08-17T02:48:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.988+0000 7f9ca2c00640 1 -- 172.21.15.100:0/3056120412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9c16d440 con 0x7f9c9c155df0 2024-08-17T02:48:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.989+0000 7f9ca2c00640 1 -- 172.21.15.100:0/3056120412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c9c155260 con 0x7f9c9c155df0 2024-08-17T02:48:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.990+0000 7f9c93400640 1 -- 172.21.15.100:0/3056120412 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9c94038050 con 0x7f9c9c155df0 2024-08-17T02:48:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.991+0000 7f9c93400640 1 --2- 172.21.15.100:0/3056120412 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9c7c065150 0x7f9c7c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.991+0000 7f9c93400640 1 -- 172.21.15.100:0/3056120412 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f9c940a2d50 con 0x7f9c9c155df0 2024-08-17T02:48:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.991+0000 7f9c9be00640 1 --2- 172.21.15.100:0/3056120412 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9c7c065150 0x7f9c7c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:45.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.992+0000 7f9c9be00640 1 --2- 172.21.15.100:0/3056120412 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9c7c065150 0x7f9c7c067600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c153ee0 tx=0x7f9c8c0090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:45.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:45.995+0000 7f9c93400640 1 -- 172.21.15.100:0/3056120412 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9c940709f0 con 0x7f9c9c155df0 2024-08-17T02:48:46.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.169+0000 7f9ca2c00640 1 -- 172.21.15.100:0/3056120412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c9c064db0 con 0x7f9c9c155df0 2024-08-17T02:48:46.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.170+0000 7f9c93400640 1 -- 172.21.15.100:0/3056120412 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18647 (secure 0 0 0) 0x7f9c94074010 con 0x7f9c9c155df0 2024-08-17T02:48:46.172 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:48:46.172 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":38,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:46:45.796677+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:28.081485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:29.108765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000001028572.meta","create_time":"2024-08-17T02:46:40.913393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001028572"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001028572.data","create_time":"2024-08-17T02:46:41.819233+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001028572"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:48:46.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.172+0000 7f9ca2c00640 1 -- 172.21.15.100:0/3056120412 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9c7c065150 msgr2=0x7f9c7c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:46.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.172+0000 7f9ca2c00640 1 --2- 172.21.15.100:0/3056120412 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9c7c065150 0x7f9c7c067600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c153ee0 tx=0x7f9c8c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.172+0000 7f9ca2c00640 1 -- 172.21.15.100:0/3056120412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c9c155df0 msgr2=0x7f9c9c153440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:46.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.172+0000 7f9ca2c00640 1 --2- 172.21.15.100:0/3056120412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c9c155df0 0x7f9c9c153440 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9c9402acb0 tx=0x7f9c94036000 comp rx=0 tx=0).stop 2024-08-17T02:48:46.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.172+0000 7f9ca2c00640 1 -- 172.21.15.100:0/3056120412 shutdown_connections 2024-08-17T02:48:46.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.172+0000 7f9ca2c00640 1 --2- 172.21.15.100:0/3056120412 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9c7c065150 0x7f9c7c067600 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.172+0000 7f9ca2c00640 1 --2- 172.21.15.100:0/3056120412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c9c155df0 0x7f9c9c153440 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.172+0000 7f9ca2c00640 1 --2- 172.21.15.100:0/3056120412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c9c155a20 0x7f9c9c14d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.172+0000 7f9ca2c00640 1 --2- 172.21.15.100:0/3056120412 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c9c06d7f0 0x7f9c9c06a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.172+0000 7f9ca2c00640 1 -- 172.21.15.100:0/3056120412 >> 172.21.15.100:0/3056120412 conn(0x7f9c9c0cb9b0 msgr2=0x7f9c9c0caea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:46.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.172+0000 7f9ca2c00640 1 -- 172.21.15.100:0/3056120412 shutdown_connections 2024-08-17T02:48:46.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.172+0000 7f9ca2c00640 1 -- 172.21.15.100:0/3056120412 wait complete. 2024-08-17T02:48:46.189 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:45:35.140990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:28.081485+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:29.108765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000001028572.meta', 'create_time': '2024-08-17T02:46:40.913393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000001028572'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000001028572.data', 'create_time': '2024-08-17T02:46:41.819233+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000001028572'}}}] 2024-08-17T02:48:46.189 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:48:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.338+0000 7f9646600640 1 Processor -- start 2024-08-17T02:48:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.338+0000 7f9646600640 1 -- start start 2024-08-17T02:48:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.339+0000 7f9646600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f96400aede0 0x7f96400aacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.339+0000 7f9646600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9640066cd0 0x7f9640067170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.339+0000 7f9646600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96400ad940 con 0x7f9640153320 2024-08-17T02:48:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.339+0000 7f9646600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96400676b0 con 0x7f96400aede0 2024-08-17T02:48:46.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.339+0000 7f9646600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964006e700 con 0x7f9640066cd0 2024-08-17T02:48:46.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.339+0000 7f963ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f96400aede0 0x7f96400aacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:46.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.339+0000 7f963ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f96400aede0 0x7f96400aacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38512/0 (socket says 172.21.15.100:38512) 2024-08-17T02:48:46.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.339+0000 7f963ea00640 1 -- 172.21.15.100:0/1069212733 learned_addr learned my addr 172.21.15.100:0/1069212733 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:46.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.340+0000 7f963fe00640 1 --2- 172.21.15.100:0/1069212733 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9640066cd0 0x7f9640067170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:46.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.340+0000 7f963ea00640 1 -- 172.21.15.100:0/1069212733 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9640066cd0 msgr2=0x7f9640067170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:46.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.340+0000 7f963ea00640 1 --2- 172.21.15.100:0/1069212733 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9640066cd0 0x7f9640067170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.340+0000 7f963ea00640 1 -- 172.21.15.100:0/1069212733 >> v1:172.21.15.123:6789/0 conn(0x7f9640153320 legacy=0x7f9640159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:46.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.340+0000 7f963ea00640 1 -- 172.21.15.100:0/1069212733 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9640159b20 con 0x7f96400aede0 2024-08-17T02:48:46.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.341+0000 7f963ea00640 1 --2- 172.21.15.100:0/1069212733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96400aede0 0x7f96400aacb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f962c009910 tx=0x7f962c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e382c1d5af2449 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.341+0000 7f963e000640 1 -- 172.21.15.100:0/1069212733 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c02adb0 con 0x7f96400aede0 2024-08-17T02:48:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.341+0000 7f963e000640 1 -- 172.21.15.100:0/1069212733 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962c032440 con 0x7f96400aede0 2024-08-17T02:48:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.341+0000 7f963e000640 1 -- 172.21.15.100:0/1069212733 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c032820 con 0x7f96400aede0 2024-08-17T02:48:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.342+0000 7f9646600640 1 -- 172.21.15.100:0/1069212733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96400aede0 msgr2=0x7f96400aacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.342+0000 7f9646600640 1 --2- 172.21.15.100:0/1069212733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96400aede0 0x7f96400aacb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f962c009910 tx=0x7f962c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.342+0000 7f9646600640 1 -- 172.21.15.100:0/1069212733 shutdown_connections 2024-08-17T02:48:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.342+0000 7f9646600640 1 --2- 172.21.15.100:0/1069212733 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9640066cd0 0x7f9640067170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.342+0000 7f9646600640 1 --2- 172.21.15.100:0/1069212733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96400aede0 0x7f96400aacb0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.342+0000 7f9646600640 1 -- 172.21.15.100:0/1069212733 >> 172.21.15.100:0/1069212733 conn(0x7f964006d8b0 msgr2=0x7f964006dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.342+0000 7f9646600640 1 -- 172.21.15.100:0/1069212733 shutdown_connections 2024-08-17T02:48:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.342+0000 7f9646600640 1 -- 172.21.15.100:0/1069212733 wait complete. 2024-08-17T02:48:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.343+0000 7f9646600640 1 Processor -- start 2024-08-17T02:48:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.343+0000 7f9646600640 1 -- start start 2024-08-17T02:48:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.344+0000 7f9646600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9640066cd0 0x7f96401506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.344+0000 7f9646600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96400aede0 0x7f9640155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.344+0000 7f9646600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9640153320 0x7f964015ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.344+0000 7f9646600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9640150c10 con 0x7f9640066cd0 2024-08-17T02:48:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.344+0000 7f9646600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964016a380 con 0x7f96400aede0 2024-08-17T02:48:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.344+0000 7f9646600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9640169770 con 0x7f9640153320 2024-08-17T02:48:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.344+0000 7f963f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9640066cd0 0x7f96401506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.344+0000 7f963f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9640066cd0 0x7f96401506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38520/0 (socket says 172.21.15.100:38520) 2024-08-17T02:48:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.344+0000 7f963f400640 1 -- 172.21.15.100:0/75210314 learned_addr learned my addr 172.21.15.100:0/75210314 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.345+0000 7f963fe00640 1 --2- 172.21.15.100:0/75210314 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9640153320 0x7f964015ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.345+0000 7f963ea00640 1 --2- 172.21.15.100:0/75210314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96400aede0 0x7f9640155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.345+0000 7f963f400640 1 -- 172.21.15.100:0/75210314 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9640153320 msgr2=0x7f964015ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.345+0000 7f963f400640 1 --2- 172.21.15.100:0/75210314 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9640153320 0x7f964015ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.345+0000 7f963f400640 1 -- 172.21.15.100:0/75210314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96400aede0 msgr2=0x7f9640155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:46.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.345+0000 7f963f400640 1 --2- 172.21.15.100:0/75210314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96400aede0 0x7f9640155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.345+0000 7f963f400640 1 -- 172.21.15.100:0/75210314 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c009450 con 0x7f9640066cd0 2024-08-17T02:48:46.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.345+0000 7f963f400640 1 --2- 172.21.15.100:0/75210314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9640066cd0 0x7f96401506d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f963000c4c0 tx=0x7f9630007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:46.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.345+0000 7f9636a00640 1 -- 172.21.15.100:0/75210314 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9630011590 con 0x7f9640066cd0 2024-08-17T02:48:46.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.345+0000 7f9636a00640 1 -- 172.21.15.100:0/75210314 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9630011710 con 0x7f9640066cd0 2024-08-17T02:48:46.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.345+0000 7f9646600640 1 -- 172.21.15.100:0/75210314 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9640169a50 con 0x7f9640066cd0 2024-08-17T02:48:46.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.345+0000 7f9636a00640 1 -- 172.21.15.100:0/75210314 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9630011ad0 con 0x7f9640066cd0 2024-08-17T02:48:46.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.345+0000 7f9646600640 1 -- 172.21.15.100:0/75210314 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964016a010 con 0x7f9640066cd0 2024-08-17T02:48:46.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.346+0000 7f9646600640 1 -- 172.21.15.100:0/75210314 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9640064db0 con 0x7f9640066cd0 2024-08-17T02:48:46.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.347+0000 7f9636a00640 1 -- 172.21.15.100:0/75210314 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f963001b3b0 con 0x7f9640066cd0 2024-08-17T02:48:46.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.348+0000 7f9636a00640 1 --2- 172.21.15.100:0/75210314 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9620065180 0x7f9620067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:46.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.348+0000 7f9636a00640 1 -- 172.21.15.100:0/75210314 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f9630081ce0 con 0x7f9640066cd0 2024-08-17T02:48:46.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.348+0000 7f963ea00640 1 --2- 172.21.15.100:0/75210314 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9620065180 0x7f9620067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:46.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.349+0000 7f963ea00640 1 --2- 172.21.15.100:0/75210314 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9620065180 0x7f9620067630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f962c034000 tx=0x7f962c032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:46.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.352+0000 7f9636a00640 1 -- 172.21.15.100:0/75210314 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f963004f980 con 0x7f9640066cd0 2024-08-17T02:48:46.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.524+0000 7f9646600640 1 -- 172.21.15.100:0/75210314 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96400ac150 con 0x7f9640066cd0 2024-08-17T02:48:46.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.525+0000 7f9636a00640 1 -- 172.21.15.100:0/75210314 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9630017070 con 0x7f9640066cd0 2024-08-17T02:48:46.526 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-08-17T02:48:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.527+0000 7f9646600640 1 -- 172.21.15.100:0/75210314 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9620065180 msgr2=0x7f9620067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.527+0000 7f9646600640 1 --2- 172.21.15.100:0/75210314 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9620065180 0x7f9620067630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f962c034000 tx=0x7f962c032000 comp rx=0 tx=0).stop 2024-08-17T02:48:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.527+0000 7f9646600640 1 -- 172.21.15.100:0/75210314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9640066cd0 msgr2=0x7f96401506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.527+0000 7f9646600640 1 --2- 172.21.15.100:0/75210314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9640066cd0 0x7f96401506d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f963000c4c0 tx=0x7f9630007ef0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.527+0000 7f9646600640 1 -- 172.21.15.100:0/75210314 shutdown_connections 2024-08-17T02:48:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.527+0000 7f9646600640 1 --2- 172.21.15.100:0/75210314 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9620065180 0x7f9620067630 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.527+0000 7f9646600640 1 --2- 172.21.15.100:0/75210314 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9640153320 0x7f964015ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.527+0000 7f9646600640 1 --2- 172.21.15.100:0/75210314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96400aede0 0x7f9640155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.527+0000 7f9646600640 1 --2- 172.21.15.100:0/75210314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9640066cd0 0x7f96401506d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.527+0000 7f9646600640 1 -- 172.21.15.100:0/75210314 >> 172.21.15.100:0/75210314 conn(0x7f964006d8b0 msgr2=0x7f9640151420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.527+0000 7f9646600640 1 -- 172.21.15.100:0/75210314 shutdown_connections 2024-08-17T02:48:46.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.527+0000 7f9646600640 1 -- 172.21.15.100:0/75210314 wait complete. 2024-08-17T02:48:46.544 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:48:46.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.693+0000 7fb6e5400640 1 Processor -- start 2024-08-17T02:48:46.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.693+0000 7fb6e5400640 1 -- start start 2024-08-17T02:48:46.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.694+0000 7fb6e5400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb6e0156c50 0x7fb6e00c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:46.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.694+0000 7fb6e5400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb6e00adcf0 0x7fb6e00ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:46.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.694+0000 7fb6e5400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6e00ab130 con 0x7fb6e00abb00 2024-08-17T02:48:46.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.694+0000 7fb6e5400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e00ae5a0 con 0x7fb6e0156c50 2024-08-17T02:48:46.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.694+0000 7fb6e5400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e00ae2c0 con 0x7fb6e00adcf0 2024-08-17T02:48:46.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.695+0000 7fb6dde00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb6e00adcf0 0x7fb6e00ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:46.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.695+0000 7fb6de800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb6e0156c50 0x7fb6e00c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:46.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.695+0000 7fb6de800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb6e0156c50 0x7fb6e00c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:50910/0 (socket says 172.21.15.100:50910) 2024-08-17T02:48:46.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.695+0000 7fb6de800640 1 -- 172.21.15.100:0/3476180029 learned_addr learned my addr 172.21.15.100:0/3476180029 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:46.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.695+0000 7fb6dde00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb6e00adcf0 0x7fb6e00ab5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:34396/0 (socket says 172.21.15.100:34396) 2024-08-17T02:48:46.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.695+0000 7fb6df200640 1 --1- 172.21.15.100:0/3476180029 >> v1:172.21.15.123:6789/0 conn(0x7fb6e00abb00 0x7fb6e00c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.100:37160/0 (socket says 172.21.15.100:37160) 2024-08-17T02:48:46.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.695+0000 7fb6de800640 1 -- 172.21.15.100:0/3476180029 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb6e00adcf0 msgr2=0x7fb6e00ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:46.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.695+0000 7fb6de800640 1 --2- 172.21.15.100:0/3476180029 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb6e00adcf0 0x7fb6e00ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.695+0000 7fb6de800640 1 -- 172.21.15.100:0/3476180029 >> v1:172.21.15.123:6789/0 conn(0x7fb6e00abb00 legacy=0x7fb6e00c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:46.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.695+0000 7fb6de800640 1 -- 172.21.15.100:0/3476180029 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e00aaae0 con 0x7fb6e0156c50 2024-08-17T02:48:46.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.695+0000 7fb6dd400640 1 -- 172.21.15.100:0/3476180029 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516413073 0 0) 0x7fb6e00ab130 con 0x7fb6e00abb00 2024-08-17T02:48:46.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.696+0000 7fb6de800640 1 --2- 172.21.15.100:0/3476180029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6e0156c50 0x7fb6e00c7cf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0009910 tx=0x7fb6d00091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3f16060881a0329 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:46.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.696+0000 7fb6dd400640 1 -- 172.21.15.100:0/3476180029 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d002adb0 con 0x7fb6e0156c50 2024-08-17T02:48:46.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.696+0000 7fb6dd400640 1 -- 172.21.15.100:0/3476180029 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d0032440 con 0x7fb6e0156c50 2024-08-17T02:48:46.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.697+0000 7fb6dd400640 1 -- 172.21.15.100:0/3476180029 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d00327e0 con 0x7fb6e0156c50 2024-08-17T02:48:46.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.697+0000 7fb6e5400640 1 -- 172.21.15.100:0/3476180029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6e0156c50 msgr2=0x7fb6e00c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:46.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.697+0000 7fb6e5400640 1 --2- 172.21.15.100:0/3476180029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6e0156c50 0x7fb6e00c7cf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0009910 tx=0x7fb6d00091d0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.697+0000 7fb6e5400640 1 -- 172.21.15.100:0/3476180029 shutdown_connections 2024-08-17T02:48:46.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.697+0000 7fb6e5400640 1 --2- 172.21.15.100:0/3476180029 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb6e00adcf0 0x7fb6e00ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.697+0000 7fb6e5400640 1 --2- 172.21.15.100:0/3476180029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6e0156c50 0x7fb6e00c7cf0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.697+0000 7fb6e5400640 1 -- 172.21.15.100:0/3476180029 >> 172.21.15.100:0/3476180029 conn(0x7fb6e0067750 msgr2=0x7fb6e00c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:46.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.697+0000 7fb6e5400640 1 -- 172.21.15.100:0/3476180029 shutdown_connections 2024-08-17T02:48:46.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.697+0000 7fb6e5400640 1 -- 172.21.15.100:0/3476180029 wait complete. 2024-08-17T02:48:46.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.698+0000 7fb6e5400640 1 Processor -- start 2024-08-17T02:48:46.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.699+0000 7fb6e5400640 1 -- start start 2024-08-17T02:48:46.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.699+0000 7fb6e5400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb6e00abb00 0x7fb6e0159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:46.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.699+0000 7fb6e5400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6e00adcf0 0x7fb6e014e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:46.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.699+0000 7fb6e5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6e0156c50 0x7fb6e014d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:46.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.699+0000 7fb6e5400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e01578a0 con 0x7fb6e0156c50 2024-08-17T02:48:46.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.699+0000 7fb6e5400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e014eb30 con 0x7fb6e00adcf0 2024-08-17T02:48:46.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.699+0000 7fb6e5400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e01558c0 con 0x7fb6e00abb00 2024-08-17T02:48:46.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.700+0000 7fb6df200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6e0156c50 0x7fb6e014d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:46.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.700+0000 7fb6de800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb6e00abb00 0x7fb6e0159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:46.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.700+0000 7fb6dde00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6e00adcf0 0x7fb6e014e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:46.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.700+0000 7fb6df200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6e0156c50 0x7fb6e014d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38524/0 (socket says 172.21.15.100:38524) 2024-08-17T02:48:46.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.700+0000 7fb6df200640 1 -- 172.21.15.100:0/3240180031 learned_addr learned my addr 172.21.15.100:0/3240180031 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:46.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.700+0000 7fb6de800640 1 --2- 172.21.15.100:0/3240180031 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb6e00abb00 0x7fb6e0159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:34402/0 (socket says 172.21.15.100:34402) 2024-08-17T02:48:46.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.700+0000 7fb6df200640 1 -- 172.21.15.100:0/3240180031 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb6e00abb00 msgr2=0x7fb6e0159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:46.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.700+0000 7fb6df200640 1 --2- 172.21.15.100:0/3240180031 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb6e00abb00 0x7fb6e0159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.700+0000 7fb6df200640 1 -- 172.21.15.100:0/3240180031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6e00adcf0 msgr2=0x7fb6e014e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:46.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.700+0000 7fb6df200640 1 --2- 172.21.15.100:0/3240180031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6e00adcf0 0x7fb6e014e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.700+0000 7fb6df200640 1 -- 172.21.15.100:0/3240180031 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d0009450 con 0x7fb6e0156c50 2024-08-17T02:48:46.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.700+0000 7fb6de800640 1 --2- 172.21.15.100:0/3240180031 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb6e00abb00 0x7fb6e0159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:48:46.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.701+0000 7fb6df200640 1 --2- 172.21.15.100:0/3240180031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6e0156c50 0x7fb6e014d550 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800c890 tx=0x7fb6d8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:46.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.701+0000 7fb6d6000640 1 -- 172.21.15.100:0/3240180031 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d800ce80 con 0x7fb6e0156c50 2024-08-17T02:48:46.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.701+0000 7fb6d6000640 1 -- 172.21.15.100:0/3240180031 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d8005d60 con 0x7fb6e0156c50 2024-08-17T02:48:46.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.701+0000 7fb6e5400640 1 -- 172.21.15.100:0/3240180031 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e0155ba0 con 0x7fb6e0156c50 2024-08-17T02:48:46.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.701+0000 7fb6d6000640 1 -- 172.21.15.100:0/3240180031 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d800a870 con 0x7fb6e0156c50 2024-08-17T02:48:46.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.701+0000 7fb6e5400640 1 -- 172.21.15.100:0/3240180031 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e0157530 con 0x7fb6e0156c50 2024-08-17T02:48:46.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.702+0000 7fb6e5400640 1 -- 172.21.15.100:0/3240180031 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e0157a50 con 0x7fb6e0156c50 2024-08-17T02:48:46.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.703+0000 7fb6d6000640 1 -- 172.21.15.100:0/3240180031 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb6d800aca0 con 0x7fb6e0156c50 2024-08-17T02:48:46.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.704+0000 7fb6d6000640 1 --2- 172.21.15.100:0/3240180031 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb6c0065150 0x7fb6c0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:46.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.704+0000 7fb6d6000640 1 -- 172.21.15.100:0/3240180031 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fb6d8082470 con 0x7fb6e0156c50 2024-08-17T02:48:46.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.704+0000 7fb6de800640 1 --2- 172.21.15.100:0/3240180031 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb6c0065150 0x7fb6c0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:46.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.705+0000 7fb6de800640 1 --2- 172.21.15.100:0/3240180031 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb6c0065150 0x7fb6c0067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0034000 tx=0x7fb6d0032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:46.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.708+0000 7fb6d6000640 1 -- 172.21.15.100:0/3240180031 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb6e0157a50 con 0x7fb6e0156c50 2024-08-17T02:48:46.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.884+0000 7fb6e5400640 1 -- 172.21.15.100:0/3240180031 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb6e0071050 con 0x7fb6e0156c50 2024-08-17T02:48:46.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.884+0000 7fb6d6000640 1 -- 172.21.15.100:0/3240180031 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb6d8050240 con 0x7fb6e0156c50 2024-08-17T02:48:46.886 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-08-17T02:48:46.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.886+0000 7fb6e5400640 1 -- 172.21.15.100:0/3240180031 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb6c0065150 msgr2=0x7fb6c0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:46.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.886+0000 7fb6e5400640 1 --2- 172.21.15.100:0/3240180031 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb6c0065150 0x7fb6c0067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0034000 tx=0x7fb6d0032000 comp rx=0 tx=0).stop 2024-08-17T02:48:46.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.886+0000 7fb6e5400640 1 -- 172.21.15.100:0/3240180031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6e0156c50 msgr2=0x7fb6e014d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:46.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.886+0000 7fb6e5400640 1 --2- 172.21.15.100:0/3240180031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6e0156c50 0x7fb6e014d550 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800c890 tx=0x7fb6d8007f90 comp rx=0 tx=0).stop 2024-08-17T02:48:46.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.886+0000 7fb6e5400640 1 -- 172.21.15.100:0/3240180031 shutdown_connections 2024-08-17T02:48:46.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.886+0000 7fb6e5400640 1 --2- 172.21.15.100:0/3240180031 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb6c0065150 0x7fb6c0067600 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.886+0000 7fb6e5400640 1 --2- 172.21.15.100:0/3240180031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6e0156c50 0x7fb6e014d550 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.886+0000 7fb6e5400640 1 --2- 172.21.15.100:0/3240180031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6e00adcf0 0x7fb6e014e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.886+0000 7fb6e5400640 1 --2- 172.21.15.100:0/3240180031 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb6e00abb00 0x7fb6e0159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:46.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.886+0000 7fb6e5400640 1 -- 172.21.15.100:0/3240180031 >> 172.21.15.100:0/3240180031 conn(0x7fb6e0067750 msgr2=0x7fb6e0153300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:46.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.886+0000 7fb6e5400640 1 -- 172.21.15.100:0/3240180031 shutdown_connections 2024-08-17T02:48:46.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:46.886+0000 7fb6e5400640 1 -- 172.21.15.100:0/3240180031 wait complete. 2024-08-17T02:48:46.903 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:48:47.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.052+0000 7f02e2c00640 1 Processor -- start 2024-08-17T02:48:47.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.052+0000 7f02e2c00640 1 -- start start 2024-08-17T02:48:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.053+0000 7f02e2c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f02dc158da0 0x7f02dc0ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.053+0000 7f02e2c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f02dc159170 0x7f02dc0aa810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.053+0000 7f02e2c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02dc0681f0 con 0x7f02dc0aad50 2024-08-17T02:48:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.053+0000 7f02e2c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02dc0ab1a0 con 0x7f02dc158da0 2024-08-17T02:48:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.053+0000 7f02e2c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02dc0b08c0 con 0x7f02dc159170 2024-08-17T02:48:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.053+0000 7f02dbe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f02dc158da0 0x7f02dc0ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.054+0000 7f02dbe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f02dc158da0 0x7f02dc0ac3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37962/0 (socket says 172.21.15.100:37962) 2024-08-17T02:48:47.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.054+0000 7f02dbe00640 1 -- 172.21.15.100:0/1862856404 learned_addr learned my addr 172.21.15.100:0/1862856404 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:47.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.054+0000 7f02dbe00640 1 -- 172.21.15.100:0/1862856404 >> v2:172.21.15.123:3300/0 conn(0x7f02dc159170 msgr2=0x7f02dc0aa810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:47.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.054+0000 7f02dbe00640 1 --2- 172.21.15.100:0/1862856404 >> v2:172.21.15.123:3300/0 conn(0x7f02dc159170 0x7f02dc0aa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.054+0000 7f02dbe00640 1 -- 172.21.15.100:0/1862856404 >> v1:172.21.15.123:6789/0 conn(0x7f02dc0aad50 legacy=0x7f02dc068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:47.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.054+0000 7f02dbe00640 1 -- 172.21.15.100:0/1862856404 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc0aca00 con 0x7f02dc158da0 2024-08-17T02:48:47.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.055+0000 7f02dbe00640 1 --2- 172.21.15.100:0/1862856404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02dc158da0 0x7f02dc0ac3e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f02dc06d770 tx=0x7f02cc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303329a29d18e536 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:47.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.055+0000 7f02daa00640 1 -- 172.21.15.100:0/1862856404 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc02ad40 con 0x7f02dc158da0 2024-08-17T02:48:47.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.055+0000 7f02daa00640 1 -- 172.21.15.100:0/1862856404 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc032440 con 0x7f02dc158da0 2024-08-17T02:48:47.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.055+0000 7f02daa00640 1 -- 172.21.15.100:0/1862856404 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc02aea0 con 0x7f02dc158da0 2024-08-17T02:48:47.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.056+0000 7f02e2c00640 1 -- 172.21.15.100:0/1862856404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02dc158da0 msgr2=0x7f02dc0ac3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:47.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.056+0000 7f02e2c00640 1 --2- 172.21.15.100:0/1862856404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02dc158da0 0x7f02dc0ac3e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f02dc06d770 tx=0x7f02cc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.056+0000 7f02e2c00640 1 -- 172.21.15.100:0/1862856404 shutdown_connections 2024-08-17T02:48:47.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.056+0000 7f02e2c00640 1 --2- 172.21.15.100:0/1862856404 >> v2:172.21.15.123:3300/0 conn(0x7f02dc159170 0x7f02dc0aa810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.056+0000 7f02e2c00640 1 --2- 172.21.15.100:0/1862856404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02dc158da0 0x7f02dc0ac3e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.056+0000 7f02e2c00640 1 -- 172.21.15.100:0/1862856404 >> 172.21.15.100:0/1862856404 conn(0x7f02dc096a70 msgr2=0x7f02dc096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:47.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.056+0000 7f02e2c00640 1 -- 172.21.15.100:0/1862856404 shutdown_connections 2024-08-17T02:48:47.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.056+0000 7f02e2c00640 1 -- 172.21.15.100:0/1862856404 wait complete. 2024-08-17T02:48:47.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.057+0000 7f02e2c00640 1 Processor -- start 2024-08-17T02:48:47.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.057+0000 7f02e2c00640 1 -- start start 2024-08-17T02:48:47.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.058+0000 7f02e2c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02dc0aad50 0x7f02dc0c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:47.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.058+0000 7f02e2c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f02dc158da0 0x7f02dc099360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:47.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.058+0000 7f02e2c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02dc0998a0 0x7f02dc153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:47.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.058+0000 7f02e2c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc098c50 con 0x7f02dc0998a0 2024-08-17T02:48:47.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.058+0000 7f02e2c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0c94d0 con 0x7f02dc0aad50 2024-08-17T02:48:47.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.058+0000 7f02e2c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc098320 con 0x7f02dc158da0 2024-08-17T02:48:47.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.059+0000 7f02e0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02dc0998a0 0x7f02dc153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:47.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.059+0000 7f02e0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02dc0998a0 0x7f02dc153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37978/0 (socket says 172.21.15.100:37978) 2024-08-17T02:48:47.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.059+0000 7f02e0c00640 1 -- 172.21.15.100:0/3943403480 learned_addr learned my addr 172.21.15.100:0/3943403480 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:47.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.059+0000 7f02db400640 1 --2- 172.21.15.100:0/3943403480 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f02dc158da0 0x7f02dc099360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:47.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.059+0000 7f02e0c00640 1 -- 172.21.15.100:0/3943403480 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f02dc158da0 msgr2=0x7f02dc099360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:47.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.059+0000 7f02dbe00640 1 --2- 172.21.15.100:0/3943403480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02dc0aad50 0x7f02dc0c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:47.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.059+0000 7f02e0c00640 1 --2- 172.21.15.100:0/3943403480 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f02dc158da0 0x7f02dc099360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.059+0000 7f02e0c00640 1 -- 172.21.15.100:0/3943403480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02dc0aad50 msgr2=0x7f02dc0c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:47.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.059+0000 7f02e0c00640 1 --2- 172.21.15.100:0/3943403480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02dc0aad50 0x7f02dc0c9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.059+0000 7f02e0c00640 1 -- 172.21.15.100:0/3943403480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02cc009450 con 0x7f02dc0998a0 2024-08-17T02:48:47.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.059+0000 7f02dbe00640 1 --2- 172.21.15.100:0/3943403480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02dc0aad50 0x7f02dc0c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:48:47.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.059+0000 7f02e0c00640 1 --2- 172.21.15.100:0/3943403480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02dc0998a0 0x7f02dc153490 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f02d400b8c0 tx=0x7f02d40093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:47.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.060+0000 7f02d3400640 1 -- 172.21.15.100:0/3943403480 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d400c860 con 0x7f02dc0998a0 2024-08-17T02:48:47.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.060+0000 7f02d3400640 1 -- 172.21.15.100:0/3943403480 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d400c040 con 0x7f02dc0998a0 2024-08-17T02:48:47.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.060+0000 7f02d3400640 1 -- 172.21.15.100:0/3943403480 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d400cc10 con 0x7f02dc0998a0 2024-08-17T02:48:47.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.060+0000 7f02e2c00640 1 -- 172.21.15.100:0/3943403480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02dc098600 con 0x7f02dc0998a0 2024-08-17T02:48:47.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.060+0000 7f02e2c00640 1 -- 172.21.15.100:0/3943403480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02dc0c9d90 con 0x7f02dc0998a0 2024-08-17T02:48:47.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.061+0000 7f02e2c00640 1 -- 172.21.15.100:0/3943403480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02dc098e00 con 0x7f02dc0998a0 2024-08-17T02:48:47.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.062+0000 7f02d3400640 1 -- 172.21.15.100:0/3943403480 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f02d4014620 con 0x7f02dc0998a0 2024-08-17T02:48:47.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.062+0000 7f02d3400640 1 --2- 172.21.15.100:0/3943403480 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f02bc065150 0x7f02bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:47.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.062+0000 7f02d3400640 1 -- 172.21.15.100:0/3943403480 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f02d40821e0 con 0x7f02dc0998a0 2024-08-17T02:48:47.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.063+0000 7f02dbe00640 1 --2- 172.21.15.100:0/3943403480 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f02bc065150 0x7f02bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:47.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.063+0000 7f02dbe00640 1 --2- 172.21.15.100:0/3943403480 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f02bc065150 0x7f02bc067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f02cc034000 tx=0x7f02cc032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:47.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.066+0000 7f02d3400640 1 -- 172.21.15.100:0/3943403480 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f02d404ce40 con 0x7f02dc0998a0 2024-08-17T02:48:47.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.239+0000 7f02e2c00640 1 -- 172.21.15.100:0/3943403480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f02dc071050 con 0x7f02dc0998a0 2024-08-17T02:48:47.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.240+0000 7f02d3400640 1 -- 172.21.15.100:0/3943403480 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f02dc098e00 con 0x7f02dc0998a0 2024-08-17T02:48:47.241 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-08-17T02:48:47.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.242+0000 7f02e2c00640 1 -- 172.21.15.100:0/3943403480 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f02bc065150 msgr2=0x7f02bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:47.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.242+0000 7f02e2c00640 1 --2- 172.21.15.100:0/3943403480 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f02bc065150 0x7f02bc067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f02cc034000 tx=0x7f02cc032000 comp rx=0 tx=0).stop 2024-08-17T02:48:47.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.242+0000 7f02e2c00640 1 -- 172.21.15.100:0/3943403480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02dc0998a0 msgr2=0x7f02dc153490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:47.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.242+0000 7f02e2c00640 1 --2- 172.21.15.100:0/3943403480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02dc0998a0 0x7f02dc153490 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f02d400b8c0 tx=0x7f02d40093e0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.242+0000 7f02e2c00640 1 -- 172.21.15.100:0/3943403480 shutdown_connections 2024-08-17T02:48:47.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.242+0000 7f02e2c00640 1 --2- 172.21.15.100:0/3943403480 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f02bc065150 0x7f02bc067600 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.242+0000 7f02e2c00640 1 --2- 172.21.15.100:0/3943403480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02dc0998a0 0x7f02dc153490 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.242+0000 7f02e2c00640 1 --2- 172.21.15.100:0/3943403480 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f02dc158da0 0x7f02dc099360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.242+0000 7f02e2c00640 1 --2- 172.21.15.100:0/3943403480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02dc0aad50 0x7f02dc0c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.242+0000 7f02e2c00640 1 -- 172.21.15.100:0/3943403480 >> 172.21.15.100:0/3943403480 conn(0x7f02dc096a70 msgr2=0x7f02dc157fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:47.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.242+0000 7f02e2c00640 1 -- 172.21.15.100:0/3943403480 shutdown_connections 2024-08-17T02:48:47.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.242+0000 7f02e2c00640 1 -- 172.21.15.100:0/3943403480 wait complete. 2024-08-17T02:48:47.259 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001028572.meta pg_num 2024-08-17T02:48:47.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.408+0000 7f5eaec00640 1 Processor -- start 2024-08-17T02:48:47.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.408+0000 7f5eaec00640 1 -- start start 2024-08-17T02:48:47.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.410+0000 7f5eaec00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5ea80abef0 0x7f5ea80accd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:47.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.410+0000 7f5eaec00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ea80ad210 0x7f5ea806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:47.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.410+0000 7f5eaec00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ea806d930 0x7f5ea815a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:47.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.410+0000 7f5eaec00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea8156e60 con 0x7f5ea806d930 2024-08-17T02:48:47.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.410+0000 7f5eaec00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea80c95e0 con 0x7f5ea80abef0 2024-08-17T02:48:47.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.410+0000 7f5eaec00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80ad660 con 0x7f5ea80ad210 2024-08-17T02:48:47.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.410+0000 7f5eae200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ea806d930 0x7f5ea815a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:47.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.410+0000 7f5eae200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ea806d930 0x7f5ea815a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37990/0 (socket says 172.21.15.100:37990) 2024-08-17T02:48:47.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.410+0000 7f5eae200640 1 -- 172.21.15.100:0/2426726480 learned_addr learned my addr 172.21.15.100:0/2426726480 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:47.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.410+0000 7f5eae200640 1 -- 172.21.15.100:0/2426726480 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ea80ad210 msgr2=0x7f5ea806d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:47.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.410+0000 7f5eae200640 1 --2- 172.21.15.100:0/2426726480 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ea80ad210 0x7f5ea806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.410+0000 7f5eae200640 1 -- 172.21.15.100:0/2426726480 >> v2:172.21.15.123:3300/0 conn(0x7f5ea80abef0 msgr2=0x7f5ea80accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:47.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.410+0000 7f5ead800640 1 --2- 172.21.15.100:0/2426726480 >> v2:172.21.15.123:3300/0 conn(0x7f5ea80abef0 0x7f5ea80accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:47.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.410+0000 7f5eae200640 1 --2- 172.21.15.100:0/2426726480 >> v2:172.21.15.123:3300/0 conn(0x7f5ea80abef0 0x7f5ea80accd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.410+0000 7f5eae200640 1 -- 172.21.15.100:0/2426726480 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea80ac2c0 con 0x7f5ea806d930 2024-08-17T02:48:47.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.410+0000 7f5ead800640 1 --2- 172.21.15.100:0/2426726480 >> v2:172.21.15.123:3300/0 conn(0x7f5ea80abef0 0x7f5ea80accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:48:47.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.411+0000 7f5eae200640 1 --2- 172.21.15.100:0/2426726480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ea806d930 0x7f5ea815a5a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5ea806a5b0 tx=0x7f5ea0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee04f4f356e0366 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:47.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.412+0000 7f5ea7e00640 1 -- 172.21.15.100:0/2426726480 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0031400 con 0x7f5ea806d930 2024-08-17T02:48:47.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.412+0000 7f5ea7e00640 1 -- 172.21.15.100:0/2426726480 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea002d050 con 0x7f5ea806d930 2024-08-17T02:48:47.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.412+0000 7f5ea7e00640 1 -- 172.21.15.100:0/2426726480 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00317d0 con 0x7f5ea806d930 2024-08-17T02:48:47.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.412+0000 7f5eaec00640 1 -- 172.21.15.100:0/2426726480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ea806d930 msgr2=0x7f5ea815a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:47.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.412+0000 7f5eaec00640 1 --2- 172.21.15.100:0/2426726480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ea806d930 0x7f5ea815a5a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5ea806a5b0 tx=0x7f5ea0009840 comp rx=0 tx=0).stop 2024-08-17T02:48:47.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.412+0000 7f5eaec00640 1 -- 172.21.15.100:0/2426726480 shutdown_connections 2024-08-17T02:48:47.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.412+0000 7f5eaec00640 1 --2- 172.21.15.100:0/2426726480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ea806d930 0x7f5ea815a5a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.412+0000 7f5eaec00640 1 --2- 172.21.15.100:0/2426726480 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ea80ad210 0x7f5ea806d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.412+0000 7f5eaec00640 1 --2- 172.21.15.100:0/2426726480 >> v2:172.21.15.123:3300/0 conn(0x7f5ea80abef0 0x7f5ea80accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.412+0000 7f5eaec00640 1 -- 172.21.15.100:0/2426726480 >> 172.21.15.100:0/2426726480 conn(0x7f5ea8066cd0 msgr2=0x7f5ea80670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:47.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.412+0000 7f5eaec00640 1 -- 172.21.15.100:0/2426726480 shutdown_connections 2024-08-17T02:48:47.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.412+0000 7f5eaec00640 1 -- 172.21.15.100:0/2426726480 wait complete. 2024-08-17T02:48:47.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.414+0000 7f5eaec00640 1 Processor -- start 2024-08-17T02:48:47.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.414+0000 7f5eaec00640 1 -- start start 2024-08-17T02:48:47.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.415+0000 7f5eaec00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ea806d930 0x7f5ea8169470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:47.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.415+0000 7f5eaec00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ea80abef0 0x7f5ea814d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:47.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.415+0000 7f5eaec00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ea80ad210 0x7f5ea80ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:47.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.415+0000 7f5eaec00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80aed90 con 0x7f5ea80abef0 2024-08-17T02:48:47.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.415+0000 7f5eaec00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea816a640 con 0x7f5ea80ad210 2024-08-17T02:48:47.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.415+0000 7f5eaec00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea8169ac0 con 0x7f5ea806d930 2024-08-17T02:48:47.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.415+0000 7f5eace00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ea80abef0 0x7f5ea814d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:47.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.415+0000 7f5eace00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ea80abef0 0x7f5ea814d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37996/0 (socket says 172.21.15.100:37996) 2024-08-17T02:48:47.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.415+0000 7f5eace00640 1 -- 172.21.15.100:0/999737443 learned_addr learned my addr 172.21.15.100:0/999737443 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:47.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.415+0000 7f5ead800640 1 --2- 172.21.15.100:0/999737443 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ea806d930 0x7f5ea8169470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:47.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.415+0000 7f5eae200640 1 --2- 172.21.15.100:0/999737443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ea80ad210 0x7f5ea80ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:47.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.415+0000 7f5eace00640 1 -- 172.21.15.100:0/999737443 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ea806d930 msgr2=0x7f5ea8169470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:47.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.415+0000 7f5eace00640 1 --2- 172.21.15.100:0/999737443 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ea806d930 0x7f5ea8169470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.415+0000 7f5eace00640 1 -- 172.21.15.100:0/999737443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ea80ad210 msgr2=0x7f5ea80ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:47.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.415+0000 7f5eace00640 1 --2- 172.21.15.100:0/999737443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ea80ad210 0x7f5ea80ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.415+0000 7f5eace00640 1 -- 172.21.15.100:0/999737443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea0009ae0 con 0x7f5ea80abef0 2024-08-17T02:48:47.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.415+0000 7f5ead800640 1 --2- 172.21.15.100:0/999737443 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ea806d930 0x7f5ea8169470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:48:47.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.416+0000 7f5eace00640 1 --2- 172.21.15.100:0/999737443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ea80abef0 0x7f5ea814d450 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400b5e0 tx=0x7f5e94009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:47.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.416+0000 7f5ea4c00640 1 -- 172.21.15.100:0/999737443 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9400f590 con 0x7f5ea80abef0 2024-08-17T02:48:47.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.416+0000 7f5ea4c00640 1 -- 172.21.15.100:0/999737443 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9400f6f0 con 0x7f5ea80abef0 2024-08-17T02:48:47.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.416+0000 7f5ea4c00640 1 -- 172.21.15.100:0/999737443 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9400fab0 con 0x7f5ea80abef0 2024-08-17T02:48:47.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.416+0000 7f5eaec00640 1 -- 172.21.15.100:0/999737443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea8169da0 con 0x7f5ea80abef0 2024-08-17T02:48:47.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.416+0000 7f5eaec00640 1 -- 172.21.15.100:0/999737443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea816a360 con 0x7f5ea80abef0 2024-08-17T02:48:47.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.417+0000 7f5eaec00640 1 -- 172.21.15.100:0/999737443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea8071050 con 0x7f5ea80abef0 2024-08-17T02:48:47.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.418+0000 7f5ea4c00640 1 -- 172.21.15.100:0/999737443 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5e9401a460 con 0x7f5ea80abef0 2024-08-17T02:48:47.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.419+0000 7f5ea4c00640 1 --2- 172.21.15.100:0/999737443 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5e88065150 0x7f5e88067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:47.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.419+0000 7f5ea4c00640 1 -- 172.21.15.100:0/999737443 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f5e94082510 con 0x7f5ea80abef0 2024-08-17T02:48:47.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.419+0000 7f5ead800640 1 --2- 172.21.15.100:0/999737443 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5e88065150 0x7f5e88067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:47.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.419+0000 7f5ead800640 1 --2- 172.21.15.100:0/999737443 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5e88065150 0x7f5e88067600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00ab50 tx=0x7f5e9c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:47.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.422+0000 7f5ea4c00640 1 -- 172.21.15.100:0/999737443 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5e94050230 con 0x7f5ea80abef0 2024-08-17T02:48:47.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.592+0000 7f5eaec00640 1 -- 172.21.15.100:0/999737443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001028572.meta", "var": "pg_num"} v 0) v1 -- 0x7f5ea80ad950 con 0x7f5ea80abef0 2024-08-17T02:48:47.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.593+0000 7f5ea4c00640 1 -- 172.21.15.100:0/999737443 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001028572.meta", "var": "pg_num"}]=0 v38) v1 ==== 124+0+11 (secure 0 0 0) 0x7f5e94053850 con 0x7f5ea80abef0 2024-08-17T02:48:47.595 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-08-17T02:48:47.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.595+0000 7f5eaec00640 1 -- 172.21.15.100:0/999737443 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5e88065150 msgr2=0x7f5e88067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:47.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.595+0000 7f5eaec00640 1 --2- 172.21.15.100:0/999737443 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5e88065150 0x7f5e88067600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00ab50 tx=0x7f5e9c008040 comp rx=0 tx=0).stop 2024-08-17T02:48:47.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.595+0000 7f5eaec00640 1 -- 172.21.15.100:0/999737443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ea80abef0 msgr2=0x7f5ea814d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:47.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.595+0000 7f5eaec00640 1 --2- 172.21.15.100:0/999737443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ea80abef0 0x7f5ea814d450 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400b5e0 tx=0x7f5e94009120 comp rx=0 tx=0).stop 2024-08-17T02:48:47.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.595+0000 7f5eaec00640 1 -- 172.21.15.100:0/999737443 shutdown_connections 2024-08-17T02:48:47.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.595+0000 7f5eaec00640 1 --2- 172.21.15.100:0/999737443 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5e88065150 0x7f5e88067600 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.595+0000 7f5eaec00640 1 --2- 172.21.15.100:0/999737443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ea80ad210 0x7f5ea80ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.595+0000 7f5eaec00640 1 --2- 172.21.15.100:0/999737443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ea80abef0 0x7f5ea814d450 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.595+0000 7f5eaec00640 1 --2- 172.21.15.100:0/999737443 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ea806d930 0x7f5ea8169470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.595+0000 7f5eaec00640 1 -- 172.21.15.100:0/999737443 >> 172.21.15.100:0/999737443 conn(0x7f5ea8066cd0 msgr2=0x7f5ea8069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:47.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.595+0000 7f5eaec00640 1 -- 172.21.15.100:0/999737443 shutdown_connections 2024-08-17T02:48:47.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.595+0000 7f5eaec00640 1 -- 172.21.15.100:0/999737443 wait complete. 2024-08-17T02:48:47.611 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001028572.data pg_num 2024-08-17T02:48:47.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.760+0000 7fb3e3a00640 1 Processor -- start 2024-08-17T02:48:47.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.760+0000 7fb3e3a00640 1 -- start start 2024-08-17T02:48:47.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.761+0000 7fb3e3a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb3dc155a80 0x7fb3dc06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:47.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.761+0000 7fb3e3a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3dc0c7db0 0x7fb3dc0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:47.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.761+0000 7fb3e3a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc1598f0 con 0x7fb3dc155e50 2024-08-17T02:48:47.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.761+0000 7fb3e3a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc159bd0 con 0x7fb3dc155a80 2024-08-17T02:48:47.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.761+0000 7fb3e3a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc159eb0 con 0x7fb3dc0c7db0 2024-08-17T02:48:47.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.761+0000 7fb3e1000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb3dc155a80 0x7fb3dc06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:47.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.762+0000 7fb3e1000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb3dc155a80 0x7fb3dc06dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38012/0 (socket says 172.21.15.100:38012) 2024-08-17T02:48:47.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.762+0000 7fb3e1000640 1 -- 172.21.15.100:0/1600934591 learned_addr learned my addr 172.21.15.100:0/1600934591 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:47.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.762+0000 7fb3dbe00640 1 --2- 172.21.15.100:0/1600934591 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3dc0c7db0 0x7fb3dc0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:47.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.762+0000 7fb3e1000640 1 -- 172.21.15.100:0/1600934591 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3dc0c7db0 msgr2=0x7fb3dc0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:47.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.762+0000 7fb3e1000640 1 --2- 172.21.15.100:0/1600934591 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3dc0c7db0 0x7fb3dc0c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.762+0000 7fb3e1000640 1 -- 172.21.15.100:0/1600934591 >> v1:172.21.15.100:6789/0 conn(0x7fb3dc155e50 legacy=0x7fb3dc06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:47.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.762+0000 7fb3e1000640 1 -- 172.21.15.100:0/1600934591 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc15a190 con 0x7fb3dc155a80 2024-08-17T02:48:47.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.763+0000 7fb3e1000640 1 --2- 172.21.15.100:0/1600934591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3dc155a80 0x7fb3dc06dc00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0009910 tx=0x7fb3d00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8e0d4385dbce4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:47.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.763+0000 7fb3db400640 1 -- 172.21.15.100:0/1600934591 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d002ae40 con 0x7fb3dc155a80 2024-08-17T02:48:47.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.763+0000 7fb3db400640 1 -- 172.21.15.100:0/1600934591 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d0032440 con 0x7fb3dc155a80 2024-08-17T02:48:47.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.763+0000 7fb3db400640 1 -- 172.21.15.100:0/1600934591 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0032820 con 0x7fb3dc155a80 2024-08-17T02:48:47.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.764+0000 7fb3e3a00640 1 -- 172.21.15.100:0/1600934591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3dc155a80 msgr2=0x7fb3dc06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:47.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.764+0000 7fb3e3a00640 1 --2- 172.21.15.100:0/1600934591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3dc155a80 0x7fb3dc06dc00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0009910 tx=0x7fb3d00091d0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.764+0000 7fb3e3a00640 1 -- 172.21.15.100:0/1600934591 shutdown_connections 2024-08-17T02:48:47.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.764+0000 7fb3e3a00640 1 --2- 172.21.15.100:0/1600934591 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3dc0c7db0 0x7fb3dc0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.764+0000 7fb3e3a00640 1 --2- 172.21.15.100:0/1600934591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3dc155a80 0x7fb3dc06dc00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.764+0000 7fb3e3a00640 1 -- 172.21.15.100:0/1600934591 >> 172.21.15.100:0/1600934591 conn(0x7fb3dc067750 msgr2=0x7fb3dc0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:47.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.764+0000 7fb3e3a00640 1 -- 172.21.15.100:0/1600934591 shutdown_connections 2024-08-17T02:48:47.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.764+0000 7fb3e3a00640 1 -- 172.21.15.100:0/1600934591 wait complete. 2024-08-17T02:48:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.765+0000 7fb3e3a00640 1 Processor -- start 2024-08-17T02:48:47.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.766+0000 7fb3e3a00640 1 -- start start 2024-08-17T02:48:47.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.766+0000 7fb3e3a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3dc0c7db0 0x7fb3dc1412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:47.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.766+0000 7fb3e3a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3dc155a80 0x7fb3dc0ac110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:47.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.766+0000 7fb3e3a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3dc155e50 0x7fb3dc0a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:47.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.766+0000 7fb3e3a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc156340 con 0x7fb3dc155a80 2024-08-17T02:48:47.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.766+0000 7fb3e3a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc14b670 con 0x7fb3dc155e50 2024-08-17T02:48:47.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.766+0000 7fb3e3a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0acbd0 con 0x7fb3dc0c7db0 2024-08-17T02:48:47.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.767+0000 7fb3dbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3dc155a80 0x7fb3dc0ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:47.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.767+0000 7fb3dbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3dc155a80 0x7fb3dc0ac110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38016/0 (socket says 172.21.15.100:38016) 2024-08-17T02:48:47.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.767+0000 7fb3dbe00640 1 -- 172.21.15.100:0/1910563641 learned_addr learned my addr 172.21.15.100:0/1910563641 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:47.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.767+0000 7fb3e1000640 1 --2- 172.21.15.100:0/1910563641 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3dc0c7db0 0x7fb3dc1412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:47.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.767+0000 7fb3e1a00640 1 --2- 172.21.15.100:0/1910563641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3dc155e50 0x7fb3dc0a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:47.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.767+0000 7fb3dbe00640 1 -- 172.21.15.100:0/1910563641 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3dc0c7db0 msgr2=0x7fb3dc1412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:47.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.767+0000 7fb3dbe00640 1 --2- 172.21.15.100:0/1910563641 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3dc0c7db0 0x7fb3dc1412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.767+0000 7fb3dbe00640 1 -- 172.21.15.100:0/1910563641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3dc155e50 msgr2=0x7fb3dc0a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:47.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.767+0000 7fb3dbe00640 1 --2- 172.21.15.100:0/1910563641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3dc155e50 0x7fb3dc0a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.767+0000 7fb3dbe00640 1 -- 172.21.15.100:0/1910563641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d0009450 con 0x7fb3dc155a80 2024-08-17T02:48:47.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.767+0000 7fb3dbe00640 1 --2- 172.21.15.100:0/1910563641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3dc155a80 0x7fb3dc0ac110 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb3c800e900 tx=0x7fb3c80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:47.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.768+0000 7fb3cfe00640 1 -- 172.21.15.100:0/1910563641 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c800c8e0 con 0x7fb3dc155a80 2024-08-17T02:48:47.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.768+0000 7fb3cfe00640 1 -- 172.21.15.100:0/1910563641 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c800ca40 con 0x7fb3dc155a80 2024-08-17T02:48:47.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.768+0000 7fb3cfe00640 1 -- 172.21.15.100:0/1910563641 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c800cde0 con 0x7fb3dc155a80 2024-08-17T02:48:47.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.768+0000 7fb3e3a00640 1 -- 172.21.15.100:0/1910563641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc0aceb0 con 0x7fb3dc155a80 2024-08-17T02:48:47.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.768+0000 7fb3e3a00640 1 -- 172.21.15.100:0/1910563641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc156830 con 0x7fb3dc155a80 2024-08-17T02:48:47.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.769+0000 7fb3e3a00640 1 -- 172.21.15.100:0/1910563641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc071050 con 0x7fb3dc155a80 2024-08-17T02:48:47.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.770+0000 7fb3cfe00640 1 -- 172.21.15.100:0/1910563641 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb3c8013680 con 0x7fb3dc155a80 2024-08-17T02:48:47.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.770+0000 7fb3cfe00640 1 --2- 172.21.15.100:0/1910563641 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb3bc065150 0x7fb3bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:47.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.770+0000 7fb3cfe00640 1 -- 172.21.15.100:0/1910563641 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fb3c8082920 con 0x7fb3dc155a80 2024-08-17T02:48:47.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.771+0000 7fb3e1000640 1 --2- 172.21.15.100:0/1910563641 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb3bc065150 0x7fb3bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:47.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.771+0000 7fb3e1000640 1 --2- 172.21.15.100:0/1910563641 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb3bc065150 0x7fb3bc067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0034000 tx=0x7fb3d0032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:47.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.775+0000 7fb3cfe00640 1 -- 172.21.15.100:0/1910563641 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb3c8050730 con 0x7fb3dc155a80 2024-08-17T02:48:47.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.947+0000 7fb3e3a00640 1 -- 172.21.15.100:0/1910563641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001028572.data", "var": "pg_num"} v 0) v1 -- 0x7fb3dc0cb6d0 con 0x7fb3dc155a80 2024-08-17T02:48:47.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.947+0000 7fb3cfe00640 1 -- 172.21.15.100:0/1910563641 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001028572.data", "var": "pg_num"}]=0 v38) v1 ==== 124+0+11 (secure 0 0 0) 0x7fb3c8053d50 con 0x7fb3dc155a80 2024-08-17T02:48:47.949 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-08-17T02:48:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.949+0000 7fb3e3a00640 1 -- 172.21.15.100:0/1910563641 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb3bc065150 msgr2=0x7fb3bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.949+0000 7fb3e3a00640 1 --2- 172.21.15.100:0/1910563641 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb3bc065150 0x7fb3bc067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0034000 tx=0x7fb3d0032000 comp rx=0 tx=0).stop 2024-08-17T02:48:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.949+0000 7fb3e3a00640 1 -- 172.21.15.100:0/1910563641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3dc155a80 msgr2=0x7fb3dc0ac110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.949+0000 7fb3e3a00640 1 --2- 172.21.15.100:0/1910563641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3dc155a80 0x7fb3dc0ac110 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb3c800e900 tx=0x7fb3c80090f0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.949+0000 7fb3e3a00640 1 -- 172.21.15.100:0/1910563641 shutdown_connections 2024-08-17T02:48:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.949+0000 7fb3e3a00640 1 --2- 172.21.15.100:0/1910563641 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb3bc065150 0x7fb3bc067600 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.949+0000 7fb3e3a00640 1 --2- 172.21.15.100:0/1910563641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3dc155e50 0x7fb3dc0a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.949+0000 7fb3e3a00640 1 --2- 172.21.15.100:0/1910563641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3dc155a80 0x7fb3dc0ac110 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.949+0000 7fb3e3a00640 1 --2- 172.21.15.100:0/1910563641 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb3dc0c7db0 0x7fb3dc1412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:47.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.949+0000 7fb3e3a00640 1 -- 172.21.15.100:0/1910563641 >> 172.21.15.100:0/1910563641 conn(0x7fb3dc067750 msgr2=0x7fb3dc0ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:47.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.949+0000 7fb3e3a00640 1 -- 172.21.15.100:0/1910563641 shutdown_connections 2024-08-17T02:48:47.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:47.949+0000 7fb3e3a00640 1 -- 172.21.15.100:0/1910563641 wait complete. 2024-08-17T02:48:47.966 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:48:48.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.112+0000 7fb443200640 1 Processor -- start 2024-08-17T02:48:48.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.113+0000 7fb443200640 1 -- start start 2024-08-17T02:48:48.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.114+0000 7fb443200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb444155900 0x7fb444155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:48.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.114+0000 7fb443200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb444158b30 0x7fb4440ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:48.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.114+0000 7fb443200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb444157690 con 0x7fb4440b0270 2024-08-17T02:48:48.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.114+0000 7fb443200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb444156a80 con 0x7fb444158b30 2024-08-17T02:48:48.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.114+0000 7fb443200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb444156d60 con 0x7fb444155900 2024-08-17T02:48:48.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.114+0000 7fb442800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb444158b30 0x7fb4440ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:48.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.114+0000 7fb442800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb444158b30 0x7fb4440ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38030/0 (socket says 172.21.15.100:38030) 2024-08-17T02:48:48.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.114+0000 7fb442800640 1 -- 172.21.15.100:0/1514706629 learned_addr learned my addr 172.21.15.100:0/1514706629 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:48.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.114+0000 7fb439400640 1 --1- 172.21.15.100:0/1514706629 >> v1:172.21.15.100:6789/0 conn(0x7fb4440b0270 0x7fb444156210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46430/0 (socket says 172.21.15.100:46430) 2024-08-17T02:48:48.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.114+0000 7fb441e00640 1 --2- 172.21.15.100:0/1514706629 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb444155900 0x7fb444155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:48.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.115+0000 7fb442800640 1 -- 172.21.15.100:0/1514706629 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb444155900 msgr2=0x7fb444155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:48.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.115+0000 7fb442800640 1 --2- 172.21.15.100:0/1514706629 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb444155900 0x7fb444155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.115+0000 7fb442800640 1 -- 172.21.15.100:0/1514706629 >> v1:172.21.15.100:6789/0 conn(0x7fb4440b0270 legacy=0x7fb444156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:48.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.115+0000 7fb442800640 1 -- 172.21.15.100:0/1514706629 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb444157040 con 0x7fb444158b30 2024-08-17T02:48:48.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.116+0000 7fb442800640 1 --2- 172.21.15.100:0/1514706629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb444158b30 0x7fb4440ae6b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb43c009f20 tx=0x7fb43c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf717d0109d559b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:48.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.116+0000 7fb441400640 1 -- 172.21.15.100:0/1514706629 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c031400 con 0x7fb444158b30 2024-08-17T02:48:48.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.116+0000 7fb441400640 1 -- 172.21.15.100:0/1514706629 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c02d050 con 0x7fb444158b30 2024-08-17T02:48:48.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.116+0000 7fb441400640 1 -- 172.21.15.100:0/1514706629 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c0317d0 con 0x7fb444158b30 2024-08-17T02:48:48.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.116+0000 7fb443200640 1 -- 172.21.15.100:0/1514706629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb444158b30 msgr2=0x7fb4440ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:48.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.116+0000 7fb443200640 1 --2- 172.21.15.100:0/1514706629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb444158b30 0x7fb4440ae6b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb43c009f20 tx=0x7fb43c009840 comp rx=0 tx=0).stop 2024-08-17T02:48:48.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.116+0000 7fb443200640 1 -- 172.21.15.100:0/1514706629 shutdown_connections 2024-08-17T02:48:48.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.116+0000 7fb443200640 1 --2- 172.21.15.100:0/1514706629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb444158b30 0x7fb4440ae6b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.116+0000 7fb443200640 1 --2- 172.21.15.100:0/1514706629 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb444155900 0x7fb444155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.116+0000 7fb443200640 1 -- 172.21.15.100:0/1514706629 >> 172.21.15.100:0/1514706629 conn(0x7fb444067750 msgr2=0x7fb4440cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:48.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.116+0000 7fb443200640 1 -- 172.21.15.100:0/1514706629 shutdown_connections 2024-08-17T02:48:48.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.117+0000 7fb443200640 1 -- 172.21.15.100:0/1514706629 wait complete. 2024-08-17T02:48:48.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.118+0000 7fb443200640 1 Processor -- start 2024-08-17T02:48:48.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.118+0000 7fb443200640 1 -- start start 2024-08-17T02:48:48.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.119+0000 7fb443200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4440b0270 0x7fb4440ab810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:48.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.119+0000 7fb443200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb444155900 0x7fb4440693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:48.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.119+0000 7fb443200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb444158b30 0x7fb444165ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:48.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.119+0000 7fb443200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb444166c50 con 0x7fb4440b0270 2024-08-17T02:48:48.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.119+0000 7fb443200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4440698f0 con 0x7fb444155900 2024-08-17T02:48:48.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.119+0000 7fb443200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4440abeb0 con 0x7fb444158b30 2024-08-17T02:48:48.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.119+0000 7fb441e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4440b0270 0x7fb4440ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:48.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.119+0000 7fb441e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4440b0270 0x7fb4440ab810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38038/0 (socket says 172.21.15.100:38038) 2024-08-17T02:48:48.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.119+0000 7fb441e00640 1 -- 172.21.15.100:0/3487358421 learned_addr learned my addr 172.21.15.100:0/3487358421 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:48.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.119+0000 7fb442800640 1 --2- 172.21.15.100:0/3487358421 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb444158b30 0x7fb444165ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:48.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.119+0000 7fb439400640 1 --2- 172.21.15.100:0/3487358421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb444155900 0x7fb4440693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:48.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.119+0000 7fb441e00640 1 -- 172.21.15.100:0/3487358421 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb444158b30 msgr2=0x7fb444165ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:48.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.119+0000 7fb441e00640 1 --2- 172.21.15.100:0/3487358421 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb444158b30 0x7fb444165ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.119+0000 7fb441e00640 1 -- 172.21.15.100:0/3487358421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb444155900 msgr2=0x7fb4440693b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:48.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.119+0000 7fb441e00640 1 --2- 172.21.15.100:0/3487358421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb444155900 0x7fb4440693b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.120+0000 7fb441e00640 1 -- 172.21.15.100:0/3487358421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c009ae0 con 0x7fb4440b0270 2024-08-17T02:48:48.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.120+0000 7fb439400640 1 --2- 172.21.15.100:0/3487358421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb444155900 0x7fb4440693b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:48:48.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.120+0000 7fb441e00640 1 --2- 172.21.15.100:0/3487358421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4440b0270 0x7fb4440ab810 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb43400d8c0 tx=0x7fb434008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:48.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.120+0000 7fb43a000640 1 -- 172.21.15.100:0/3487358421 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43400de50 con 0x7fb4440b0270 2024-08-17T02:48:48.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.120+0000 7fb43a000640 1 -- 172.21.15.100:0/3487358421 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43400b8d0 con 0x7fb4440b0270 2024-08-17T02:48:48.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.120+0000 7fb43a000640 1 -- 172.21.15.100:0/3487358421 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43400bc70 con 0x7fb4440b0270 2024-08-17T02:48:48.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.120+0000 7fb443200640 1 -- 172.21.15.100:0/3487358421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4440ac190 con 0x7fb4440b0270 2024-08-17T02:48:48.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.120+0000 7fb443200640 1 -- 172.21.15.100:0/3487358421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb444166410 con 0x7fb4440b0270 2024-08-17T02:48:48.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.121+0000 7fb443200640 1 -- 172.21.15.100:0/3487358421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb444071050 con 0x7fb4440b0270 2024-08-17T02:48:48.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.122+0000 7fb43a000640 1 -- 172.21.15.100:0/3487358421 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb434014640 con 0x7fb4440b0270 2024-08-17T02:48:48.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.123+0000 7fb43a000640 1 --2- 172.21.15.100:0/3487358421 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb420065150 0x7fb420067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:48.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.123+0000 7fb43a000640 1 -- 172.21.15.100:0/3487358421 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fb434082e30 con 0x7fb4440b0270 2024-08-17T02:48:48.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.123+0000 7fb439400640 1 --2- 172.21.15.100:0/3487358421 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb420065150 0x7fb420067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:48.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.124+0000 7fb439400640 1 --2- 172.21.15.100:0/3487358421 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb420065150 0x7fb420067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb4440b0d10 tx=0x7fb42c007d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:48.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.127+0000 7fb43a000640 1 -- 172.21.15.100:0/3487358421 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb434050b90 con 0x7fb4440b0270 2024-08-17T02:48:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.334+0000 7fb443200640 1 -- 172.21.15.100:0/3487358421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb44406f480 con 0x7fb4440b0270 2024-08-17T02:48:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.335+0000 7fb43a000640 1 -- 172.21.15.100:0/3487358421 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5696 (secure 0 0 0) 0x7fb4340541b0 con 0x7fb4440b0270 2024-08-17T02:48:48.337 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:48:48.337 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1972998642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1972998642},{"type":"v1","addr":"172.21.15.100:6836","nonce":1972998642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3961484077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3961484077},{"type":"v1","addr":"172.21.15.100:6837","nonce":3961484077}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:30.114385+0000","modified":"2024-08-17T02:46:33.731841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1541092259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":1541092259},{"type":"v1","addr":"172.21.15.123:6835","nonce":1541092259}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:42.789210+0000","modified":"2024-08-17T02:46:44.792554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4885":{"gid":4885,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.123:6834/1763367135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1763367135},{"type":"v1","addr":"172.21.15.123:6834","nonce":1763367135}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001028572","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:48:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 20 2024-08-17T02:48:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.337+0000 7fb443200640 1 -- 172.21.15.100:0/3487358421 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb420065150 msgr2=0x7fb420067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.337+0000 7fb443200640 1 --2- 172.21.15.100:0/3487358421 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb420065150 0x7fb420067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb4440b0d10 tx=0x7fb42c007d80 comp rx=0 tx=0).stop 2024-08-17T02:48:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.337+0000 7fb443200640 1 -- 172.21.15.100:0/3487358421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4440b0270 msgr2=0x7fb4440ab810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.337+0000 7fb443200640 1 --2- 172.21.15.100:0/3487358421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4440b0270 0x7fb4440ab810 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb43400d8c0 tx=0x7fb434008040 comp rx=0 tx=0).stop 2024-08-17T02:48:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.337+0000 7fb443200640 1 -- 172.21.15.100:0/3487358421 shutdown_connections 2024-08-17T02:48:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.337+0000 7fb443200640 1 --2- 172.21.15.100:0/3487358421 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb420065150 0x7fb420067600 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.337+0000 7fb443200640 1 --2- 172.21.15.100:0/3487358421 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb444158b30 0x7fb444165ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.337+0000 7fb443200640 1 --2- 172.21.15.100:0/3487358421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb444155900 0x7fb4440693b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.337+0000 7fb443200640 1 --2- 172.21.15.100:0/3487358421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4440b0270 0x7fb4440ab810 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.337+0000 7fb443200640 1 -- 172.21.15.100:0/3487358421 >> 172.21.15.100:0/3487358421 conn(0x7fb444067750 msgr2=0x7fb4440af030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:48.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.337+0000 7fb443200640 1 -- 172.21.15.100:0/3487358421 shutdown_connections 2024-08-17T02:48:48.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.337+0000 7fb443200640 1 -- 172.21.15.100:0/3487358421 wait complete. 2024-08-17T02:48:48.353 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:48:48.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.498+0000 7f9a03800640 1 Processor -- start 2024-08-17T02:48:48.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.498+0000 7f9a03800640 1 -- start start 2024-08-17T02:48:48.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.499+0000 7f9a03800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f99fc06ddf0 0x7f99fc158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:48.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.499+0000 7f9a03800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99fc0a9a10 con 0x7f99fc06da20 2024-08-17T02:48:48.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.499+0000 7f9a03800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99fc0a9cf0 con 0x7f99fc0aa7d0 2024-08-17T02:48:48.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.499+0000 7f9a03800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99fc0ac400 con 0x7f99fc06ddf0 2024-08-17T02:48:48.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.499+0000 7f9a00e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f99fc06da20 0x7f99fc158890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46440/0 (socket says 172.21.15.100:46440) 2024-08-17T02:48:48.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.499+0000 7f9a00e00640 1 -- 172.21.15.100:0/106821301 learned_addr learned my addr 172.21.15.100:0/106821301 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:48:48.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.500+0000 7f9a01800640 1 --2- 172.21.15.100:0/106821301 >> v2:172.21.15.123:3300/0 conn(0x7f99fc06ddf0 0x7f99fc158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:48.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.500+0000 7f99fb400640 1 -- 172.21.15.100:0/106821301 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581214354 0 0) 0x7f99fc0a9a10 con 0x7f99fc06da20 2024-08-17T02:48:48.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.500+0000 7f99fb400640 1 -- 172.21.15.100:0/106821301 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99e40034e0 con 0x7f99fc06da20 2024-08-17T02:48:48.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.500+0000 7f99fb400640 1 -- 172.21.15.100:0/106821301 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851208338 0 0) 0x7f99fc0a9cf0 con 0x7f99fc0aa7d0 2024-08-17T02:48:48.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.500+0000 7f99fb400640 1 -- 172.21.15.100:0/106821301 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99fc0a9a10 con 0x7f99fc0aa7d0 2024-08-17T02:48:48.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.500+0000 7f99fb400640 1 -- 172.21.15.100:0/106821301 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3599332641 0 0) 0x7f99e40034e0 con 0x7f99fc06da20 2024-08-17T02:48:48.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.500+0000 7f99fb400640 1 -- 172.21.15.100:0/106821301 >> v2:172.21.15.123:3300/0 conn(0x7f99fc06ddf0 msgr2=0x7f99fc158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:48.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.500+0000 7f99fb400640 1 --2- 172.21.15.100:0/106821301 >> v2:172.21.15.123:3300/0 conn(0x7f99fc06ddf0 0x7f99fc158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.500+0000 7f99fb400640 1 -- 172.21.15.100:0/106821301 >> v1:172.21.15.123:6789/0 conn(0x7f99fc0aa7d0 legacy=0x7f99fc0ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:48.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.500+0000 7f99fb400640 1 -- 172.21.15.100:0/106821301 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc0a9fd0 con 0x7f99fc06da20 2024-08-17T02:48:48.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.500+0000 7f99fb400640 1 -- 172.21.15.100:0/106821301 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1817143124 0 0) 0x7f99f0001470 con 0x7f99fc06da20 2024-08-17T02:48:48.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.500+0000 7f99fb400640 1 -- 172.21.15.100:0/106821301 >> v1:172.21.15.100:6789/0 conn(0x7f99fc06da20 legacy=0x7f99fc158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:48.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.500+0000 7f99fb400640 1 --2- 172.21.15.100:0/106821301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99e4003bb0 0x7f99e4003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:48.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.500+0000 7f99fb400640 1 --2- 172.21.15.100:0/106821301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e4004780 0x7f99e4004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:48.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.500+0000 7f99fb400640 1 --2- 172.21.15.100:0/106821301 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e4005180 0x7f99e400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:48.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.500+0000 7f99fb400640 1 -- 172.21.15.100:0/106821301 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0ac400 con 0x7f99e4004780 2024-08-17T02:48:48.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.500+0000 7f99fb400640 1 -- 172.21.15.100:0/106821301 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e400c120 con 0x7f99e4003bb0 2024-08-17T02:48:48.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.500+0000 7f99fb400640 1 -- 172.21.15.100:0/106821301 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e400c2e0 con 0x7f99e4005180 2024-08-17T02:48:48.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.501+0000 7f99fbe00640 1 --2- 172.21.15.100:0/106821301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e4004780 0x7f99e4004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:48.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.501+0000 7f9a00e00640 1 --2- 172.21.15.100:0/106821301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99e4003bb0 0x7f99e4003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:48.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.501+0000 7f9a01800640 1 --2- 172.21.15.100:0/106821301 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e4005180 0x7f99e400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:48.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.501+0000 7f99fbe00640 1 -- 172.21.15.100:0/106821301 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e4005180 msgr2=0x7f99e400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:48.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.501+0000 7f99fbe00640 1 --2- 172.21.15.100:0/106821301 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e4005180 0x7f99e400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.501+0000 7f99fbe00640 1 -- 172.21.15.100:0/106821301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99e4003bb0 msgr2=0x7f99e4003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:48.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.501+0000 7f99fbe00640 1 --2- 172.21.15.100:0/106821301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99e4003bb0 0x7f99e4003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.501+0000 7f99fbe00640 1 -- 172.21.15.100:0/106821301 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e40034e0 con 0x7f99e4004780 2024-08-17T02:48:48.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.501+0000 7f9a01800640 1 --2- 172.21.15.100:0/106821301 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e4005180 0x7f99e400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:48:48.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.501+0000 7f9a01800640 1 -- 172.21.15.100:0/106821301 reap_dead start 2024-08-17T02:48:48.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.502+0000 7f99fbe00640 1 --2- 172.21.15.100:0/106821301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e4004780 0x7f99e4004bf0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f99e8007fd0 tx=0x7f99e8007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301af9dbb5aa0c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:48.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.502+0000 7f99fb400640 1 -- 172.21.15.100:0/106821301 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e802a9c0 con 0x7f99e4004780 2024-08-17T02:48:48.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.502+0000 7f99fb400640 1 -- 172.21.15.100:0/106821301 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e802ab20 con 0x7f99e4004780 2024-08-17T02:48:48.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.502+0000 7f99fb400640 1 -- 172.21.15.100:0/106821301 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e80323f0 con 0x7f99e4004780 2024-08-17T02:48:48.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.503+0000 7f9a03800640 1 -- 172.21.15.100:0/106821301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e4004780 msgr2=0x7f99e4004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:48.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.503+0000 7f9a03800640 1 --2- 172.21.15.100:0/106821301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e4004780 0x7f99e4004bf0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f99e8007fd0 tx=0x7f99e8007ca0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.503+0000 7f9a03800640 1 -- 172.21.15.100:0/106821301 shutdown_connections 2024-08-17T02:48:48.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.503+0000 7f9a03800640 1 --2- 172.21.15.100:0/106821301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e4004780 0x7f99e4004bf0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.503+0000 7f9a03800640 1 -- 172.21.15.100:0/106821301 >> 172.21.15.100:0/106821301 conn(0x7f99fc0cb9b0 msgr2=0x7f99fc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:48.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.503+0000 7f9a03800640 1 -- 172.21.15.100:0/106821301 shutdown_connections 2024-08-17T02:48:48.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.503+0000 7f9a03800640 1 -- 172.21.15.100:0/106821301 wait complete. 2024-08-17T02:48:48.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.504+0000 7f9a03800640 1 Processor -- start 2024-08-17T02:48:48.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.504+0000 7f9a03800640 1 -- start start 2024-08-17T02:48:48.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.505+0000 7f9a03800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e4004780 0x7f99fc15f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:48.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.505+0000 7f9a03800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99fc15b380 0x7f99fc14b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:48.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.505+0000 7f9a03800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99fc14b570 0x7f99fc15c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:48.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.505+0000 7f9a03800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc159e70 con 0x7f99fc15b380 2024-08-17T02:48:48.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.505+0000 7f9a03800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc15aef0 con 0x7f99fc14b570 2024-08-17T02:48:48.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.505+0000 7f9a03800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc15a0c0 con 0x7f99e4004780 2024-08-17T02:48:48.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.506+0000 7f99fbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99fc15b380 0x7f99fc14b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:48.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.506+0000 7f99fbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99fc15b380 0x7f99fc14b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38068/0 (socket says 172.21.15.100:38068) 2024-08-17T02:48:48.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.506+0000 7f99fbe00640 1 -- 172.21.15.100:0/1629832135 learned_addr learned my addr 172.21.15.100:0/1629832135 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:48.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.506+0000 7f9a00e00640 1 --2- 172.21.15.100:0/1629832135 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e4004780 0x7f99fc15f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:48.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.506+0000 7f9a01800640 1 --2- 172.21.15.100:0/1629832135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99fc14b570 0x7f99fc15c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:48.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.506+0000 7f99fbe00640 1 -- 172.21.15.100:0/1629832135 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e4004780 msgr2=0x7f99fc15f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:48.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.506+0000 7f99fbe00640 1 --2- 172.21.15.100:0/1629832135 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e4004780 0x7f99fc15f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.506+0000 7f99fbe00640 1 -- 172.21.15.100:0/1629832135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99fc14b570 msgr2=0x7f99fc15c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:48.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.506+0000 7f99fbe00640 1 --2- 172.21.15.100:0/1629832135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99fc14b570 0x7f99fc15c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.506+0000 7f99fbe00640 1 -- 172.21.15.100:0/1629832135 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc15a3a0 con 0x7f99fc15b380 2024-08-17T02:48:48.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.506+0000 7f99fbe00640 1 --2- 172.21.15.100:0/1629832135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99fc15b380 0x7f99fc14b030 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f99e802a580 tx=0x7f99e8003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:48.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.506+0000 7f99efe00640 1 -- 172.21.15.100:0/1629832135 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e8033be0 con 0x7f99fc15b380 2024-08-17T02:48:48.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.506+0000 7f99efe00640 1 -- 172.21.15.100:0/1629832135 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e8033d40 con 0x7f99fc15b380 2024-08-17T02:48:48.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.507+0000 7f9a03800640 1 -- 172.21.15.100:0/1629832135 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99fc15a8a0 con 0x7f99fc15b380 2024-08-17T02:48:48.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.507+0000 7f99efe00640 1 -- 172.21.15.100:0/1629832135 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e8007270 con 0x7f99fc15b380 2024-08-17T02:48:48.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.507+0000 7f9a03800640 1 -- 172.21.15.100:0/1629832135 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99fc15b7f0 con 0x7f99fc15b380 2024-08-17T02:48:48.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.508+0000 7f9a03800640 1 -- 172.21.15.100:0/1629832135 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99fc15b7f0 con 0x7f99fc15b380 2024-08-17T02:48:48.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.508+0000 7f99efe00640 1 -- 172.21.15.100:0/1629832135 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f99e8006790 con 0x7f99fc15b380 2024-08-17T02:48:48.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.509+0000 7f99efe00640 1 --2- 172.21.15.100:0/1629832135 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f99dc065180 0x7f99dc067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:48.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.509+0000 7f99efe00640 1 -- 172.21.15.100:0/1629832135 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f99e80a2cd0 con 0x7f99fc15b380 2024-08-17T02:48:48.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.509+0000 7f9a00e00640 1 --2- 172.21.15.100:0/1629832135 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f99dc065180 0x7f99dc067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:48.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.510+0000 7f9a00e00640 1 --2- 172.21.15.100:0/1629832135 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f99dc065180 0x7f99dc067630 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f99f0000e10 tx=0x7f99f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:48.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.513+0000 7f99efe00640 1 -- 172.21.15.100:0/1629832135 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f99e8070970 con 0x7f99fc15b380 2024-08-17T02:48:48.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.687+0000 7f9a03800640 1 -- 172.21.15.100:0/1629832135 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99fc15b7f0 con 0x7f99fc15b380 2024-08-17T02:48:48.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.688+0000 7f99efe00640 1 -- 172.21.15.100:0/1629832135 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18647 (secure 0 0 0) 0x7f99e80076a0 con 0x7f99fc15b380 2024-08-17T02:48:48.690 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:48:48.690 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":38,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:46:45.796677+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:28.081485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:29.108765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000001028572.meta","create_time":"2024-08-17T02:46:40.913393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001028572"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001028572.data","create_time":"2024-08-17T02:46:41.819233+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001028572"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:48:48.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.690+0000 7f9a03800640 1 -- 172.21.15.100:0/1629832135 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f99dc065180 msgr2=0x7f99dc067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:48.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.690+0000 7f9a03800640 1 --2- 172.21.15.100:0/1629832135 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f99dc065180 0x7f99dc067630 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f99f0000e10 tx=0x7f99f0009040 comp rx=0 tx=0).stop 2024-08-17T02:48:48.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.690+0000 7f9a03800640 1 -- 172.21.15.100:0/1629832135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99fc15b380 msgr2=0x7f99fc14b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:48.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.690+0000 7f9a03800640 1 --2- 172.21.15.100:0/1629832135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99fc15b380 0x7f99fc14b030 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f99e802a580 tx=0x7f99e8003000 comp rx=0 tx=0).stop 2024-08-17T02:48:48.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.690+0000 7f9a03800640 1 -- 172.21.15.100:0/1629832135 shutdown_connections 2024-08-17T02:48:48.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.690+0000 7f9a03800640 1 --2- 172.21.15.100:0/1629832135 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f99dc065180 0x7f99dc067630 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.690+0000 7f9a03800640 1 --2- 172.21.15.100:0/1629832135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99fc14b570 0x7f99fc15c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.690+0000 7f9a03800640 1 --2- 172.21.15.100:0/1629832135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99fc15b380 0x7f99fc14b030 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.690+0000 7f9a03800640 1 --2- 172.21.15.100:0/1629832135 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e4004780 0x7f99fc15f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.690+0000 7f9a03800640 1 -- 172.21.15.100:0/1629832135 >> 172.21.15.100:0/1629832135 conn(0x7f99fc0cb9b0 msgr2=0x7f99fc0ab5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:48.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.690+0000 7f9a03800640 1 -- 172.21.15.100:0/1629832135 shutdown_connections 2024-08-17T02:48:48.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.690+0000 7f9a03800640 1 -- 172.21.15.100:0/1629832135 wait complete. 2024-08-17T02:48:48.707 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:48:48.707 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:48:48.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.853+0000 7f1e07c00640 1 Processor -- start 2024-08-17T02:48:48.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.853+0000 7f1e07c00640 1 -- start start 2024-08-17T02:48:48.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.855+0000 7f1e07c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1e00140580 0x7f1e000c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:48.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.855+0000 7f1e07c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e000caa80 con 0x7f1e000b1440 2024-08-17T02:48:48.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.855+0000 7f1e07c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e000c9e70 con 0x7f1e001401b0 2024-08-17T02:48:48.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.855+0000 7f1e07c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e000c9c90 con 0x7f1e00140580 2024-08-17T02:48:48.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.855+0000 7f1e05c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1e00140580 0x7f1e000c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:48.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.855+0000 7f1e05c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1e00140580 0x7f1e000c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38084/0 (socket says 172.21.15.100:38084) 2024-08-17T02:48:48.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.855+0000 7f1e05c00640 1 -- 172.21.15.100:0/1738254451 learned_addr learned my addr 172.21.15.100:0/1738254451 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:48.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.855+0000 7f1df7e00640 1 --1- 172.21.15.100:0/1738254451 >> v1:172.21.15.100:6789/0 conn(0x7f1e000b1440 0x7f1e000c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46454/0 (socket says 172.21.15.100:46454) 2024-08-17T02:48:48.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.855+0000 7f1e05c00640 1 -- 172.21.15.100:0/1738254451 >> v1:172.21.15.123:6789/0 conn(0x7f1e001401b0 legacy=0x7f1e000b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:48.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.855+0000 7f1e05c00640 1 -- 172.21.15.100:0/1738254451 >> v1:172.21.15.100:6789/0 conn(0x7f1e000b1440 legacy=0x7f1e000c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:48.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.855+0000 7f1e05c00640 1 -- 172.21.15.100:0/1738254451 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e000ca150 con 0x7f1e00140580 2024-08-17T02:48:48.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.856+0000 7f1e05c00640 1 --2- 172.21.15.100:0/1738254451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e00140580 0x7f1e000c9750 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009f20 tx=0x7f1df8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3e946fe60c95f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:48.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.856+0000 7f1dffe00640 1 -- 172.21.15.100:0/1738254451 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8032470 con 0x7f1e00140580 2024-08-17T02:48:48.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.857+0000 7f1dffe00640 1 -- 172.21.15.100:0/1738254451 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df80325d0 con 0x7f1e00140580 2024-08-17T02:48:48.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.857+0000 7f1dffe00640 1 -- 172.21.15.100:0/1738254451 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df80329b0 con 0x7f1e00140580 2024-08-17T02:48:48.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.857+0000 7f1e07c00640 1 -- 172.21.15.100:0/1738254451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e00140580 msgr2=0x7f1e000c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:48.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.857+0000 7f1e07c00640 1 --2- 172.21.15.100:0/1738254451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e00140580 0x7f1e000c9750 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009f20 tx=0x7f1df8009840 comp rx=0 tx=0).stop 2024-08-17T02:48:48.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.857+0000 7f1e07c00640 1 -- 172.21.15.100:0/1738254451 shutdown_connections 2024-08-17T02:48:48.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.857+0000 7f1e07c00640 1 --2- 172.21.15.100:0/1738254451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e00140580 0x7f1e000c9750 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.857+0000 7f1e07c00640 1 -- 172.21.15.100:0/1738254451 >> 172.21.15.100:0/1738254451 conn(0x7f1e000cb9b0 msgr2=0x7f1e000cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:48.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.857+0000 7f1e07c00640 1 -- 172.21.15.100:0/1738254451 shutdown_connections 2024-08-17T02:48:48.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.857+0000 7f1e07c00640 1 -- 172.21.15.100:0/1738254451 wait complete. 2024-08-17T02:48:48.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.859+0000 7f1e07c00640 1 Processor -- start 2024-08-17T02:48:48.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.859+0000 7f1e07c00640 1 -- start start 2024-08-17T02:48:48.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.860+0000 7f1e07c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e000b1440 0x7f1e0014d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:48.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.860+0000 7f1e07c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e001401b0 0x7f1e00069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:48.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.860+0000 7f1e07c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e00140580 0x7f1e00069b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:48.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.860+0000 7f1e07c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0015c8a0 con 0x7f1e00140580 2024-08-17T02:48:48.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.860+0000 7f1e07c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0015bc90 con 0x7f1e000b1440 2024-08-17T02:48:48.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.860+0000 7f1e07c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0015bf70 con 0x7f1e001401b0 2024-08-17T02:48:48.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.860+0000 7f1e05c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e00140580 0x7f1e00069b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:48.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.860+0000 7f1e05c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e00140580 0x7f1e00069b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38096/0 (socket says 172.21.15.100:38096) 2024-08-17T02:48:48.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.860+0000 7f1e05c00640 1 -- 172.21.15.100:0/462929494 learned_addr learned my addr 172.21.15.100:0/462929494 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:48.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.860+0000 7f1df7e00640 1 --2- 172.21.15.100:0/462929494 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e001401b0 0x7f1e00069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:48.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.860+0000 7f1e05200640 1 --2- 172.21.15.100:0/462929494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e000b1440 0x7f1e0014d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:48.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.860+0000 7f1e05c00640 1 -- 172.21.15.100:0/462929494 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e001401b0 msgr2=0x7f1e00069640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:48.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.860+0000 7f1e05c00640 1 --2- 172.21.15.100:0/462929494 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e001401b0 0x7f1e00069640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.860+0000 7f1e05c00640 1 -- 172.21.15.100:0/462929494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e000b1440 msgr2=0x7f1e0014d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:48.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.860+0000 7f1e05c00640 1 --2- 172.21.15.100:0/462929494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e000b1440 0x7f1e0014d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:48.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.860+0000 7f1e05c00640 1 -- 172.21.15.100:0/462929494 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df8009ae0 con 0x7f1e00140580 2024-08-17T02:48:48.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.861+0000 7f1e05c00640 1 --2- 172.21.15.100:0/462929494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e00140580 0x7f1e00069b80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009f80 tx=0x7f1df8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:48.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.861+0000 7f1dfcc00640 1 -- 172.21.15.100:0/462929494 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8032470 con 0x7f1e00140580 2024-08-17T02:48:48.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.861+0000 7f1dfcc00640 1 -- 172.21.15.100:0/462929494 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df8008e30 con 0x7f1e00140580 2024-08-17T02:48:48.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.861+0000 7f1dfcc00640 1 -- 172.21.15.100:0/462929494 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df803c660 con 0x7f1e00140580 2024-08-17T02:48:48.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.861+0000 7f1e07c00640 1 -- 172.21.15.100:0/462929494 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e0015c250 con 0x7f1e00140580 2024-08-17T02:48:48.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.861+0000 7f1e07c00640 1 -- 172.21.15.100:0/462929494 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e0014dc70 con 0x7f1e00140580 2024-08-17T02:48:48.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.862+0000 7f1e07c00640 1 -- 172.21.15.100:0/462929494 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e0015ca50 con 0x7f1e00140580 2024-08-17T02:48:48.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.863+0000 7f1dfcc00640 1 -- 172.21.15.100:0/462929494 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1df8039050 con 0x7f1e00140580 2024-08-17T02:48:48.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.864+0000 7f1dfcc00640 1 --2- 172.21.15.100:0/462929494 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1ddc065150 0x7f1ddc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:48.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.864+0000 7f1dfcc00640 1 -- 172.21.15.100:0/462929494 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f1df80a3990 con 0x7f1e00140580 2024-08-17T02:48:48.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.864+0000 7f1e05200640 1 --2- 172.21.15.100:0/462929494 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1ddc065150 0x7f1ddc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:48.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.865+0000 7f1e05200640 1 --2- 172.21.15.100:0/462929494 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1ddc065150 0x7f1ddc067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1df0007fd0 tx=0x7f1df0007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:48.868+0000 7f1dfcc00640 1 -- 172.21.15.100:0/462929494 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1e0015ca50 con 0x7f1e00140580 2024-08-17T02:48:49.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.076+0000 7f1e07c00640 1 -- 172.21.15.100:0/462929494 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e00064db0 con 0x7f1e00140580 2024-08-17T02:48:49.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.077+0000 7f1dfcc00640 1 -- 172.21.15.100:0/462929494 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5696 (secure 0 0 0) 0x7f1df80716e0 con 0x7f1e00140580 2024-08-17T02:48:49.079 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:48:49.079 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1972998642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1972998642},{"type":"v1","addr":"172.21.15.100:6836","nonce":1972998642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3961484077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3961484077},{"type":"v1","addr":"172.21.15.100:6837","nonce":3961484077}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:30.114385+0000","modified":"2024-08-17T02:46:33.731841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1541092259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":1541092259},{"type":"v1","addr":"172.21.15.123:6835","nonce":1541092259}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:42.789210+0000","modified":"2024-08-17T02:46:44.792554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4885":{"gid":4885,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.123:6834/1763367135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1763367135},{"type":"v1","addr":"172.21.15.123:6834","nonce":1763367135}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001028572","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:48:49.079 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 20 2024-08-17T02:48:49.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.079+0000 7f1e07c00640 1 -- 172.21.15.100:0/462929494 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1ddc065150 msgr2=0x7f1ddc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:49.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.079+0000 7f1e07c00640 1 --2- 172.21.15.100:0/462929494 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1ddc065150 0x7f1ddc067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1df0007fd0 tx=0x7f1df0007e30 comp rx=0 tx=0).stop 2024-08-17T02:48:49.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.079+0000 7f1e07c00640 1 -- 172.21.15.100:0/462929494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e00140580 msgr2=0x7f1e00069b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:49.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.079+0000 7f1e07c00640 1 --2- 172.21.15.100:0/462929494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e00140580 0x7f1e00069b80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009f80 tx=0x7f1df8037000 comp rx=0 tx=0).stop 2024-08-17T02:48:49.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.079+0000 7f1e07c00640 1 -- 172.21.15.100:0/462929494 shutdown_connections 2024-08-17T02:48:49.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.079+0000 7f1e07c00640 1 --2- 172.21.15.100:0/462929494 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1ddc065150 0x7f1ddc067600 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.079+0000 7f1e07c00640 1 --2- 172.21.15.100:0/462929494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e00140580 0x7f1e00069b80 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.079+0000 7f1e07c00640 1 --2- 172.21.15.100:0/462929494 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e001401b0 0x7f1e00069640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.079+0000 7f1e07c00640 1 --2- 172.21.15.100:0/462929494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e000b1440 0x7f1e0014d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.079+0000 7f1e07c00640 1 -- 172.21.15.100:0/462929494 >> 172.21.15.100:0/462929494 conn(0x7f1e000cb9b0 msgr2=0x7f1e000cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:49.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.079+0000 7f1e07c00640 1 -- 172.21.15.100:0/462929494 shutdown_connections 2024-08-17T02:48:49.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.079+0000 7f1e07c00640 1 -- 172.21.15.100:0/462929494 wait complete. 2024-08-17T02:48:49.097 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:48:49.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.244+0000 7f1e2aa00640 1 Processor -- start 2024-08-17T02:48:49.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.244+0000 7f1e2aa00640 1 -- start start 2024-08-17T02:48:49.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.245+0000 7f1e2aa00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e2415d830 0x7f1e2406e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:49.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.245+0000 7f1e2aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1e2415e310 0x7f1e24166e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:49.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.246+0000 7f1e2aa00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e240b1690 con 0x7f1e240b0610 2024-08-17T02:48:49.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.246+0000 7f1e2aa00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e240b1b20 con 0x7f1e2415e310 2024-08-17T02:48:49.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.246+0000 7f1e2aa00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e240ae4a0 con 0x7f1e2415d830 2024-08-17T02:48:49.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.246+0000 7f1e28a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1e2415e310 0x7f1e24166e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:49.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.246+0000 7f1e28a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1e2415e310 0x7f1e24166e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38110/0 (socket says 172.21.15.100:38110) 2024-08-17T02:48:49.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.246+0000 7f1e28a00640 1 -- 172.21.15.100:0/307684023 learned_addr learned my addr 172.21.15.100:0/307684023 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:49.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.246+0000 7f1e23e00640 1 --2- 172.21.15.100:0/307684023 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e2415d830 0x7f1e2406e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:49.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.246+0000 7f1e28a00640 1 -- 172.21.15.100:0/307684023 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e2415d830 msgr2=0x7f1e2406e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:49.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.246+0000 7f1e28a00640 1 --2- 172.21.15.100:0/307684023 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e2415d830 0x7f1e2406e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.246+0000 7f1e28a00640 1 -- 172.21.15.100:0/307684023 >> v1:172.21.15.123:6789/0 conn(0x7f1e240b0610 legacy=0x7f1e2415dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:49.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.246+0000 7f1e28a00640 1 -- 172.21.15.100:0/307684023 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2415b200 con 0x7f1e2415e310 2024-08-17T02:48:49.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.247+0000 7f1e28a00640 1 --2- 172.21.15.100:0/307684023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e2415e310 0x7f1e24166e50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c009910 tx=0x7f1e1c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f75d9de46cb715 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:49.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.248+0000 7f1e22a00640 1 -- 172.21.15.100:0/307684023 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c02ae40 con 0x7f1e2415e310 2024-08-17T02:48:49.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.248+0000 7f1e22a00640 1 -- 172.21.15.100:0/307684023 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c032440 con 0x7f1e2415e310 2024-08-17T02:48:49.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.248+0000 7f1e22a00640 1 -- 172.21.15.100:0/307684023 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c032820 con 0x7f1e2415e310 2024-08-17T02:48:49.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.248+0000 7f1e2aa00640 1 -- 172.21.15.100:0/307684023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e2415e310 msgr2=0x7f1e24166e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:49.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.248+0000 7f1e2aa00640 1 --2- 172.21.15.100:0/307684023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e2415e310 0x7f1e24166e50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c009910 tx=0x7f1e1c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.248+0000 7f1e2aa00640 1 -- 172.21.15.100:0/307684023 shutdown_connections 2024-08-17T02:48:49.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.248+0000 7f1e2aa00640 1 --2- 172.21.15.100:0/307684023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e2415e310 0x7f1e24166e50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.248+0000 7f1e2aa00640 1 --2- 172.21.15.100:0/307684023 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e2415d830 0x7f1e2406e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.248+0000 7f1e2aa00640 1 -- 172.21.15.100:0/307684023 >> 172.21.15.100:0/307684023 conn(0x7f1e240cb9b0 msgr2=0x7f1e240cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:49.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.248+0000 7f1e2aa00640 1 -- 172.21.15.100:0/307684023 shutdown_connections 2024-08-17T02:48:49.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.248+0000 7f1e2aa00640 1 -- 172.21.15.100:0/307684023 wait complete. 2024-08-17T02:48:49.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.250+0000 7f1e2aa00640 1 Processor -- start 2024-08-17T02:48:49.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.250+0000 7f1e2aa00640 1 -- start start 2024-08-17T02:48:49.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.251+0000 7f1e2aa00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e240b0610 0x7f1e24155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:49.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.251+0000 7f1e2aa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e2415d830 0x7f1e24158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:49.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.251+0000 7f1e2aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e2415e310 0x7f1e24159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:49.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.251+0000 7f1e2aa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e24163f50 con 0x7f1e2415e310 2024-08-17T02:48:49.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.251+0000 7f1e2aa00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e24156330 con 0x7f1e2415d830 2024-08-17T02:48:49.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.251+0000 7f1e2aa00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e24163ac0 con 0x7f1e240b0610 2024-08-17T02:48:49.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.251+0000 7f1e28a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e2415e310 0x7f1e24159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:49.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.251+0000 7f1e28a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e2415e310 0x7f1e24159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38118/0 (socket says 172.21.15.100:38118) 2024-08-17T02:48:49.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.251+0000 7f1e28a00640 1 -- 172.21.15.100:0/1192180721 learned_addr learned my addr 172.21.15.100:0/1192180721 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:49.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.251+0000 7f1e23e00640 1 --2- 172.21.15.100:0/1192180721 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e240b0610 0x7f1e24155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:49.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.251+0000 7f1e23400640 1 --2- 172.21.15.100:0/1192180721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e2415d830 0x7f1e24158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:49.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.251+0000 7f1e28a00640 1 -- 172.21.15.100:0/1192180721 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e240b0610 msgr2=0x7f1e24155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:49.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.251+0000 7f1e28a00640 1 --2- 172.21.15.100:0/1192180721 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e240b0610 0x7f1e24155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.251+0000 7f1e28a00640 1 -- 172.21.15.100:0/1192180721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e2415d830 msgr2=0x7f1e24158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:49.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.251+0000 7f1e28a00640 1 --2- 172.21.15.100:0/1192180721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e2415d830 0x7f1e24158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.251+0000 7f1e28a00640 1 -- 172.21.15.100:0/1192180721 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c009450 con 0x7f1e2415e310 2024-08-17T02:48:49.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.251+0000 7f1e23400640 1 --2- 172.21.15.100:0/1192180721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e2415d830 0x7f1e24158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:48:49.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.252+0000 7f1e28a00640 1 --2- 172.21.15.100:0/1192180721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e2415e310 0x7f1e24159470 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c009970 tx=0x7f1e1c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:49.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.252+0000 7f1e1b400640 1 -- 172.21.15.100:0/1192180721 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c03d420 con 0x7f1e2415e310 2024-08-17T02:48:49.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.252+0000 7f1e1b400640 1 -- 172.21.15.100:0/1192180721 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c03d5a0 con 0x7f1e2415e310 2024-08-17T02:48:49.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.252+0000 7f1e1b400640 1 -- 172.21.15.100:0/1192180721 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c03d960 con 0x7f1e2415e310 2024-08-17T02:48:49.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.252+0000 7f1e2aa00640 1 -- 172.21.15.100:0/1192180721 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e24155db0 con 0x7f1e2415e310 2024-08-17T02:48:49.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.252+0000 7f1e2aa00640 1 -- 172.21.15.100:0/1192180721 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e24163190 con 0x7f1e2415e310 2024-08-17T02:48:49.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.253+0000 7f1e2aa00640 1 -- 172.21.15.100:0/1192180721 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e24163c30 con 0x7f1e2415e310 2024-08-17T02:48:49.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.254+0000 7f1e1b400640 1 -- 172.21.15.100:0/1192180721 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1e1c03dd50 con 0x7f1e2415e310 2024-08-17T02:48:49.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.255+0000 7f1e1b400640 1 --2- 172.21.15.100:0/1192180721 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1e04065150 0x7f1e04067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:49.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.255+0000 7f1e1b400640 1 -- 172.21.15.100:0/1192180721 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f1e1c02ae40 con 0x7f1e2415e310 2024-08-17T02:48:49.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.255+0000 7f1e23e00640 1 --2- 172.21.15.100:0/1192180721 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1e04065150 0x7f1e04067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:49.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.256+0000 7f1e23e00640 1 --2- 172.21.15.100:0/1192180721 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1e04065150 0x7f1e04067600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1e24159b80 tx=0x7f1e14009850 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:49.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.259+0000 7f1e1b400640 1 -- 172.21.15.100:0/1192180721 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1e1c070c60 con 0x7f1e2415e310 2024-08-17T02:48:49.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.467+0000 7f1e2aa00640 1 -- 172.21.15.100:0/1192180721 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e24064db0 con 0x7f1e2415e310 2024-08-17T02:48:49.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.468+0000 7f1e1b400640 1 -- 172.21.15.100:0/1192180721 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5696 (secure 0 0 0) 0x7f1e1c042090 con 0x7f1e2415e310 2024-08-17T02:48:49.469 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:48:49.469 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1972998642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1972998642},{"type":"v1","addr":"172.21.15.100:6836","nonce":1972998642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3961484077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3961484077},{"type":"v1","addr":"172.21.15.100:6837","nonce":3961484077}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:30.114385+0000","modified":"2024-08-17T02:46:33.731841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1541092259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":1541092259},{"type":"v1","addr":"172.21.15.123:6835","nonce":1541092259}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:42.789210+0000","modified":"2024-08-17T02:46:44.792554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4885":{"gid":4885,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.123:6834/1763367135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1763367135},{"type":"v1","addr":"172.21.15.123:6834","nonce":1763367135}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001028572","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:48:49.470 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 20 2024-08-17T02:48:49.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.470+0000 7f1e2aa00640 1 -- 172.21.15.100:0/1192180721 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1e04065150 msgr2=0x7f1e04067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:49.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.470+0000 7f1e2aa00640 1 --2- 172.21.15.100:0/1192180721 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1e04065150 0x7f1e04067600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1e24159b80 tx=0x7f1e14009850 comp rx=0 tx=0).stop 2024-08-17T02:48:49.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.470+0000 7f1e2aa00640 1 -- 172.21.15.100:0/1192180721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e2415e310 msgr2=0x7f1e24159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:49.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.470+0000 7f1e2aa00640 1 --2- 172.21.15.100:0/1192180721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e2415e310 0x7f1e24159470 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c009970 tx=0x7f1e1c032000 comp rx=0 tx=0).stop 2024-08-17T02:48:49.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.470+0000 7f1e2aa00640 1 -- 172.21.15.100:0/1192180721 shutdown_connections 2024-08-17T02:48:49.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.470+0000 7f1e2aa00640 1 --2- 172.21.15.100:0/1192180721 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1e04065150 0x7f1e04067600 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.470+0000 7f1e2aa00640 1 --2- 172.21.15.100:0/1192180721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e2415e310 0x7f1e24159470 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.470+0000 7f1e2aa00640 1 --2- 172.21.15.100:0/1192180721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e2415d830 0x7f1e24158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.470+0000 7f1e2aa00640 1 --2- 172.21.15.100:0/1192180721 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e240b0610 0x7f1e24155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.470+0000 7f1e2aa00640 1 -- 172.21.15.100:0/1192180721 >> 172.21.15.100:0/1192180721 conn(0x7f1e240cb9b0 msgr2=0x7f1e2406c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:49.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.470+0000 7f1e2aa00640 1 -- 172.21.15.100:0/1192180721 shutdown_connections 2024-08-17T02:48:49.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.470+0000 7f1e2aa00640 1 -- 172.21.15.100:0/1192180721 wait complete. 2024-08-17T02:48:49.486 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:48:49.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.631+0000 7fd8ffe00640 1 Processor -- start 2024-08-17T02:48:49.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.631+0000 7fd8ffe00640 1 -- start start 2024-08-17T02:48:49.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.632+0000 7fd8ffe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd8f80b1440 0x7fd8f80caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:49.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.633+0000 7fd8ffe00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f80caa80 con 0x7fd8f8140580 2024-08-17T02:48:49.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.633+0000 7fd8ffe00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f80c9e70 con 0x7fd8f81401b0 2024-08-17T02:48:49.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.633+0000 7fd8ffe00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f80cb450 con 0x7fd8f80b1440 2024-08-17T02:48:49.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.633+0000 7fd8fca00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd8f80b1440 0x7fd8f80caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:49.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.633+0000 7fd8fca00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd8f80b1440 0x7fd8f80caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38134/0 (socket says 172.21.15.100:38134) 2024-08-17T02:48:49.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.633+0000 7fd8fca00640 1 -- 172.21.15.100:0/47292858 learned_addr learned my addr 172.21.15.100:0/47292858 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:49.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.633+0000 7fd8fde00640 1 --1- 172.21.15.100:0/47292858 >> v1:172.21.15.100:6789/0 conn(0x7fd8f8140580 0x7fd8f80c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46468/0 (socket says 172.21.15.100:46468) 2024-08-17T02:48:49.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.633+0000 7fd8fca00640 1 -- 172.21.15.100:0/47292858 >> v1:172.21.15.123:6789/0 conn(0x7fd8f81401b0 legacy=0x7fd8f80b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:49.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.633+0000 7fd8fca00640 1 -- 172.21.15.100:0/47292858 >> v1:172.21.15.100:6789/0 conn(0x7fd8f8140580 legacy=0x7fd8f80c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:49.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.633+0000 7fd8fca00640 1 -- 172.21.15.100:0/47292858 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f80ca150 con 0x7fd8f80b1440 2024-08-17T02:48:49.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.634+0000 7fd8fca00640 1 --2- 172.21.15.100:0/47292858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f80b1440 0x7fd8f80caf10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009910 tx=0x7fd8e40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270be1f25e0ed14d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:49.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.634+0000 7fd8f7e00640 1 -- 172.21.15.100:0/47292858 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4032440 con 0x7fd8f80b1440 2024-08-17T02:48:49.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.635+0000 7fd8f7e00640 1 -- 172.21.15.100:0/47292858 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e40325a0 con 0x7fd8f80b1440 2024-08-17T02:48:49.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.635+0000 7fd8f7e00640 1 -- 172.21.15.100:0/47292858 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4032980 con 0x7fd8f80b1440 2024-08-17T02:48:49.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.635+0000 7fd8ffe00640 1 -- 172.21.15.100:0/47292858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f80b1440 msgr2=0x7fd8f80caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:49.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.635+0000 7fd8ffe00640 1 --2- 172.21.15.100:0/47292858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f80b1440 0x7fd8f80caf10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009910 tx=0x7fd8e40091d0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.635+0000 7fd8ffe00640 1 -- 172.21.15.100:0/47292858 shutdown_connections 2024-08-17T02:48:49.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.635+0000 7fd8ffe00640 1 --2- 172.21.15.100:0/47292858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f80b1440 0x7fd8f80caf10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.635+0000 7fd8ffe00640 1 -- 172.21.15.100:0/47292858 >> 172.21.15.100:0/47292858 conn(0x7fd8f80cb9b0 msgr2=0x7fd8f80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:49.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.635+0000 7fd8ffe00640 1 -- 172.21.15.100:0/47292858 shutdown_connections 2024-08-17T02:48:49.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.635+0000 7fd8ffe00640 1 -- 172.21.15.100:0/47292858 wait complete. 2024-08-17T02:48:49.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.637+0000 7fd8ffe00640 1 Processor -- start 2024-08-17T02:48:49.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.637+0000 7fd8ffe00640 1 -- start start 2024-08-17T02:48:49.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.638+0000 7fd8ffe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8f80b1440 0x7fd8f8156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:49.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.638+0000 7fd8ffe00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8f81401b0 0x7fd8f8167970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:49.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.638+0000 7fd8ffe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f8140580 0x7fd8f80a61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:49.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.638+0000 7fd8ffe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f8156b60 con 0x7fd8f8140580 2024-08-17T02:48:49.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.638+0000 7fd8ffe00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f80c7d10 con 0x7fd8f80b1440 2024-08-17T02:48:49.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.638+0000 7fd8ffe00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f80c6f70 con 0x7fd8f81401b0 2024-08-17T02:48:49.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.638+0000 7fd8fde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f8140580 0x7fd8f80a61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:49.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.638+0000 7fd8fde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f8140580 0x7fd8f80a61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38136/0 (socket says 172.21.15.100:38136) 2024-08-17T02:48:49.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.638+0000 7fd8fde00640 1 -- 172.21.15.100:0/3496402846 learned_addr learned my addr 172.21.15.100:0/3496402846 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:49.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.638+0000 7fd8fd400640 1 --2- 172.21.15.100:0/3496402846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8f80b1440 0x7fd8f8156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:49.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.638+0000 7fd8fca00640 1 --2- 172.21.15.100:0/3496402846 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8f81401b0 0x7fd8f8167970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:49.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.638+0000 7fd8fde00640 1 -- 172.21.15.100:0/3496402846 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8f81401b0 msgr2=0x7fd8f8167970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:49.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.638+0000 7fd8fde00640 1 --2- 172.21.15.100:0/3496402846 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8f81401b0 0x7fd8f8167970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.638+0000 7fd8fde00640 1 -- 172.21.15.100:0/3496402846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8f80b1440 msgr2=0x7fd8f8156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:49.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.638+0000 7fd8fde00640 1 --2- 172.21.15.100:0/3496402846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8f80b1440 0x7fd8f8156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.638+0000 7fd8fde00640 1 -- 172.21.15.100:0/3496402846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e4009450 con 0x7fd8f8140580 2024-08-17T02:48:49.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.639+0000 7fd8fde00640 1 --2- 172.21.15.100:0/3496402846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f8140580 0x7fd8f80a61c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000c910 tx=0x7fd8f0001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:49.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.639+0000 7fd8f4c00640 1 -- 172.21.15.100:0/3496402846 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f000cea0 con 0x7fd8f8140580 2024-08-17T02:48:49.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.639+0000 7fd8f4c00640 1 -- 172.21.15.100:0/3496402846 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f0005d60 con 0x7fd8f8140580 2024-08-17T02:48:49.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.639+0000 7fd8f4c00640 1 -- 172.21.15.100:0/3496402846 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f000a870 con 0x7fd8f8140580 2024-08-17T02:48:49.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.639+0000 7fd8ffe00640 1 -- 172.21.15.100:0/3496402846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f80c73e0 con 0x7fd8f8140580 2024-08-17T02:48:49.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.639+0000 7fd8ffe00640 1 -- 172.21.15.100:0/3496402846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f80c79a0 con 0x7fd8f8140580 2024-08-17T02:48:49.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.640+0000 7fd8ffe00640 1 -- 172.21.15.100:0/3496402846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f8064db0 con 0x7fd8f8140580 2024-08-17T02:48:49.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.641+0000 7fd8f4c00640 1 -- 172.21.15.100:0/3496402846 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd8f000aca0 con 0x7fd8f8140580 2024-08-17T02:48:49.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.641+0000 7fd8f4c00640 1 --2- 172.21.15.100:0/3496402846 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd8d8065150 0x7fd8d8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:49.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.642+0000 7fd8f4c00640 1 -- 172.21.15.100:0/3496402846 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fd8f0082460 con 0x7fd8f8140580 2024-08-17T02:48:49.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.642+0000 7fd8fd400640 1 --2- 172.21.15.100:0/3496402846 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd8d8065150 0x7fd8d8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:49.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.642+0000 7fd8fd400640 1 --2- 172.21.15.100:0/3496402846 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd8d8065150 0x7fd8d8067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec007fd0 tx=0x7fd8ec007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:49.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.646+0000 7fd8f4c00640 1 -- 172.21.15.100:0/3496402846 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd8f0050230 con 0x7fd8f8140580 2024-08-17T02:48:49.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.818+0000 7fd8ffe00640 1 -- 172.21.15.100:0/3496402846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8f80c7e50 con 0x7fd8f8140580 2024-08-17T02:48:49.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.819+0000 7fd8f4c00640 1 -- 172.21.15.100:0/3496402846 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18647 (secure 0 0 0) 0x7fd8f0053850 con 0x7fd8f8140580 2024-08-17T02:48:49.823 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:48:49.823 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":38,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:46:45.796677+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:28.081485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:29.108765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000001028572.meta","create_time":"2024-08-17T02:46:40.913393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001028572"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001028572.data","create_time":"2024-08-17T02:46:41.819233+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001028572"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:48:49.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.821+0000 7fd8ffe00640 1 -- 172.21.15.100:0/3496402846 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd8d8065150 msgr2=0x7fd8d8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:49.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.821+0000 7fd8ffe00640 1 --2- 172.21.15.100:0/3496402846 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd8d8065150 0x7fd8d8067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec007fd0 tx=0x7fd8ec007e30 comp rx=0 tx=0).stop 2024-08-17T02:48:49.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.821+0000 7fd8ffe00640 1 -- 172.21.15.100:0/3496402846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f8140580 msgr2=0x7fd8f80a61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:49.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.821+0000 7fd8ffe00640 1 --2- 172.21.15.100:0/3496402846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f8140580 0x7fd8f80a61c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000c910 tx=0x7fd8f0001690 comp rx=0 tx=0).stop 2024-08-17T02:48:49.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.821+0000 7fd8ffe00640 1 -- 172.21.15.100:0/3496402846 shutdown_connections 2024-08-17T02:48:49.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.821+0000 7fd8ffe00640 1 --2- 172.21.15.100:0/3496402846 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd8d8065150 0x7fd8d8067600 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.821+0000 7fd8ffe00640 1 --2- 172.21.15.100:0/3496402846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8f8140580 0x7fd8f80a61c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.821+0000 7fd8ffe00640 1 --2- 172.21.15.100:0/3496402846 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8f81401b0 0x7fd8f8167970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.821+0000 7fd8ffe00640 1 --2- 172.21.15.100:0/3496402846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8f80b1440 0x7fd8f8156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.821+0000 7fd8ffe00640 1 -- 172.21.15.100:0/3496402846 >> 172.21.15.100:0/3496402846 conn(0x7fd8f80cb9b0 msgr2=0x7fd8f813eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.821+0000 7fd8ffe00640 1 -- 172.21.15.100:0/3496402846 shutdown_connections 2024-08-17T02:48:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.821+0000 7fd8ffe00640 1 -- 172.21.15.100:0/3496402846 wait complete. 2024-08-17T02:48:49.838 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:48:49.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.985+0000 7fc145c00640 1 Processor -- start 2024-08-17T02:48:49.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.986+0000 7fc145c00640 1 -- start start 2024-08-17T02:48:49.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.987+0000 7fc145c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc140158d40 0x7fc14006ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:49.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.987+0000 7fc145c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc1400aa290 0x7fc1400b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:49.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.987+0000 7fc145c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1400af590 con 0x7fc140158970 2024-08-17T02:48:49.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.987+0000 7fc145c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1400aed30 con 0x7fc1400aa290 2024-08-17T02:48:49.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.987+0000 7fc145c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1400b0130 con 0x7fc140158d40 2024-08-17T02:48:49.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.987+0000 7fc13fe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc140158970 0x7fc1400afa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46484/0 (socket says 172.21.15.100:46484) 2024-08-17T02:48:49.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.987+0000 7fc13fe00640 1 -- 172.21.15.100:0/3084072884 learned_addr learned my addr 172.21.15.100:0/3084072884 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:48:49.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.987+0000 7fc145200640 1 --2- 172.21.15.100:0/3084072884 >> v2:172.21.15.100:3300/0 conn(0x7fc1400aa290 0x7fc1400b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:49.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.987+0000 7fc13f400640 1 --2- 172.21.15.100:0/3084072884 >> v2:172.21.15.123:3300/0 conn(0x7fc140158d40 0x7fc14006ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:49.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.988+0000 7fc145200640 1 -- 172.21.15.100:0/3084072884 >> v2:172.21.15.123:3300/0 conn(0x7fc140158d40 msgr2=0x7fc14006ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:49.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.988+0000 7fc145200640 1 --2- 172.21.15.100:0/3084072884 >> v2:172.21.15.123:3300/0 conn(0x7fc140158d40 0x7fc14006ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.988+0000 7fc145200640 1 -- 172.21.15.100:0/3084072884 >> v1:172.21.15.100:6789/0 conn(0x7fc140158970 legacy=0x7fc1400afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:49.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.988+0000 7fc145200640 1 -- 172.21.15.100:0/3084072884 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1400aa9f0 con 0x7fc1400aa290 2024-08-17T02:48:49.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.989+0000 7fc145200640 1 --2- 172.21.15.100:0/3084072884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1400aa290 0x7fc1400b0380 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc1400cbc90 tx=0x7fc138009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a505562feea83056 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:49.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.989+0000 7fc13ea00640 1 -- 172.21.15.100:0/3084072884 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138007550 con 0x7fc1400aa290 2024-08-17T02:48:49.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.989+0000 7fc13ea00640 1 -- 172.21.15.100:0/3084072884 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13802d050 con 0x7fc1400aa290 2024-08-17T02:48:49.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.989+0000 7fc13ea00640 1 -- 172.21.15.100:0/3084072884 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138007920 con 0x7fc1400aa290 2024-08-17T02:48:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.989+0000 7fc145c00640 1 -- 172.21.15.100:0/3084072884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1400aa290 msgr2=0x7fc1400b0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.989+0000 7fc145c00640 1 --2- 172.21.15.100:0/3084072884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1400aa290 0x7fc1400b0380 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc1400cbc90 tx=0x7fc138009780 comp rx=0 tx=0).stop 2024-08-17T02:48:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.989+0000 7fc145c00640 1 -- 172.21.15.100:0/3084072884 shutdown_connections 2024-08-17T02:48:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.990+0000 7fc145c00640 1 --2- 172.21.15.100:0/3084072884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1400aa290 0x7fc1400b0380 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.990+0000 7fc145c00640 1 --2- 172.21.15.100:0/3084072884 >> v2:172.21.15.123:3300/0 conn(0x7fc140158d40 0x7fc14006ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.990+0000 7fc145c00640 1 -- 172.21.15.100:0/3084072884 >> 172.21.15.100:0/3084072884 conn(0x7fc140067750 msgr2=0x7fc140068c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.990+0000 7fc145c00640 1 -- 172.21.15.100:0/3084072884 shutdown_connections 2024-08-17T02:48:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.990+0000 7fc145c00640 1 -- 172.21.15.100:0/3084072884 wait complete. 2024-08-17T02:48:49.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.991+0000 7fc145c00640 1 Processor -- start 2024-08-17T02:48:49.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.991+0000 7fc145c00640 1 -- start start 2024-08-17T02:48:49.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.992+0000 7fc145c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1400aa290 0x7fc14015be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:49.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.992+0000 7fc145c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc140158970 0x7fc140168a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:49.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.992+0000 7fc145c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc140158d40 0x7fc140148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:49.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.992+0000 7fc145c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14015c390 con 0x7fc1400aa290 2024-08-17T02:48:49.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.992+0000 7fc145c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1400c0cb0 con 0x7fc140158970 2024-08-17T02:48:49.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.992+0000 7fc145c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1400c0f90 con 0x7fc140158d40 2024-08-17T02:48:49.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.992+0000 7fc13fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1400aa290 0x7fc14015be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:49.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.992+0000 7fc13fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1400aa290 0x7fc14015be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38150/0 (socket says 172.21.15.100:38150) 2024-08-17T02:48:49.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.992+0000 7fc13fe00640 1 -- 172.21.15.100:0/3277106901 learned_addr learned my addr 172.21.15.100:0/3277106901 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:49.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.992+0000 7fc145200640 1 --2- 172.21.15.100:0/3277106901 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc140158d40 0x7fc140148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:49.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.992+0000 7fc13f400640 1 --2- 172.21.15.100:0/3277106901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc140158970 0x7fc140168a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:49.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.993+0000 7fc13fe00640 1 -- 172.21.15.100:0/3277106901 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc140158d40 msgr2=0x7fc140148510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:49.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.993+0000 7fc13fe00640 1 --2- 172.21.15.100:0/3277106901 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc140158d40 0x7fc140148510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.993+0000 7fc13fe00640 1 -- 172.21.15.100:0/3277106901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc140158970 msgr2=0x7fc140168a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:49.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.993+0000 7fc13fe00640 1 --2- 172.21.15.100:0/3277106901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc140158970 0x7fc140168a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:49.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.993+0000 7fc13fe00640 1 -- 172.21.15.100:0/3277106901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc138009a20 con 0x7fc1400aa290 2024-08-17T02:48:49.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.993+0000 7fc13f400640 1 --2- 172.21.15.100:0/3277106901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc140158970 0x7fc140168a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:48:49.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.993+0000 7fc145200640 1 --2- 172.21.15.100:0/3277106901 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc140158d40 0x7fc140148510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:48:49.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.993+0000 7fc13fe00640 1 --2- 172.21.15.100:0/3277106901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1400aa290 0x7fc14015be50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc13000c590 tx=0x7fc130007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:49.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.993+0000 7fc137400640 1 -- 172.21.15.100:0/3277106901 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc130005aa0 con 0x7fc1400aa290 2024-08-17T02:48:49.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.993+0000 7fc137400640 1 -- 172.21.15.100:0/3277106901 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc130005c20 con 0x7fc1400aa290 2024-08-17T02:48:49.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.993+0000 7fc137400640 1 -- 172.21.15.100:0/3277106901 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1300070f0 con 0x7fc1400aa290 2024-08-17T02:48:49.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.993+0000 7fc145c00640 1 -- 172.21.15.100:0/3277106901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1400c1270 con 0x7fc1400aa290 2024-08-17T02:48:49.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.993+0000 7fc145c00640 1 -- 172.21.15.100:0/3277106901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1400c1830 con 0x7fc1400aa290 2024-08-17T02:48:49.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.994+0000 7fc145c00640 1 -- 172.21.15.100:0/3277106901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc140071050 con 0x7fc1400aa290 2024-08-17T02:48:49.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.995+0000 7fc137400640 1 -- 172.21.15.100:0/3277106901 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc130007540 con 0x7fc1400aa290 2024-08-17T02:48:49.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.996+0000 7fc137400640 1 --2- 172.21.15.100:0/3277106901 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc120065150 0x7fc120067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:49.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.996+0000 7fc137400640 1 -- 172.21.15.100:0/3277106901 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fc130081870 con 0x7fc1400aa290 2024-08-17T02:48:49.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.996+0000 7fc13f400640 1 --2- 172.21.15.100:0/3277106901 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc120065150 0x7fc120067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:49.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:49.997+0000 7fc13f400640 1 --2- 172.21.15.100:0/3277106901 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc120065150 0x7fc120067600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc12c006e70 tx=0x7fc12c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:50.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.000+0000 7fc137400640 1 -- 172.21.15.100:0/3277106901 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc13004f630 con 0x7fc1400aa290 2024-08-17T02:48:50.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.209+0000 7fc145c00640 1 -- 172.21.15.100:0/3277106901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc14006b230 con 0x7fc1400aa290 2024-08-17T02:48:50.211 INFO:tasks.ceph.mon.a.smithi100.stderr:2024-08-17T02:48:50.210+0000 7f3a9f600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:48:50.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.217+0000 7fc137400640 1 -- 172.21.15.100:0/3277106901 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc130052c50 con 0x7fc1400aa290 2024-08-17T02:48:50.219 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:48:50.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.220+0000 7fc145c00640 1 -- 172.21.15.100:0/3277106901 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc120065150 msgr2=0x7fc120067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:50.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.220+0000 7fc145c00640 1 --2- 172.21.15.100:0/3277106901 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc120065150 0x7fc120067600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc12c006e70 tx=0x7fc12c008040 comp rx=0 tx=0).stop 2024-08-17T02:48:50.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.220+0000 7fc145c00640 1 -- 172.21.15.100:0/3277106901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1400aa290 msgr2=0x7fc14015be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:50.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.220+0000 7fc145c00640 1 --2- 172.21.15.100:0/3277106901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1400aa290 0x7fc14015be50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc13000c590 tx=0x7fc130007ee0 comp rx=0 tx=0).stop 2024-08-17T02:48:50.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.220+0000 7fc145c00640 1 -- 172.21.15.100:0/3277106901 shutdown_connections 2024-08-17T02:48:50.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.220+0000 7fc145c00640 1 --2- 172.21.15.100:0/3277106901 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc120065150 0x7fc120067600 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:50.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.220+0000 7fc145c00640 1 --2- 172.21.15.100:0/3277106901 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc140158d40 0x7fc140148510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:50.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.220+0000 7fc145c00640 1 --2- 172.21.15.100:0/3277106901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc140158970 0x7fc140168a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:50.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.220+0000 7fc145c00640 1 --2- 172.21.15.100:0/3277106901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1400aa290 0x7fc14015be50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:50.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.220+0000 7fc145c00640 1 -- 172.21.15.100:0/3277106901 >> 172.21.15.100:0/3277106901 conn(0x7fc140067750 msgr2=0x7fc14015d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:50.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.220+0000 7fc145c00640 1 -- 172.21.15.100:0/3277106901 shutdown_connections 2024-08-17T02:48:50.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.220+0000 7fc145c00640 1 -- 172.21.15.100:0/3277106901 wait complete. 2024-08-17T02:48:50.229 INFO:tasks.ceph.mds.b.smithi123.stderr: -7210> 2024-08-17T02:46:34.687+0000 7f92cfe00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:48:50.237 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:48:50.272 INFO:tasks.ceph.mds.b.smithi123.stdout:starting mds.b at 2024-08-17T02:48:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.387+0000 7f44fa400640 1 Processor -- start 2024-08-17T02:48:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.387+0000 7f44fa400640 1 -- start start 2024-08-17T02:48:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.388+0000 7f44fa400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f44f40aedc0 0x7f44f40af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.388+0000 7f44fa400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f40afbd0 con 0x7f44f4155a30 2024-08-17T02:48:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.388+0000 7f44fa400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f40ac220 con 0x7f44f40aaa10 2024-08-17T02:48:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.388+0000 7f44fa400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f40aca80 con 0x7f44f40aedc0 2024-08-17T02:48:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.388+0000 7f44f9000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f44f4155a30 0x7f44f40b0060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46492/0 (socket says 172.21.15.100:46492) 2024-08-17T02:48:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.388+0000 7f44f9000640 1 -- 172.21.15.100:0/3978784389 learned_addr learned my addr 172.21.15.100:0/3978784389 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:48:50.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.389+0000 7f44f3e00640 1 -- 172.21.15.100:0/3978784389 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156950971 0 0) 0x7f44f40afbd0 con 0x7f44f4155a30 2024-08-17T02:48:50.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.389+0000 7f44f3e00640 1 -- 172.21.15.100:0/3978784389 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44d80034e0 con 0x7f44f4155a30 2024-08-17T02:48:50.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.389+0000 7f44f9a00640 1 --2- 172.21.15.100:0/3978784389 >> v2:172.21.15.123:3300/0 conn(0x7f44f40aedc0 0x7f44f40af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.389+0000 7f44f3e00640 1 -- 172.21.15.100:0/3978784389 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3991249933 0 0) 0x7f44d80034e0 con 0x7f44f4155a30 2024-08-17T02:48:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.389+0000 7f44f3e00640 1 -- 172.21.15.100:0/3978784389 >> v2:172.21.15.123:3300/0 conn(0x7f44f40aedc0 msgr2=0x7f44f40af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.389+0000 7f44f3e00640 1 --2- 172.21.15.100:0/3978784389 >> v2:172.21.15.123:3300/0 conn(0x7f44f40aedc0 0x7f44f40af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.389+0000 7f44f3e00640 1 -- 172.21.15.100:0/3978784389 >> v1:172.21.15.123:6789/0 conn(0x7f44f40aaa10 legacy=0x7f44f40ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.389+0000 7f44f3e00640 1 -- 172.21.15.100:0/3978784389 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f40ac4c0 con 0x7f44f4155a30 2024-08-17T02:48:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.389+0000 7f44f3e00640 1 -- 172.21.15.100:0/3978784389 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1817143124 0 0) 0x7f44e4001470 con 0x7f44f4155a30 2024-08-17T02:48:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.389+0000 7f44f3e00640 1 -- 172.21.15.100:0/3978784389 >> v1:172.21.15.100:6789/0 conn(0x7f44f4155a30 legacy=0x7f44f40b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.389+0000 7f44f3e00640 1 --2- 172.21.15.100:0/3978784389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44d80039d0 0x7f44d8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.389+0000 7f44f3e00640 1 --2- 172.21.15.100:0/3978784389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44d8004780 0x7f44d8004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.389+0000 7f44f3e00640 1 --2- 172.21.15.100:0/3978784389 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44d8005130 0x7f44d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.389+0000 7f44f3e00640 1 -- 172.21.15.100:0/3978784389 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40aca80 con 0x7f44d8004780 2024-08-17T02:48:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.389+0000 7f44f3e00640 1 -- 172.21.15.100:0/3978784389 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d800bfc0 con 0x7f44d80039d0 2024-08-17T02:48:50.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.389+0000 7f44f3e00640 1 -- 172.21.15.100:0/3978784389 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d800e390 con 0x7f44d8005130 2024-08-17T02:48:50.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.389+0000 7f44ebe00640 1 --2- 172.21.15.100:0/3978784389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44d8004780 0x7f44d8004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:50.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.389+0000 7f44f9000640 1 --2- 172.21.15.100:0/3978784389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44d80039d0 0x7f44d8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:50.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.390+0000 7f44f9a00640 1 --2- 172.21.15.100:0/3978784389 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44d8005130 0x7f44d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:50.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.390+0000 7f44ebe00640 1 -- 172.21.15.100:0/3978784389 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44d8005130 msgr2=0x7f44d800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:50.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.390+0000 7f44ebe00640 1 --2- 172.21.15.100:0/3978784389 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44d8005130 0x7f44d800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:50.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.390+0000 7f44ebe00640 1 -- 172.21.15.100:0/3978784389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44d80039d0 msgr2=0x7f44d8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:50.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.390+0000 7f44ebe00640 1 --2- 172.21.15.100:0/3978784389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44d80039d0 0x7f44d8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:50.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.390+0000 7f44f9a00640 1 -- 172.21.15.100:0/3978784389 reap_dead start 2024-08-17T02:48:50.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.390+0000 7f44ebe00640 1 -- 172.21.15.100:0/3978784389 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d80034e0 con 0x7f44d8004780 2024-08-17T02:48:50.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.390+0000 7f44f9000640 1 --2- 172.21.15.100:0/3978784389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44d80039d0 0x7f44d8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:48:50.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.391+0000 7f44ebe00640 1 --2- 172.21.15.100:0/3978784389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44d8004780 0x7f44d8004bf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f44dc001920 tx=0x7f44dc007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da6241f96833151 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:50.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.391+0000 7f44f3e00640 1 -- 172.21.15.100:0/3978784389 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc02aab0 con 0x7f44d8004780 2024-08-17T02:48:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.391+0000 7f44f3e00640 1 -- 172.21.15.100:0/3978784389 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc02ac30 con 0x7f44d8004780 2024-08-17T02:48:50.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.391+0000 7f44f3e00640 1 -- 172.21.15.100:0/3978784389 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc0323f0 con 0x7f44d8004780 2024-08-17T02:48:50.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.392+0000 7f44fa400640 1 -- 172.21.15.100:0/3978784389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44d8004780 msgr2=0x7f44d8004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:50.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.392+0000 7f44fa400640 1 --2- 172.21.15.100:0/3978784389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44d8004780 0x7f44d8004bf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f44dc001920 tx=0x7f44dc007c80 comp rx=0 tx=0).stop 2024-08-17T02:48:50.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.392+0000 7f44fa400640 1 -- 172.21.15.100:0/3978784389 shutdown_connections 2024-08-17T02:48:50.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.392+0000 7f44fa400640 1 --2- 172.21.15.100:0/3978784389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44d8004780 0x7f44d8004bf0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:50.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.392+0000 7f44fa400640 1 -- 172.21.15.100:0/3978784389 >> 172.21.15.100:0/3978784389 conn(0x7f44f4067750 msgr2=0x7f44f40cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:50.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.392+0000 7f44fa400640 1 -- 172.21.15.100:0/3978784389 shutdown_connections 2024-08-17T02:48:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.392+0000 7f44fa400640 1 -- 172.21.15.100:0/3978784389 wait complete. 2024-08-17T02:48:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.393+0000 7f44fa400640 1 Processor -- start 2024-08-17T02:48:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.393+0000 7f44fa400640 1 -- start start 2024-08-17T02:48:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.394+0000 7f44fa400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44d8004780 0x7f44f4158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.394+0000 7f44fa400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44f413e090 0x7f44f4156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.394+0000 7f44fa400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f413e4e0 0x7f44f4157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.394+0000 7f44fa400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f41583d0 con 0x7f44f413e090 2024-08-17T02:48:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.394+0000 7f44fa400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f41577c0 con 0x7f44f413e4e0 2024-08-17T02:48:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.394+0000 7f44fa400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f4157aa0 con 0x7f44d8004780 2024-08-17T02:48:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.395+0000 7f44ebe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44f413e090 0x7f44f4156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.395+0000 7f44ebe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44f413e090 0x7f44f4156c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38170/0 (socket says 172.21.15.100:38170) 2024-08-17T02:48:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.395+0000 7f44ebe00640 1 -- 172.21.15.100:0/2469758328 learned_addr learned my addr 172.21.15.100:0/2469758328 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:50.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.395+0000 7f44f9000640 1 --2- 172.21.15.100:0/2469758328 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44d8004780 0x7f44f4158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.395+0000 7f44f9a00640 1 --2- 172.21.15.100:0/2469758328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f413e4e0 0x7f44f4157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.395+0000 7f44ebe00640 1 -- 172.21.15.100:0/2469758328 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44d8004780 msgr2=0x7f44f4158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.395+0000 7f44ebe00640 1 --2- 172.21.15.100:0/2469758328 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44d8004780 0x7f44f4158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.395+0000 7f44ebe00640 1 -- 172.21.15.100:0/2469758328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f413e4e0 msgr2=0x7f44f4157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.395+0000 7f44ebe00640 1 --2- 172.21.15.100:0/2469758328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f413e4e0 0x7f44f4157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.395+0000 7f44ebe00640 1 -- 172.21.15.100:0/2469758328 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f4157d80 con 0x7f44f413e090 2024-08-17T02:48:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.395+0000 7f44ebe00640 1 --2- 172.21.15.100:0/2469758328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44f413e090 0x7f44f4156c50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f44dc02a5a0 tx=0x7f44dc003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.396+0000 7f44f0c00640 1 -- 172.21.15.100:0/2469758328 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc040070 con 0x7f44f413e090 2024-08-17T02:48:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.396+0000 7f44f0c00640 1 -- 172.21.15.100:0/2469758328 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc007320 con 0x7f44f413e090 2024-08-17T02:48:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.396+0000 7f44fa400640 1 -- 172.21.15.100:0/2469758328 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f4158060 con 0x7f44f413e090 2024-08-17T02:48:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.396+0000 7f44f0c00640 1 -- 172.21.15.100:0/2469758328 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc006790 con 0x7f44f413e090 2024-08-17T02:48:50.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.396+0000 7f44fa400640 1 -- 172.21.15.100:0/2469758328 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f40a5e00 con 0x7f44f413e090 2024-08-17T02:48:50.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.397+0000 7f44fa400640 1 -- 172.21.15.100:0/2469758328 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f4158da0 con 0x7f44f413e090 2024-08-17T02:48:50.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.398+0000 7f44f0c00640 1 -- 172.21.15.100:0/2469758328 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f44dc006b40 con 0x7f44f413e090 2024-08-17T02:48:50.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.398+0000 7f44f0c00640 1 --2- 172.21.15.100:0/2469758328 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f44d0065150 0x7f44d0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:50.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.398+0000 7f44f0c00640 1 -- 172.21.15.100:0/2469758328 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f44dc0a1ed0 con 0x7f44f413e090 2024-08-17T02:48:50.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.399+0000 7f44f9000640 1 --2- 172.21.15.100:0/2469758328 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f44d0065150 0x7f44d0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:50.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.399+0000 7f44f9000640 1 --2- 172.21.15.100:0/2469758328 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f44d0065150 0x7f44d0067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f44e4001200 tx=0x7f44f40ac3b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:50.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.403+0000 7f44f0c00640 1 -- 172.21.15.100:0/2469758328 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f44dc06fd20 con 0x7f44f413e090 2024-08-17T02:48:50.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:50.617+0000 7f44fa400640 1 -- 172.21.15.100:0/2469758328 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f44f4071050 con 0x7f44f413e090 2024-08-17T02:48:51.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.216+0000 7f44f0c00640 1 -- 172.21.15.100:0/2469758328 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7f44dc073340 con 0x7f44f413e090 2024-08-17T02:48:51.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.219+0000 7f44fa400640 1 -- 172.21.15.100:0/2469758328 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f44d0065150 msgr2=0x7f44d0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:51.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.219+0000 7f44fa400640 1 --2- 172.21.15.100:0/2469758328 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f44d0065150 0x7f44d0067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f44e4001200 tx=0x7f44f40ac3b0 comp rx=0 tx=0).stop 2024-08-17T02:48:51.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.219+0000 7f44fa400640 1 -- 172.21.15.100:0/2469758328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44f413e090 msgr2=0x7f44f4156c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:51.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.219+0000 7f44fa400640 1 --2- 172.21.15.100:0/2469758328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44f413e090 0x7f44f4156c50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f44dc02a5a0 tx=0x7f44dc003000 comp rx=0 tx=0).stop 2024-08-17T02:48:51.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.219+0000 7f44fa400640 1 -- 172.21.15.100:0/2469758328 shutdown_connections 2024-08-17T02:48:51.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.219+0000 7f44fa400640 1 --2- 172.21.15.100:0/2469758328 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f44d0065150 0x7f44d0067600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:51.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.219+0000 7f44fa400640 1 --2- 172.21.15.100:0/2469758328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f413e4e0 0x7f44f4157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:51.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.219+0000 7f44fa400640 1 --2- 172.21.15.100:0/2469758328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44f413e090 0x7f44f4156c50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:51.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.219+0000 7f44fa400640 1 --2- 172.21.15.100:0/2469758328 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44d8004780 0x7f44f4158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:51.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.219+0000 7f44fa400640 1 -- 172.21.15.100:0/2469758328 >> 172.21.15.100:0/2469758328 conn(0x7f44f4067750 msgr2=0x7f44f406c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:51.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.219+0000 7f44fa400640 1 -- 172.21.15.100:0/2469758328 shutdown_connections 2024-08-17T02:48:51.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.219+0000 7f44fa400640 1 -- 172.21.15.100:0/2469758328 wait complete. 2024-08-17T02:48:51.236 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:48:51.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.386+0000 7f8e4f800640 1 Processor -- start 2024-08-17T02:48:51.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.386+0000 7f8e4f800640 1 -- start start 2024-08-17T02:48:51.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.388+0000 7f8e4f800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8e4806e5f0 0x7f8e480c8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.388+0000 7f8e4f800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8e48156c60 0x7f8e480c8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.388+0000 7f8e4f800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e480ae9b0 con 0x7f8e48156890 2024-08-17T02:48:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.388+0000 7f8e4f800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e480c8bb0 con 0x7f8e4806e5f0 2024-08-17T02:48:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.388+0000 7f8e4f800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e480aa730 con 0x7f8e48156c60 2024-08-17T02:48:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.388+0000 7f8e3fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8e4806e5f0 0x7f8e480c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.388+0000 7f8e3fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8e4806e5f0 0x7f8e480c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38182/0 (socket says 172.21.15.100:38182) 2024-08-17T02:48:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.388+0000 7f8e3fe00640 1 -- 172.21.15.100:0/1472087107 learned_addr learned my addr 172.21.15.100:0/1472087107 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.388+0000 7f8e4d800640 1 --2- 172.21.15.100:0/1472087107 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8e48156c60 0x7f8e480c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.388+0000 7f8e3fe00640 1 -- 172.21.15.100:0/1472087107 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8e48156c60 msgr2=0x7f8e480c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.388+0000 7f8e3fe00640 1 --2- 172.21.15.100:0/1472087107 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8e48156c60 0x7f8e480c8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.388+0000 7f8e3fe00640 1 -- 172.21.15.100:0/1472087107 >> v1:172.21.15.123:6789/0 conn(0x7f8e48156890 legacy=0x7f8e4806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.388+0000 7f8e3fe00640 1 -- 172.21.15.100:0/1472087107 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e480ab320 con 0x7f8e4806e5f0 2024-08-17T02:48:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.388+0000 7f8e4d800640 1 --2- 172.21.15.100:0/1472087107 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8e48156c60 0x7f8e480c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:48:51.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.389+0000 7f8e3fe00640 1 --2- 172.21.15.100:0/1472087107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e4806e5f0 0x7f8e480c8130 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8e30009910 tx=0x7f8e300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a8a129e137d088 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:51.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.389+0000 7f8e47e00640 1 -- 172.21.15.100:0/1472087107 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3002ad40 con 0x7f8e4806e5f0 2024-08-17T02:48:51.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.389+0000 7f8e47e00640 1 -- 172.21.15.100:0/1472087107 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e30032440 con 0x7f8e4806e5f0 2024-08-17T02:48:51.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.389+0000 7f8e47e00640 1 -- 172.21.15.100:0/1472087107 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3002aea0 con 0x7f8e4806e5f0 2024-08-17T02:48:51.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.390+0000 7f8e4f800640 1 -- 172.21.15.100:0/1472087107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e4806e5f0 msgr2=0x7f8e480c8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:51.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.390+0000 7f8e4f800640 1 --2- 172.21.15.100:0/1472087107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e4806e5f0 0x7f8e480c8130 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8e30009910 tx=0x7f8e300091d0 comp rx=0 tx=0).stop 2024-08-17T02:48:51.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.390+0000 7f8e4f800640 1 -- 172.21.15.100:0/1472087107 shutdown_connections 2024-08-17T02:48:51.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.390+0000 7f8e4f800640 1 --2- 172.21.15.100:0/1472087107 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8e48156c60 0x7f8e480c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:51.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.390+0000 7f8e4f800640 1 --2- 172.21.15.100:0/1472087107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e4806e5f0 0x7f8e480c8130 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:51.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.390+0000 7f8e4f800640 1 -- 172.21.15.100:0/1472087107 >> 172.21.15.100:0/1472087107 conn(0x7f8e48067750 msgr2=0x7f8e4806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:51.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.390+0000 7f8e4f800640 1 -- 172.21.15.100:0/1472087107 shutdown_connections 2024-08-17T02:48:51.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.390+0000 7f8e4f800640 1 -- 172.21.15.100:0/1472087107 wait complete. 2024-08-17T02:48:51.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.391+0000 7f8e4f800640 1 Processor -- start 2024-08-17T02:48:51.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.392+0000 7f8e4f800640 1 -- start start 2024-08-17T02:48:51.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.392+0000 7f8e4f800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e4806e5f0 0x7f8e48150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:51.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.392+0000 7f8e4f800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e48156890 0x7f8e4814fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:51.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.392+0000 7f8e4f800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8e48156c60 0x7f8e4814ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:51.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.392+0000 7f8e4f800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4814efd0 con 0x7f8e4806e5f0 2024-08-17T02:48:51.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.392+0000 7f8e4f800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4814f460 con 0x7f8e48156890 2024-08-17T02:48:51.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.392+0000 7f8e4f800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4814e3c0 con 0x7f8e48156c60 2024-08-17T02:48:51.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.393+0000 7f8e4ce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e4806e5f0 0x7f8e48150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:51.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.393+0000 7f8e4ce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e4806e5f0 0x7f8e48150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38186/0 (socket says 172.21.15.100:38186) 2024-08-17T02:48:51.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.393+0000 7f8e3fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e48156890 0x7f8e4814fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:51.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.393+0000 7f8e4ce00640 1 -- 172.21.15.100:0/2588608676 learned_addr learned my addr 172.21.15.100:0/2588608676 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:51.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.393+0000 7f8e4d800640 1 --2- 172.21.15.100:0/2588608676 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8e48156c60 0x7f8e4814ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:51.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.393+0000 7f8e4ce00640 1 -- 172.21.15.100:0/2588608676 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8e48156c60 msgr2=0x7f8e4814ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:51.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.393+0000 7f8e4ce00640 1 --2- 172.21.15.100:0/2588608676 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8e48156c60 0x7f8e4814ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:51.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.393+0000 7f8e4ce00640 1 -- 172.21.15.100:0/2588608676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e48156890 msgr2=0x7f8e4814fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:51.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.393+0000 7f8e4ce00640 1 --2- 172.21.15.100:0/2588608676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e48156890 0x7f8e4814fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:51.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.393+0000 7f8e4ce00640 1 -- 172.21.15.100:0/2588608676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e30009450 con 0x7f8e4806e5f0 2024-08-17T02:48:51.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.394+0000 7f8e4ce00640 1 --2- 172.21.15.100:0/2588608676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e4806e5f0 0x7f8e48150b80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8e3800c5e0 tx=0x7f8e38007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:51.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.394+0000 7f8e44c00640 1 -- 172.21.15.100:0/2588608676 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38012630 con 0x7f8e4806e5f0 2024-08-17T02:48:51.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.394+0000 7f8e44c00640 1 -- 172.21.15.100:0/2588608676 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e380127b0 con 0x7f8e4806e5f0 2024-08-17T02:48:51.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.394+0000 7f8e44c00640 1 -- 172.21.15.100:0/2588608676 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38012bb0 con 0x7f8e4806e5f0 2024-08-17T02:48:51.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.394+0000 7f8e4f800640 1 -- 172.21.15.100:0/2588608676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4814e6a0 con 0x7f8e4806e5f0 2024-08-17T02:48:51.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.394+0000 7f8e4f800640 1 -- 172.21.15.100:0/2588608676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4814ec60 con 0x7f8e4806e5f0 2024-08-17T02:48:51.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.395+0000 7f8e4f800640 1 -- 172.21.15.100:0/2588608676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e480710c0 con 0x7f8e4806e5f0 2024-08-17T02:48:51.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.396+0000 7f8e44c00640 1 -- 172.21.15.100:0/2588608676 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8e3801a3b0 con 0x7f8e4806e5f0 2024-08-17T02:48:51.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.396+0000 7f8e44c00640 1 --2- 172.21.15.100:0/2588608676 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8e24065150 0x7f8e24067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:51.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.397+0000 7f8e44c00640 1 -- 172.21.15.100:0/2588608676 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f8e380822d0 con 0x7f8e4806e5f0 2024-08-17T02:48:51.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.397+0000 7f8e3fe00640 1 --2- 172.21.15.100:0/2588608676 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8e24065150 0x7f8e24067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:51.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.397+0000 7f8e3fe00640 1 --2- 172.21.15.100:0/2588608676 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8e24065150 0x7f8e24067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8e30034000 tx=0x7f8e30032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:51.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.401+0000 7f8e44c00640 1 -- 172.21.15.100:0/2588608676 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8e3804ffc0 con 0x7f8e4806e5f0 2024-08-17T02:48:51.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:51.573+0000 7f8e4f800640 1 -- 172.21.15.100:0/2588608676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8e480650c0 con 0x7f8e4806e5f0 2024-08-17T02:48:52.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.421+0000 7f8e44c00640 1 -- 172.21.15.100:0/2588608676 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8e380535e0 con 0x7f8e4806e5f0 2024-08-17T02:48:52.424 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:48:52.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.425+0000 7f8e4f800640 1 -- 172.21.15.100:0/2588608676 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8e24065150 msgr2=0x7f8e24067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.425+0000 7f8e4f800640 1 --2- 172.21.15.100:0/2588608676 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8e24065150 0x7f8e24067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8e30034000 tx=0x7f8e30032000 comp rx=0 tx=0).stop 2024-08-17T02:48:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.425+0000 7f8e4f800640 1 -- 172.21.15.100:0/2588608676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e4806e5f0 msgr2=0x7f8e48150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.425+0000 7f8e4f800640 1 --2- 172.21.15.100:0/2588608676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e4806e5f0 0x7f8e48150b80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8e3800c5e0 tx=0x7f8e38007ed0 comp rx=0 tx=0).stop 2024-08-17T02:48:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.426+0000 7f8e4f800640 1 -- 172.21.15.100:0/2588608676 shutdown_connections 2024-08-17T02:48:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.426+0000 7f8e4f800640 1 --2- 172.21.15.100:0/2588608676 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f8e24065150 0x7f8e24067600 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.426+0000 7f8e4f800640 1 --2- 172.21.15.100:0/2588608676 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8e48156c60 0x7f8e4814ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.426+0000 7f8e4f800640 1 --2- 172.21.15.100:0/2588608676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e48156890 0x7f8e4814fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.426+0000 7f8e4f800640 1 --2- 172.21.15.100:0/2588608676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e4806e5f0 0x7f8e48150b80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.426+0000 7f8e4f800640 1 -- 172.21.15.100:0/2588608676 >> 172.21.15.100:0/2588608676 conn(0x7f8e48067750 msgr2=0x7f8e48153510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.426+0000 7f8e4f800640 1 -- 172.21.15.100:0/2588608676 shutdown_connections 2024-08-17T02:48:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.426+0000 7f8e4f800640 1 -- 172.21.15.100:0/2588608676 wait complete. 2024-08-17T02:48:52.448 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:48:52.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.601+0000 7f64f2c00640 1 Processor -- start 2024-08-17T02:48:52.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.601+0000 7f64f2c00640 1 -- start start 2024-08-17T02:48:52.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.603+0000 7f64f2c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f64ec0adbb0 0x7f64ec0af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:52.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.603+0000 7f64f2c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f64ec157140 0x7f64ec1575a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:52.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.603+0000 7f64f2c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ec0aec80 con 0x7f64ec1510b0 2024-08-17T02:48:52.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.603+0000 7f64f2c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ec0af650 con 0x7f64ec0adbb0 2024-08-17T02:48:52.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.603+0000 7f64f2c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec157ae0 con 0x7f64ec157140 2024-08-17T02:48:52.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.603+0000 7f64f0e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f64ec0adbb0 0x7f64ec0af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:52.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.603+0000 7f64f0e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f64ec0adbb0 0x7f64ec0af110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38188/0 (socket says 172.21.15.100:38188) 2024-08-17T02:48:52.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.603+0000 7f64f0e00640 1 -- 172.21.15.100:0/2892254057 learned_addr learned my addr 172.21.15.100:0/2892254057 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:52.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.603+0000 7f64f2200640 1 --2- 172.21.15.100:0/2892254057 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f64ec157140 0x7f64ec1575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:52.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.603+0000 7f64f0e00640 1 -- 172.21.15.100:0/2892254057 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f64ec157140 msgr2=0x7f64ec1575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:52.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.603+0000 7f64f0e00640 1 --2- 172.21.15.100:0/2892254057 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f64ec157140 0x7f64ec1575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:52.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.603+0000 7f64f0e00640 1 -- 172.21.15.100:0/2892254057 >> v1:172.21.15.123:6789/0 conn(0x7f64ec1510b0 legacy=0x7f64ec0ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:52.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.603+0000 7f64f0e00640 1 -- 172.21.15.100:0/2892254057 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec0cc6a0 con 0x7f64ec0adbb0 2024-08-17T02:48:52.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.604+0000 7f64f0e00640 1 --2- 172.21.15.100:0/2892254057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64ec0adbb0 0x7f64ec0af110 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f64d8009910 tx=0x7f64d80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da335aaf5a43758a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:52.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.605+0000 7f64ebe00640 1 -- 172.21.15.100:0/2892254057 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d802ae40 con 0x7f64ec0adbb0 2024-08-17T02:48:52.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.605+0000 7f64ebe00640 1 -- 172.21.15.100:0/2892254057 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d8032440 con 0x7f64ec0adbb0 2024-08-17T02:48:52.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.605+0000 7f64ebe00640 1 -- 172.21.15.100:0/2892254057 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d8032820 con 0x7f64ec0adbb0 2024-08-17T02:48:52.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.605+0000 7f64f2c00640 1 -- 172.21.15.100:0/2892254057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64ec0adbb0 msgr2=0x7f64ec0af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:52.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.605+0000 7f64f2c00640 1 --2- 172.21.15.100:0/2892254057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64ec0adbb0 0x7f64ec0af110 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f64d8009910 tx=0x7f64d80091d0 comp rx=0 tx=0).stop 2024-08-17T02:48:52.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.605+0000 7f64f2c00640 1 -- 172.21.15.100:0/2892254057 shutdown_connections 2024-08-17T02:48:52.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.605+0000 7f64f2c00640 1 --2- 172.21.15.100:0/2892254057 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f64ec157140 0x7f64ec1575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:52.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.605+0000 7f64f2c00640 1 --2- 172.21.15.100:0/2892254057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64ec0adbb0 0x7f64ec0af110 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:52.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.605+0000 7f64f2c00640 1 -- 172.21.15.100:0/2892254057 >> 172.21.15.100:0/2892254057 conn(0x7f64ec067750 msgr2=0x7f64ec0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:52.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.605+0000 7f64f2c00640 1 -- 172.21.15.100:0/2892254057 shutdown_connections 2024-08-17T02:48:52.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.605+0000 7f64f2c00640 1 -- 172.21.15.100:0/2892254057 wait complete. 2024-08-17T02:48:52.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.607+0000 7f64f2c00640 1 Processor -- start 2024-08-17T02:48:52.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.607+0000 7f64f2c00640 1 -- start start 2024-08-17T02:48:52.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.608+0000 7f64f2c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64ec0adbb0 0x7f64ec14f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:52.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.608+0000 7f64f2c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f64ec1510b0 0x7f64ec156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:52.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.608+0000 7f64f2c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64ec157140 0x7f64ec0cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:52.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.608+0000 7f64f2c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec1565a0 con 0x7f64ec157140 2024-08-17T02:48:52.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.608+0000 7f64f2c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec155bd0 con 0x7f64ec0adbb0 2024-08-17T02:48:52.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.608+0000 7f64f2c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec0cbb00 con 0x7f64ec1510b0 2024-08-17T02:48:52.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.608+0000 7f64f2200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64ec157140 0x7f64ec0cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:52.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.608+0000 7f64f2200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64ec157140 0x7f64ec0cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38204/0 (socket says 172.21.15.100:38204) 2024-08-17T02:48:52.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.608+0000 7f64f2200640 1 -- 172.21.15.100:0/687494864 learned_addr learned my addr 172.21.15.100:0/687494864 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:52.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.608+0000 7f64f1800640 1 --2- 172.21.15.100:0/687494864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64ec0adbb0 0x7f64ec14f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:52.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.608+0000 7f64f0e00640 1 --2- 172.21.15.100:0/687494864 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f64ec1510b0 0x7f64ec156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:52.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.608+0000 7f64f2200640 1 -- 172.21.15.100:0/687494864 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f64ec1510b0 msgr2=0x7f64ec156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:52.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.608+0000 7f64f2200640 1 --2- 172.21.15.100:0/687494864 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f64ec1510b0 0x7f64ec156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:52.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.608+0000 7f64f2200640 1 -- 172.21.15.100:0/687494864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64ec0adbb0 msgr2=0x7f64ec14f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:52.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.608+0000 7f64f2200640 1 --2- 172.21.15.100:0/687494864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64ec0adbb0 0x7f64ec14f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:52.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.608+0000 7f64f2200640 1 -- 172.21.15.100:0/687494864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d8009450 con 0x7f64ec157140 2024-08-17T02:48:52.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.609+0000 7f64f2200640 1 --2- 172.21.15.100:0/687494864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64ec157140 0x7f64ec0cb0f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f64e4009fa0 tx=0x7f64e4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:52.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.609+0000 7f64e8c00640 1 -- 172.21.15.100:0/687494864 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e400ee60 con 0x7f64ec157140 2024-08-17T02:48:52.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.609+0000 7f64e8c00640 1 -- 172.21.15.100:0/687494864 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e4014420 con 0x7f64ec157140 2024-08-17T02:48:52.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.609+0000 7f64e8c00640 1 -- 172.21.15.100:0/687494864 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e40147e0 con 0x7f64ec157140 2024-08-17T02:48:52.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.609+0000 7f64f2c00640 1 -- 172.21.15.100:0/687494864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ec155580 con 0x7f64ec157140 2024-08-17T02:48:52.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.609+0000 7f64f2c00640 1 -- 172.21.15.100:0/687494864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ec155290 con 0x7f64ec157140 2024-08-17T02:48:52.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.610+0000 7f64f2c00640 1 -- 172.21.15.100:0/687494864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ec155d60 con 0x7f64ec157140 2024-08-17T02:48:52.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.611+0000 7f64e8c00640 1 -- 172.21.15.100:0/687494864 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f64e4014b50 con 0x7f64ec157140 2024-08-17T02:48:52.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.612+0000 7f64e8c00640 1 --2- 172.21.15.100:0/687494864 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f64cc065150 0x7f64cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:52.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.612+0000 7f64e8c00640 1 -- 172.21.15.100:0/687494864 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6251+0+0 (secure 0 0 0) 0x7f64e4082dd0 con 0x7f64ec157140 2024-08-17T02:48:52.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.612+0000 7f64f1800640 1 --2- 172.21.15.100:0/687494864 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f64cc065150 0x7f64cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:52.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.613+0000 7f64f1800640 1 --2- 172.21.15.100:0/687494864 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f64cc065150 0x7f64cc067600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f64e0007fd0 tx=0x7f64e0007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:52.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.616+0000 7f64e8c00640 1 -- 172.21.15.100:0/687494864 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f64e4050c80 con 0x7f64ec157140 2024-08-17T02:48:52.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:52.789+0000 7f64f2c00640 1 -- 172.21.15.100:0/687494864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f64ec071050 con 0x7f64ec157140 2024-08-17T02:48:53.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.427+0000 7f64e8c00640 1 -- 172.21.15.100:0/687494864 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) v1 ==== 169+0+0 (secure 0 0 0) 0x7f64e40542a0 con 0x7f64ec157140 2024-08-17T02:48:53.429 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2024-08-17T02:48:53.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.432+0000 7f64f2c00640 1 -- 172.21.15.100:0/687494864 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f64cc065150 msgr2=0x7f64cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:53.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.432+0000 7f64f2c00640 1 --2- 172.21.15.100:0/687494864 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f64cc065150 0x7f64cc067600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f64e0007fd0 tx=0x7f64e0007df0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.432+0000 7f64f2c00640 1 -- 172.21.15.100:0/687494864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64ec157140 msgr2=0x7f64ec0cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:53.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.432+0000 7f64f2c00640 1 --2- 172.21.15.100:0/687494864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64ec157140 0x7f64ec0cb0f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f64e4009fa0 tx=0x7f64e4009900 comp rx=0 tx=0).stop 2024-08-17T02:48:53.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.432+0000 7f64f2c00640 1 -- 172.21.15.100:0/687494864 shutdown_connections 2024-08-17T02:48:53.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.432+0000 7f64f2c00640 1 --2- 172.21.15.100:0/687494864 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f64cc065150 0x7f64cc067600 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.432+0000 7f64f2c00640 1 --2- 172.21.15.100:0/687494864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64ec157140 0x7f64ec0cb0f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.432+0000 7f64f2c00640 1 --2- 172.21.15.100:0/687494864 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f64ec1510b0 0x7f64ec156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.432+0000 7f64f2c00640 1 --2- 172.21.15.100:0/687494864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64ec0adbb0 0x7f64ec14f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.432+0000 7f64f2c00640 1 -- 172.21.15.100:0/687494864 >> 172.21.15.100:0/687494864 conn(0x7f64ec067750 msgr2=0x7f64ec0a98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:53.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.434+0000 7f64f2c00640 1 -- 172.21.15.100:0/687494864 shutdown_connections 2024-08-17T02:48:53.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.435+0000 7f64f2c00640 1 -- 172.21.15.100:0/687494864 wait complete. 2024-08-17T02:48:53.455 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:48:53.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.602+0000 7f5807200640 1 Processor -- start 2024-08-17T02:48:53.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.602+0000 7f5807200640 1 -- start start 2024-08-17T02:48:53.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.603+0000 7f5807200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5808159ca0 0x7f58080ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:53.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.603+0000 7f5807200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f58080ccca0 0x7f5808162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:53.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.603+0000 7f5807200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58080cadc0 con 0x7f58080ca8a0 2024-08-17T02:48:53.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.603+0000 7f5807200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58080cd6e0 con 0x7f5808159ca0 2024-08-17T02:48:53.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.603+0000 7f5807200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58080cb060 con 0x7f58080ccca0 2024-08-17T02:48:53.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.603+0000 7f5805e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5808159ca0 0x7f58080ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:53.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.603+0000 7f57fd400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f58080ca8a0 0x7f58080cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46500/0 (socket says 172.21.15.100:46500) 2024-08-17T02:48:53.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.603+0000 7f57fd400640 1 -- 172.21.15.100:0/1614972721 learned_addr learned my addr 172.21.15.100:0/1614972721 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:48:53.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.604+0000 7f5806800640 1 --2- 172.21.15.100:0/1614972721 >> v2:172.21.15.123:3300/0 conn(0x7f58080ccca0 0x7f5808162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:53.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.604+0000 7f5805e00640 1 -- 172.21.15.100:0/1614972721 >> v2:172.21.15.123:3300/0 conn(0x7f58080ccca0 msgr2=0x7f5808162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:53.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.604+0000 7f5805e00640 1 --2- 172.21.15.100:0/1614972721 >> v2:172.21.15.123:3300/0 conn(0x7f58080ccca0 0x7f5808162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.604+0000 7f5805e00640 1 -- 172.21.15.100:0/1614972721 >> v1:172.21.15.100:6789/0 conn(0x7f58080ca8a0 legacy=0x7f58080cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:53.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.604+0000 7f5805e00640 1 -- 172.21.15.100:0/1614972721 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58080cb300 con 0x7f5808159ca0 2024-08-17T02:48:53.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.604+0000 7f5805400640 1 -- 172.21.15.100:0/1614972721 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323784081 0 0) 0x7f58080cadc0 con 0x7f58080ca8a0 2024-08-17T02:48:53.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.605+0000 7f5805e00640 1 --2- 172.21.15.100:0/1614972721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5808159ca0 0x7f58080ca360 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f58080b26e0 tx=0x7f57f80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e7469b2ffd0507 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:53.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.605+0000 7f5805400640 1 -- 172.21.15.100:0/1614972721 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f802adb0 con 0x7f5808159ca0 2024-08-17T02:48:53.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.605+0000 7f5805400640 1 -- 172.21.15.100:0/1614972721 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f8032440 con 0x7f5808159ca0 2024-08-17T02:48:53.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.605+0000 7f5805400640 1 -- 172.21.15.100:0/1614972721 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f80327e0 con 0x7f5808159ca0 2024-08-17T02:48:53.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.606+0000 7f5807200640 1 -- 172.21.15.100:0/1614972721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5808159ca0 msgr2=0x7f58080ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:53.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.606+0000 7f5807200640 1 --2- 172.21.15.100:0/1614972721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5808159ca0 0x7f58080ca360 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f58080b26e0 tx=0x7f57f80090f0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.606+0000 7f5807200640 1 -- 172.21.15.100:0/1614972721 shutdown_connections 2024-08-17T02:48:53.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.606+0000 7f5807200640 1 --2- 172.21.15.100:0/1614972721 >> v2:172.21.15.123:3300/0 conn(0x7f58080ccca0 0x7f5808162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.606+0000 7f5807200640 1 --2- 172.21.15.100:0/1614972721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5808159ca0 0x7f58080ca360 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.606+0000 7f5807200640 1 -- 172.21.15.100:0/1614972721 >> 172.21.15.100:0/1614972721 conn(0x7f5808098e00 msgr2=0x7f580806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:53.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.606+0000 7f5807200640 1 -- 172.21.15.100:0/1614972721 shutdown_connections 2024-08-17T02:48:53.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.606+0000 7f5807200640 1 -- 172.21.15.100:0/1614972721 wait complete. 2024-08-17T02:48:53.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.607+0000 7f5807200640 1 Processor -- start 2024-08-17T02:48:53.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.608+0000 7f5807200640 1 -- start start 2024-08-17T02:48:53.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.608+0000 7f5807200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58080ca8a0 0x7f58080c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:53.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.608+0000 7f5807200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f58080ccca0 0x7f5808158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:53.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.608+0000 7f5807200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5808159ca0 0x7f5808154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:53.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.608+0000 7f5807200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5808169a60 con 0x7f5808159ca0 2024-08-17T02:48:53.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.608+0000 7f5807200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58080c5f00 con 0x7f58080ca8a0 2024-08-17T02:48:53.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.608+0000 7f5807200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58080c55d0 con 0x7f58080ccca0 2024-08-17T02:48:53.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.609+0000 7f5806800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5808159ca0 0x7f5808154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:53.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.609+0000 7f5806800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5808159ca0 0x7f5808154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38224/0 (socket says 172.21.15.100:38224) 2024-08-17T02:48:53.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.609+0000 7f5806800640 1 -- 172.21.15.100:0/3599577438 learned_addr learned my addr 172.21.15.100:0/3599577438 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:53.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.609+0000 7f5805e00640 1 --2- 172.21.15.100:0/3599577438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58080ca8a0 0x7f58080c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:53.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.609+0000 7f57fd400640 1 --2- 172.21.15.100:0/3599577438 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f58080ccca0 0x7f5808158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:53.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.609+0000 7f5806800640 1 -- 172.21.15.100:0/3599577438 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f58080ccca0 msgr2=0x7f5808158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:53.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.609+0000 7f5806800640 1 --2- 172.21.15.100:0/3599577438 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f58080ccca0 0x7f5808158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.609+0000 7f5806800640 1 -- 172.21.15.100:0/3599577438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58080ca8a0 msgr2=0x7f58080c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:53.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.609+0000 7f5806800640 1 --2- 172.21.15.100:0/3599577438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58080ca8a0 0x7f58080c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.609+0000 7f5806800640 1 -- 172.21.15.100:0/3599577438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f8009390 con 0x7f5808159ca0 2024-08-17T02:48:53.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.609+0000 7f5806800640 1 --2- 172.21.15.100:0/3599577438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5808159ca0 0x7f5808154d50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5800007f50 tx=0x7f58000098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:53.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.610+0000 7f57fe000640 1 -- 172.21.15.100:0/3599577438 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580000ee10 con 0x7f5808159ca0 2024-08-17T02:48:53.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.610+0000 7f57fe000640 1 -- 172.21.15.100:0/3599577438 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5800014420 con 0x7f5808159ca0 2024-08-17T02:48:53.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.610+0000 7f57fe000640 1 -- 172.21.15.100:0/3599577438 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58000147e0 con 0x7f5808159ca0 2024-08-17T02:48:53.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.610+0000 7f5807200640 1 -- 172.21.15.100:0/3599577438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58080c58b0 con 0x7f5808159ca0 2024-08-17T02:48:53.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.610+0000 7f5807200640 1 -- 172.21.15.100:0/3599577438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58080c68d0 con 0x7f5808159ca0 2024-08-17T02:48:53.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.611+0000 7f5807200640 1 -- 172.21.15.100:0/3599577438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58080c6090 con 0x7f5808159ca0 2024-08-17T02:48:53.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.611+0000 7f57fe000640 1 -- 172.21.15.100:0/3599577438 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5800014bd0 con 0x7f5808159ca0 2024-08-17T02:48:53.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.612+0000 7f57fe000640 1 --2- 172.21.15.100:0/3599577438 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f57e4065150 0x7f57e4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:53.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.612+0000 7f57fe000640 1 -- 172.21.15.100:0/3599577438 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f5800082ca0 con 0x7f5808159ca0 2024-08-17T02:48:53.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.612+0000 7f5805e00640 1 --2- 172.21.15.100:0/3599577438 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f57e4065150 0x7f57e4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:53.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.613+0000 7f5805e00640 1 --2- 172.21.15.100:0/3599577438 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f57e4065150 0x7f57e4067600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f57f8034000 tx=0x7f57f8032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:53.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.616+0000 7f57fe000640 1 -- 172.21.15.100:0/3599577438 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5800050c40 con 0x7f5808159ca0 2024-08-17T02:48:53.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.791+0000 7f5807200640 1 -- 172.21.15.100:0/3599577438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5808071050 con 0x7f5808159ca0 2024-08-17T02:48:53.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.791+0000 7f57fe000640 1 -- 172.21.15.100:0/3599577438 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+15562 (secure 0 0 0) 0x7f5800054260 con 0x7f5808159ca0 2024-08-17T02:48:53.792 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:48:53.792 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":41,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:48:53.419744+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000001028572.meta","create_time":"2024-08-17T02:46:40.913393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001028572"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001028572.data","create_time":"2024-08-17T02:46:41.819233+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001028572"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6835/1541092259":"2024-08-18T02:48:50.211886+0000","172.21.15.123:6833/1541092259":"2024-08-18T02:48:50.211886+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:48:53.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.794+0000 7f5807200640 1 -- 172.21.15.100:0/3599577438 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f57e4065150 msgr2=0x7f57e4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:53.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.794+0000 7f5807200640 1 --2- 172.21.15.100:0/3599577438 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f57e4065150 0x7f57e4067600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f57f8034000 tx=0x7f57f8032000 comp rx=0 tx=0).stop 2024-08-17T02:48:53.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.794+0000 7f5807200640 1 -- 172.21.15.100:0/3599577438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5808159ca0 msgr2=0x7f5808154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:53.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.794+0000 7f5807200640 1 --2- 172.21.15.100:0/3599577438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5808159ca0 0x7f5808154d50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5800007f50 tx=0x7f58000098a0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.794+0000 7f5807200640 1 -- 172.21.15.100:0/3599577438 shutdown_connections 2024-08-17T02:48:53.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.794+0000 7f5807200640 1 --2- 172.21.15.100:0/3599577438 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f57e4065150 0x7f57e4067600 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.794+0000 7f5807200640 1 --2- 172.21.15.100:0/3599577438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5808159ca0 0x7f5808154d50 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.794+0000 7f5807200640 1 --2- 172.21.15.100:0/3599577438 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f58080ccca0 0x7f5808158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.794+0000 7f5807200640 1 --2- 172.21.15.100:0/3599577438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58080ca8a0 0x7f58080c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.794+0000 7f5807200640 1 -- 172.21.15.100:0/3599577438 >> 172.21.15.100:0/3599577438 conn(0x7f5808098e00 msgr2=0x7f58080ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:53.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.794+0000 7f5807200640 1 -- 172.21.15.100:0/3599577438 shutdown_connections 2024-08-17T02:48:53.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.794+0000 7f5807200640 1 -- 172.21.15.100:0/3599577438 wait complete. 2024-08-17T02:48:53.810 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:45:35.140990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000001028572.meta', 'create_time': '2024-08-17T02:46:40.913393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000001028572'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000001028572.data', 'create_time': '2024-08-17T02:46:41.819233+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000001028572'}}}] 2024-08-17T02:48:53.810 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:48:53.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.960+0000 7f33f9e00640 1 Processor -- start 2024-08-17T02:48:53.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.960+0000 7f33f9e00640 1 -- start start 2024-08-17T02:48:53.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.961+0000 7f33f9e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33f40ac640 0x7f33f40b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:53.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.961+0000 7f33f9e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f40aef20 0x7f33f40aca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:53.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.961+0000 7f33f9e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f40b0510 con 0x7f33f40af3c0 2024-08-17T02:48:53.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.961+0000 7f33f9e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f40af900 con 0x7f33f40ac640 2024-08-17T02:48:53.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.961+0000 7f33f9e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40afbe0 con 0x7f33f40aef20 2024-08-17T02:48:53.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.961+0000 7f33f3400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f33f40af3c0 0x7f33f40c8e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46516/0 (socket says 172.21.15.100:46516) 2024-08-17T02:48:53.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.961+0000 7f33f3400640 1 -- 172.21.15.100:0/3616913417 learned_addr learned my addr 172.21.15.100:0/3616913417 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:48:53.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.962+0000 7f33f2a00640 1 --2- 172.21.15.100:0/3616913417 >> v2:172.21.15.123:3300/0 conn(0x7f33f40ac640 0x7f33f40b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:53.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.962+0000 7f33f2000640 1 --2- 172.21.15.100:0/3616913417 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f40aef20 0x7f33f40aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:53.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.962+0000 7f33f1600640 1 -- 172.21.15.100:0/3616913417 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3923507814 0 0) 0x7f33f40b0510 con 0x7f33f40af3c0 2024-08-17T02:48:53.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.962+0000 7f33f1600640 1 -- 172.21.15.100:0/3616913417 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33d80034e0 con 0x7f33f40af3c0 2024-08-17T02:48:53.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.962+0000 7f33f1600640 1 -- 172.21.15.100:0/3616913417 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3640341588 0 0) 0x7f33d80034e0 con 0x7f33f40af3c0 2024-08-17T02:48:53.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.962+0000 7f33f1600640 1 -- 172.21.15.100:0/3616913417 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f40aef20 msgr2=0x7f33f40aca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:53.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.962+0000 7f33f1600640 1 --2- 172.21.15.100:0/3616913417 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f40aef20 0x7f33f40aca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.962+0000 7f33f1600640 1 -- 172.21.15.100:0/3616913417 >> v2:172.21.15.123:3300/0 conn(0x7f33f40ac640 msgr2=0x7f33f40b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:53.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.962+0000 7f33f1600640 1 --2- 172.21.15.100:0/3616913417 >> v2:172.21.15.123:3300/0 conn(0x7f33f40ac640 0x7f33f40b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.962+0000 7f33f1600640 1 -- 172.21.15.100:0/3616913417 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f40afec0 con 0x7f33f40af3c0 2024-08-17T02:48:53.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.962+0000 7f33f1600640 1 -- 172.21.15.100:0/3616913417 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1817143124 0 0) 0x7f33ec0017f0 con 0x7f33f40af3c0 2024-08-17T02:48:53.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.962+0000 7f33f2a00640 1 --2- 172.21.15.100:0/3616913417 >> v2:172.21.15.123:3300/0 conn(0x7f33f40ac640 0x7f33f40b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:48:53.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.962+0000 7f33f1600640 1 -- 172.21.15.100:0/3616913417 >> v1:172.21.15.100:6789/0 conn(0x7f33f40af3c0 legacy=0x7f33f40c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:53.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.962+0000 7f33f1600640 1 --2- 172.21.15.100:0/3616913417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33d80039d0 0x7f33d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:53.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.962+0000 7f33f1600640 1 --2- 172.21.15.100:0/3616913417 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f40aef20 0x7f33d8004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:53.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.962+0000 7f33f1600640 1 --2- 172.21.15.100:0/3616913417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33d8004cc0 0x7f33d8005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:53.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.962+0000 7f33f1600640 1 -- 172.21.15.100:0/3616913417 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40af900 con 0x7f33d8004cc0 2024-08-17T02:48:53.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.962+0000 7f33f1600640 1 -- 172.21.15.100:0/3616913417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40afbe0 con 0x7f33d80039d0 2024-08-17T02:48:53.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.962+0000 7f33f1600640 1 -- 172.21.15.100:0/3616913417 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d800b9d0 con 0x7f33f40aef20 2024-08-17T02:48:53.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.963+0000 7f33f3400640 1 --2- 172.21.15.100:0/3616913417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33d8004cc0 0x7f33d8005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:53.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.963+0000 7f33f2a00640 1 --2- 172.21.15.100:0/3616913417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33d80039d0 0x7f33d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:53.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.963+0000 7f33f2000640 1 --2- 172.21.15.100:0/3616913417 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f40aef20 0x7f33d8004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:53.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.963+0000 7f33f2a00640 1 -- 172.21.15.100:0/3616913417 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f40aef20 msgr2=0x7f33d8004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:53.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.963+0000 7f33f2a00640 1 --2- 172.21.15.100:0/3616913417 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f40aef20 0x7f33d8004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.963+0000 7f33f2a00640 1 -- 172.21.15.100:0/3616913417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33d8004cc0 msgr2=0x7f33d8005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:53.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.963+0000 7f33f2a00640 1 --2- 172.21.15.100:0/3616913417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33d8004cc0 0x7f33d8005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.963+0000 7f33f2a00640 1 -- 172.21.15.100:0/3616913417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d80034e0 con 0x7f33d80039d0 2024-08-17T02:48:53.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.964+0000 7f33f2a00640 1 --2- 172.21.15.100:0/3616913417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33d80039d0 0x7f33d8003de0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009870 tx=0x7f33e40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e18c2b9becf936b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:53.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.965+0000 7f33f1600640 1 -- 172.21.15.100:0/3616913417 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4031400 con 0x7f33d80039d0 2024-08-17T02:48:53.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.965+0000 7f33f1600640 1 -- 172.21.15.100:0/3616913417 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e4031560 con 0x7f33d80039d0 2024-08-17T02:48:53.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.965+0000 7f33f1600640 1 -- 172.21.15.100:0/3616913417 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e40318e0 con 0x7f33d80039d0 2024-08-17T02:48:53.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.965+0000 7f33f9e00640 1 -- 172.21.15.100:0/3616913417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33d80039d0 msgr2=0x7f33d8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:53.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.965+0000 7f33f9e00640 1 --2- 172.21.15.100:0/3616913417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33d80039d0 0x7f33d8003de0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009870 tx=0x7f33e40090f0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.965+0000 7f33f3400640 1 -- 172.21.15.100:0/3616913417 reap_dead start 2024-08-17T02:48:53.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.965+0000 7f33f9e00640 1 -- 172.21.15.100:0/3616913417 shutdown_connections 2024-08-17T02:48:53.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.965+0000 7f33f9e00640 1 -- 172.21.15.100:0/3616913417 >> 172.21.15.100:0/3616913417 conn(0x7f33f4066cd0 msgr2=0x7f33f40670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:53.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.965+0000 7f33f9e00640 1 -- 172.21.15.100:0/3616913417 shutdown_connections 2024-08-17T02:48:53.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.965+0000 7f33f9e00640 1 -- 172.21.15.100:0/3616913417 wait complete. 2024-08-17T02:48:53.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.967+0000 7f33f9e00640 1 Processor -- start 2024-08-17T02:48:53.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.967+0000 7f33f9e00640 1 -- start start 2024-08-17T02:48:53.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.967+0000 7f33f9e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33d80039d0 0x7f33f40aa780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:53.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.967+0000 7f33f9e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f40a98b0 0x7f33f40a7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:53.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.968+0000 7f33f9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33f4140f00 0x7f33f4154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:53.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.968+0000 7f33f9e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40a9420 con 0x7f33f4140f00 2024-08-17T02:48:53.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.968+0000 7f33f9e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40a8810 con 0x7f33d80039d0 2024-08-17T02:48:53.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.968+0000 7f33f9e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40a8af0 con 0x7f33f40a98b0 2024-08-17T02:48:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.968+0000 7f33f3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33f4140f00 0x7f33f4154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.968+0000 7f33f3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33f4140f00 0x7f33f4154350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38234/0 (socket says 172.21.15.100:38234) 2024-08-17T02:48:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.968+0000 7f33f3400640 1 -- 172.21.15.100:0/3681084230 learned_addr learned my addr 172.21.15.100:0/3681084230 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.968+0000 7f33f2000640 1 --2- 172.21.15.100:0/3681084230 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f40a98b0 0x7f33f40a7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.968+0000 7f33f2a00640 1 --2- 172.21.15.100:0/3681084230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33d80039d0 0x7f33f40aa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.968+0000 7f33f3400640 1 -- 172.21.15.100:0/3681084230 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f40a98b0 msgr2=0x7f33f40a7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.968+0000 7f33f3400640 1 --2- 172.21.15.100:0/3681084230 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f40a98b0 0x7f33f40a7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.968+0000 7f33f3400640 1 -- 172.21.15.100:0/3681084230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33d80039d0 msgr2=0x7f33f40aa780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.968+0000 7f33f3400640 1 --2- 172.21.15.100:0/3681084230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33d80039d0 0x7f33f40aa780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.968+0000 7f33f3400640 1 -- 172.21.15.100:0/3681084230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f40a8dd0 con 0x7f33f4140f00 2024-08-17T02:48:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.968+0000 7f33f2a00640 1 --2- 172.21.15.100:0/3681084230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33d80039d0 0x7f33f40aa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:48:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.968+0000 7f33f3400640 1 --2- 172.21.15.100:0/3681084230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33f4140f00 0x7f33f4154350 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f33f4069c70 tx=0x7f33f40b0480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.969+0000 7f33ea000640 1 -- 172.21.15.100:0/3681084230 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec00a7d0 con 0x7f33f4140f00 2024-08-17T02:48:53.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.969+0000 7f33ea000640 1 -- 172.21.15.100:0/3681084230 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ec00a950 con 0x7f33f4140f00 2024-08-17T02:48:53.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.969+0000 7f33f9e00640 1 -- 172.21.15.100:0/3681084230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f40a90b0 con 0x7f33f4140f00 2024-08-17T02:48:53.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.969+0000 7f33ea000640 1 -- 172.21.15.100:0/3681084230 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec00ad10 con 0x7f33f4140f00 2024-08-17T02:48:53.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.969+0000 7f33f9e00640 1 -- 172.21.15.100:0/3681084230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f40a84d0 con 0x7f33f4140f00 2024-08-17T02:48:53.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.970+0000 7f33f9e00640 1 -- 172.21.15.100:0/3681084230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f4064db0 con 0x7f33f4140f00 2024-08-17T02:48:53.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.971+0000 7f33ea000640 1 -- 172.21.15.100:0/3681084230 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f33ec013600 con 0x7f33f4140f00 2024-08-17T02:48:53.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.972+0000 7f33ea000640 1 --2- 172.21.15.100:0/3681084230 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f33d40651d0 0x7f33d4067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:53.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.972+0000 7f33ea000640 1 -- 172.21.15.100:0/3681084230 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f33ec082810 con 0x7f33f4140f00 2024-08-17T02:48:53.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.972+0000 7f33f2a00640 1 --2- 172.21.15.100:0/3681084230 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f33d40651d0 0x7f33d4067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:53.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.973+0000 7f33f2a00640 1 --2- 172.21.15.100:0/3681084230 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f33d40651d0 0x7f33d4067680 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f33e4037000 tx=0x7f33e4038000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:53.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:53.976+0000 7f33ea000640 1 -- 172.21.15.100:0/3681084230 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f33ec0507b0 con 0x7f33f4140f00 2024-08-17T02:48:54.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.149+0000 7f33f9e00640 1 -- 172.21.15.100:0/3681084230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33f40684b0 con 0x7f33f4140f00 2024-08-17T02:48:54.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.149+0000 7f33ea000640 1 -- 172.21.15.100:0/3681084230 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33ec053dd0 con 0x7f33f4140f00 2024-08-17T02:48:54.150 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-08-17T02:48:54.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.151+0000 7f33f9e00640 1 -- 172.21.15.100:0/3681084230 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f33d40651d0 msgr2=0x7f33d4067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:54.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.151+0000 7f33f9e00640 1 --2- 172.21.15.100:0/3681084230 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f33d40651d0 0x7f33d4067680 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f33e4037000 tx=0x7f33e4038000 comp rx=0 tx=0).stop 2024-08-17T02:48:54.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.151+0000 7f33f9e00640 1 -- 172.21.15.100:0/3681084230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33f4140f00 msgr2=0x7f33f4154350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:54.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.151+0000 7f33f9e00640 1 --2- 172.21.15.100:0/3681084230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33f4140f00 0x7f33f4154350 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f33f4069c70 tx=0x7f33f40b0480 comp rx=0 tx=0).stop 2024-08-17T02:48:54.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.151+0000 7f33f9e00640 1 -- 172.21.15.100:0/3681084230 shutdown_connections 2024-08-17T02:48:54.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.151+0000 7f33f9e00640 1 --2- 172.21.15.100:0/3681084230 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f33d40651d0 0x7f33d4067680 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.151+0000 7f33f9e00640 1 --2- 172.21.15.100:0/3681084230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33f4140f00 0x7f33f4154350 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.151+0000 7f33f9e00640 1 --2- 172.21.15.100:0/3681084230 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33f40a98b0 0x7f33f40a7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.151+0000 7f33f9e00640 1 --2- 172.21.15.100:0/3681084230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33d80039d0 0x7f33f40aa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.151+0000 7f33f9e00640 1 -- 172.21.15.100:0/3681084230 >> 172.21.15.100:0/3681084230 conn(0x7f33f4066cd0 msgr2=0x7f33f4152400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:54.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.152+0000 7f33f9e00640 1 -- 172.21.15.100:0/3681084230 shutdown_connections 2024-08-17T02:48:54.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.152+0000 7f33f9e00640 1 -- 172.21.15.100:0/3681084230 wait complete. 2024-08-17T02:48:54.168 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001028572.meta pg_num 2024-08-17T02:48:54.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.317+0000 7f6586800640 1 Processor -- start 2024-08-17T02:48:54.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.318+0000 7f6586800640 1 -- start start 2024-08-17T02:48:54.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.319+0000 7f6586800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65800adfb0 0x7f65800ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:54.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.319+0000 7f6586800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65800afc40 con 0x7f6580155a30 2024-08-17T02:48:54.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.319+0000 7f6586800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65800af030 con 0x7f6580155660 2024-08-17T02:48:54.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.319+0000 7f6586800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65800af310 con 0x7f65800adfb0 2024-08-17T02:48:54.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.319+0000 7f6585e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6580155a30 0x7f658006dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46520/0 (socket says 172.21.15.100:46520) 2024-08-17T02:48:54.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.319+0000 7f6585e00640 1 -- 172.21.15.100:0/4058438821 learned_addr learned my addr 172.21.15.100:0/4058438821 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:48:54.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.320+0000 7f657fe00640 1 -- 172.21.15.100:0/4058438821 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534149359 0 0) 0x7f65800afc40 con 0x7f6580155a30 2024-08-17T02:48:54.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.320+0000 7f6584a00640 1 --2- 172.21.15.100:0/4058438821 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65800adfb0 0x7f65800ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:54.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.320+0000 7f657fe00640 1 -- 172.21.15.100:0/4058438821 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65680034e0 con 0x7f6580155a30 2024-08-17T02:48:54.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.320+0000 7f657fe00640 1 -- 172.21.15.100:0/4058438821 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141242307 0 0) 0x7f65800af030 con 0x7f6580155660 2024-08-17T02:48:54.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.320+0000 7f657fe00640 1 -- 172.21.15.100:0/4058438821 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65800afc40 con 0x7f6580155660 2024-08-17T02:48:54.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.320+0000 7f657fe00640 1 -- 172.21.15.100:0/4058438821 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2651228538 0 0) 0x7f65680034e0 con 0x7f6580155a30 2024-08-17T02:48:54.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.320+0000 7f657fe00640 1 -- 172.21.15.100:0/4058438821 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65800adfb0 msgr2=0x7f65800ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:54.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.320+0000 7f657fe00640 1 --2- 172.21.15.100:0/4058438821 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65800adfb0 0x7f65800ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.320+0000 7f657fe00640 1 -- 172.21.15.100:0/4058438821 >> v1:172.21.15.123:6789/0 conn(0x7f6580155660 legacy=0x7f65800c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:54.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.320+0000 7f657fe00640 1 -- 172.21.15.100:0/4058438821 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65800af5f0 con 0x7f6580155a30 2024-08-17T02:48:54.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.320+0000 7f657fe00640 1 -- 172.21.15.100:0/4058438821 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1817143124 0 0) 0x7f65780017f0 con 0x7f6580155a30 2024-08-17T02:48:54.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.320+0000 7f657fe00640 1 -- 172.21.15.100:0/4058438821 >> v1:172.21.15.100:6789/0 conn(0x7f6580155a30 legacy=0x7f658006dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:54.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.320+0000 7f657fe00640 1 --2- 172.21.15.100:0/4058438821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6568004bf0 0x7f6568004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:54.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.320+0000 7f657fe00640 1 --2- 172.21.15.100:0/4058438821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6568003720 0x7f6568003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:54.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.320+0000 7f657fe00640 1 --2- 172.21.15.100:0/4058438821 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65800adfb0 0x7f65680040d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:54.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.320+0000 7f657fe00640 1 -- 172.21.15.100:0/4058438821 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65800af310 con 0x7f6568004bf0 2024-08-17T02:48:54.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.320+0000 7f657fe00640 1 -- 172.21.15.100:0/4058438821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656800bab0 con 0x7f6568003720 2024-08-17T02:48:54.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.320+0000 7f657fe00640 1 -- 172.21.15.100:0/4058438821 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656800de80 con 0x7f65800adfb0 2024-08-17T02:48:54.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.320+0000 7f6585400640 1 --2- 172.21.15.100:0/4058438821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6568004bf0 0x7f6568004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:54.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.320+0000 7f6585e00640 1 --2- 172.21.15.100:0/4058438821 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65800adfb0 0x7f65680040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:54.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.321+0000 7f6584a00640 1 --2- 172.21.15.100:0/4058438821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6568003720 0x7f6568003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:54.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.321+0000 7f6585400640 1 -- 172.21.15.100:0/4058438821 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65800adfb0 msgr2=0x7f65680040d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:54.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.321+0000 7f6585400640 1 --2- 172.21.15.100:0/4058438821 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65800adfb0 0x7f65680040d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.321+0000 7f6585400640 1 -- 172.21.15.100:0/4058438821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6568003720 msgr2=0x7f6568003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:54.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.321+0000 7f6585400640 1 --2- 172.21.15.100:0/4058438821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6568003720 0x7f6568003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.321+0000 7f6585400640 1 -- 172.21.15.100:0/4058438821 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65680034e0 con 0x7f6568004bf0 2024-08-17T02:48:54.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.322+0000 7f6585400640 1 --2- 172.21.15.100:0/4058438821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6568004bf0 0x7f6568004fe0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6574001960 tx=0x7f6574007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3136d4e7c8ccf8d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:54.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.322+0000 7f657fe00640 1 -- 172.21.15.100:0/4058438821 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657402aa70 con 0x7f6568004bf0 2024-08-17T02:48:54.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.322+0000 7f657fe00640 1 -- 172.21.15.100:0/4058438821 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657402abd0 con 0x7f6568004bf0 2024-08-17T02:48:54.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.322+0000 7f657fe00640 1 -- 172.21.15.100:0/4058438821 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65740323f0 con 0x7f6568004bf0 2024-08-17T02:48:54.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.323+0000 7f6586800640 1 -- 172.21.15.100:0/4058438821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6568004bf0 msgr2=0x7f6568004fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:54.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.323+0000 7f6586800640 1 --2- 172.21.15.100:0/4058438821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6568004bf0 0x7f6568004fe0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6574001960 tx=0x7f6574007ca0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.323+0000 7f6585e00640 1 -- 172.21.15.100:0/4058438821 reap_dead start 2024-08-17T02:48:54.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.323+0000 7f6586800640 1 -- 172.21.15.100:0/4058438821 shutdown_connections 2024-08-17T02:48:54.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.323+0000 7f6586800640 1 -- 172.21.15.100:0/4058438821 >> 172.21.15.100:0/4058438821 conn(0x7f6580066cd0 msgr2=0x7f65800670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:54.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.323+0000 7f6586800640 1 -- 172.21.15.100:0/4058438821 shutdown_connections 2024-08-17T02:48:54.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.323+0000 7f6586800640 1 -- 172.21.15.100:0/4058438821 wait complete. 2024-08-17T02:48:54.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.324+0000 7f6586800640 1 Processor -- start 2024-08-17T02:48:54.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.324+0000 7f6586800640 1 -- start start 2024-08-17T02:48:54.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.325+0000 7f6586800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6568004bf0 0x7f65800a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:54.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.325+0000 7f6586800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6580151500 0x7f6580152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:54.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.325+0000 7f6586800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65800aaf60 0x7f658014fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:54.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.325+0000 7f6586800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65800aaad0 con 0x7f6568004bf0 2024-08-17T02:48:54.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.325+0000 7f6586800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65800a9ec0 con 0x7f6580151500 2024-08-17T02:48:54.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.325+0000 7f6586800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65800aa1a0 con 0x7f65800aaf60 2024-08-17T02:48:54.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.325+0000 7f6585400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6568004bf0 0x7f65800a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:54.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.325+0000 7f6585400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6568004bf0 0x7f65800a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38260/0 (socket says 172.21.15.100:38260) 2024-08-17T02:48:54.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.325+0000 7f6585400640 1 -- 172.21.15.100:0/3471312733 learned_addr learned my addr 172.21.15.100:0/3471312733 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:54.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.326+0000 7f6585e00640 1 --2- 172.21.15.100:0/3471312733 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65800aaf60 0x7f658014fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:54.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.326+0000 7f6584a00640 1 --2- 172.21.15.100:0/3471312733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6580151500 0x7f6580152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:54.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.326+0000 7f6585400640 1 -- 172.21.15.100:0/3471312733 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65800aaf60 msgr2=0x7f658014fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:54.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.326+0000 7f6585400640 1 --2- 172.21.15.100:0/3471312733 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65800aaf60 0x7f658014fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.326+0000 7f6585400640 1 -- 172.21.15.100:0/3471312733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6580151500 msgr2=0x7f6580152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:54.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.326+0000 7f6585400640 1 --2- 172.21.15.100:0/3471312733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6580151500 0x7f6580152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.326+0000 7f6585400640 1 -- 172.21.15.100:0/3471312733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65800aa480 con 0x7f6568004bf0 2024-08-17T02:48:54.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.326+0000 7f6584a00640 1 --2- 172.21.15.100:0/3471312733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6580151500 0x7f6580152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:48:54.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.326+0000 7f6585e00640 1 --2- 172.21.15.100:0/3471312733 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65800aaf60 0x7f658014fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:48:54.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.326+0000 7f6585400640 1 --2- 172.21.15.100:0/3471312733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6568004bf0 0x7f65800a98e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6574001960 tx=0x7f6574003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:54.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.326+0000 7f657cc00640 1 -- 172.21.15.100:0/3471312733 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657403d470 con 0x7f6568004bf0 2024-08-17T02:48:54.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.326+0000 7f657cc00640 1 -- 172.21.15.100:0/3471312733 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657403d5d0 con 0x7f6568004bf0 2024-08-17T02:48:54.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.326+0000 7f657cc00640 1 -- 172.21.15.100:0/3471312733 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657403d990 con 0x7f6568004bf0 2024-08-17T02:48:54.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.326+0000 7f6586800640 1 -- 172.21.15.100:0/3471312733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65800aa760 con 0x7f6568004bf0 2024-08-17T02:48:54.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.327+0000 7f6586800640 1 -- 172.21.15.100:0/3471312733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6580150220 con 0x7f6568004bf0 2024-08-17T02:48:54.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.328+0000 7f6586800640 1 -- 172.21.15.100:0/3471312733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6580071050 con 0x7f6568004bf0 2024-08-17T02:48:54.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.328+0000 7f657cc00640 1 -- 172.21.15.100:0/3471312733 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6574031390 con 0x7f6568004bf0 2024-08-17T02:48:54.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.329+0000 7f657cc00640 1 --2- 172.21.15.100:0/3471312733 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6560065180 0x7f6560067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:54.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.329+0000 7f657cc00640 1 -- 172.21.15.100:0/3471312733 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f65740a2320 con 0x7f6568004bf0 2024-08-17T02:48:54.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.329+0000 7f6584a00640 1 --2- 172.21.15.100:0/3471312733 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6560065180 0x7f6560067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:54.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.330+0000 7f6584a00640 1 --2- 172.21.15.100:0/3471312733 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6560065180 0x7f6560067630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f65801518f0 tx=0x7f656c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:54.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.333+0000 7f657cc00640 1 -- 172.21.15.100:0/3471312733 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6574070360 con 0x7f6568004bf0 2024-08-17T02:48:54.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.505+0000 7f6586800640 1 -- 172.21.15.100:0/3471312733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001028572.meta", "var": "pg_num"} v 0) v1 -- 0x7f6580071050 con 0x7f6568004bf0 2024-08-17T02:48:54.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.506+0000 7f657cc00640 1 -- 172.21.15.100:0/3471312733 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001028572.meta", "var": "pg_num"}]=0 v41) v1 ==== 124+0+11 (secure 0 0 0) 0x7f6574073980 con 0x7f6568004bf0 2024-08-17T02:48:54.507 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-08-17T02:48:54.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.508+0000 7f6586800640 1 -- 172.21.15.100:0/3471312733 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6560065180 msgr2=0x7f6560067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:54.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.508+0000 7f6586800640 1 --2- 172.21.15.100:0/3471312733 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6560065180 0x7f6560067630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f65801518f0 tx=0x7f656c008040 comp rx=0 tx=0).stop 2024-08-17T02:48:54.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.508+0000 7f6586800640 1 -- 172.21.15.100:0/3471312733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6568004bf0 msgr2=0x7f65800a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:54.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.508+0000 7f6586800640 1 --2- 172.21.15.100:0/3471312733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6568004bf0 0x7f65800a98e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6574001960 tx=0x7f6574003000 comp rx=0 tx=0).stop 2024-08-17T02:48:54.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.508+0000 7f6586800640 1 -- 172.21.15.100:0/3471312733 shutdown_connections 2024-08-17T02:48:54.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.508+0000 7f6586800640 1 --2- 172.21.15.100:0/3471312733 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6560065180 0x7f6560067630 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.508+0000 7f6586800640 1 --2- 172.21.15.100:0/3471312733 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f65800aaf60 0x7f658014fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.508+0000 7f6586800640 1 --2- 172.21.15.100:0/3471312733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6580151500 0x7f6580152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.508+0000 7f6586800640 1 --2- 172.21.15.100:0/3471312733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6568004bf0 0x7f65800a98e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.508+0000 7f6586800640 1 -- 172.21.15.100:0/3471312733 >> 172.21.15.100:0/3471312733 conn(0x7f6580066cd0 msgr2=0x7f6580155f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:54.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.508+0000 7f6586800640 1 -- 172.21.15.100:0/3471312733 shutdown_connections 2024-08-17T02:48:54.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.508+0000 7f6586800640 1 -- 172.21.15.100:0/3471312733 wait complete. 2024-08-17T02:48:54.528 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001028572.data pg_num 2024-08-17T02:48:54.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.677+0000 7fed13000640 1 Processor -- start 2024-08-17T02:48:54.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.677+0000 7fed13000640 1 -- start start 2024-08-17T02:48:54.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.678+0000 7fed13000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed0c069a60 0x7fed0c069e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:54.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.678+0000 7fed13000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fed0c0c7e50 0x7fed0c06a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:54.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.678+0000 7fed13000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0c06d470 con 0x7fed0c0ab7f0 2024-08-17T02:48:54.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.678+0000 7fed13000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0c0aec60 con 0x7fed0c0c7e50 2024-08-17T02:48:54.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.678+0000 7fed13000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0c06c860 con 0x7fed0c069a60 2024-08-17T02:48:54.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.679+0000 7fed0b400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fed0c0c7e50 0x7fed0c06a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:54.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.679+0000 7fed11000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fed0c0ab7f0 0x7fed0c154e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46530/0 (socket says 172.21.15.100:46530) 2024-08-17T02:48:54.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.679+0000 7fed11000640 1 -- 172.21.15.100:0/26214689 learned_addr learned my addr 172.21.15.100:0/26214689 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:48:54.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.679+0000 7fed0be00640 1 --2- 172.21.15.100:0/26214689 >> v2:172.21.15.123:3300/0 conn(0x7fed0c069a60 0x7fed0c069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:54.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.679+0000 7fed0b400640 1 -- 172.21.15.100:0/26214689 >> v2:172.21.15.123:3300/0 conn(0x7fed0c069a60 msgr2=0x7fed0c069e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:54.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.679+0000 7fed0aa00640 1 -- 172.21.15.100:0/26214689 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608790937 0 0) 0x7fed0c06d470 con 0x7fed0c0ab7f0 2024-08-17T02:48:54.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.679+0000 7fed0b400640 1 --2- 172.21.15.100:0/26214689 >> v2:172.21.15.123:3300/0 conn(0x7fed0c069a60 0x7fed0c069e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.679+0000 7fed0b400640 1 -- 172.21.15.100:0/26214689 >> v1:172.21.15.100:6789/0 conn(0x7fed0c0ab7f0 legacy=0x7fed0c154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:54.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.679+0000 7fed0b400640 1 -- 172.21.15.100:0/26214689 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0c06cb40 con 0x7fed0c0c7e50 2024-08-17T02:48:54.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.680+0000 7fed0b400640 1 --2- 172.21.15.100:0/26214689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed0c0c7e50 0x7fed0c06a590 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fed0c0680f0 tx=0x7fecf80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b22dd9fcf7d5e26 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:54.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.680+0000 7fed0aa00640 1 -- 172.21.15.100:0/26214689 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf802ad20 con 0x7fed0c0c7e50 2024-08-17T02:48:54.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.680+0000 7fed0aa00640 1 -- 172.21.15.100:0/26214689 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf802ae80 con 0x7fed0c0c7e50 2024-08-17T02:48:54.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.680+0000 7fed0aa00640 1 -- 172.21.15.100:0/26214689 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf8032670 con 0x7fed0c0c7e50 2024-08-17T02:48:54.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.681+0000 7fed13000640 1 -- 172.21.15.100:0/26214689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed0c0c7e50 msgr2=0x7fed0c06a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:54.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.681+0000 7fed13000640 1 --2- 172.21.15.100:0/26214689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed0c0c7e50 0x7fed0c06a590 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fed0c0680f0 tx=0x7fecf80090f0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.681+0000 7fed13000640 1 -- 172.21.15.100:0/26214689 shutdown_connections 2024-08-17T02:48:54.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.681+0000 7fed13000640 1 --2- 172.21.15.100:0/26214689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed0c0c7e50 0x7fed0c06a590 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.681+0000 7fed13000640 1 --2- 172.21.15.100:0/26214689 >> v2:172.21.15.123:3300/0 conn(0x7fed0c069a60 0x7fed0c069e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.681+0000 7fed13000640 1 -- 172.21.15.100:0/26214689 >> 172.21.15.100:0/26214689 conn(0x7fed0c067750 msgr2=0x7fed0c0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:54.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.681+0000 7fed13000640 1 -- 172.21.15.100:0/26214689 shutdown_connections 2024-08-17T02:48:54.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.681+0000 7fed13000640 1 -- 172.21.15.100:0/26214689 wait complete. 2024-08-17T02:48:54.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.682+0000 7fed13000640 1 Processor -- start 2024-08-17T02:48:54.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.682+0000 7fed13000640 1 -- start start 2024-08-17T02:48:54.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.683+0000 7fed13000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed0c069a60 0x7fed0c0aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:54.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.683+0000 7fed13000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed0c0ab7f0 0x7fed0c16a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:54.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.683+0000 7fed13000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed0c0c7e50 0x7fed0c16adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:54.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.683+0000 7fed13000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c157c40 con 0x7fed0c069a60 2024-08-17T02:48:54.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.683+0000 7fed13000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c1581a0 con 0x7fed0c0c7e50 2024-08-17T02:48:54.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.683+0000 7fed13000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c159a40 con 0x7fed0c0ab7f0 2024-08-17T02:48:54.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.683+0000 7fed0be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed0c069a60 0x7fed0c0aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:54.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.683+0000 7fed0be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed0c069a60 0x7fed0c0aaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38276/0 (socket says 172.21.15.100:38276) 2024-08-17T02:48:54.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.683+0000 7fed0be00640 1 -- 172.21.15.100:0/2103262359 learned_addr learned my addr 172.21.15.100:0/2103262359 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:54.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.684+0000 7fed0b400640 1 --2- 172.21.15.100:0/2103262359 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed0c0ab7f0 0x7fed0c16a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:54.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.684+0000 7fed11000640 1 --2- 172.21.15.100:0/2103262359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed0c0c7e50 0x7fed0c16adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:54.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.684+0000 7fed0be00640 1 -- 172.21.15.100:0/2103262359 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed0c0ab7f0 msgr2=0x7fed0c16a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:54.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.684+0000 7fed0be00640 1 --2- 172.21.15.100:0/2103262359 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed0c0ab7f0 0x7fed0c16a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.684+0000 7fed0be00640 1 -- 172.21.15.100:0/2103262359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed0c0c7e50 msgr2=0x7fed0c16adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:54.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.684+0000 7fed0be00640 1 --2- 172.21.15.100:0/2103262359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed0c0c7e50 0x7fed0c16adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.684+0000 7fed0be00640 1 -- 172.21.15.100:0/2103262359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf8009390 con 0x7fed0c069a60 2024-08-17T02:48:54.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.684+0000 7fed0b400640 1 --2- 172.21.15.100:0/2103262359 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed0c0ab7f0 0x7fed0c16a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:48:54.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.684+0000 7fed11000640 1 --2- 172.21.15.100:0/2103262359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed0c0c7e50 0x7fed0c16adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:48:54.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.684+0000 7fed0be00640 1 --2- 172.21.15.100:0/2103262359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed0c069a60 0x7fed0c0aaf90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fecfc00ea20 tx=0x7fecfc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:54.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.684+0000 7fed03400640 1 -- 172.21.15.100:0/2103262359 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc009600 con 0x7fed0c069a60 2024-08-17T02:48:54.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.684+0000 7fed03400640 1 -- 172.21.15.100:0/2103262359 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc00ca10 con 0x7fed0c069a60 2024-08-17T02:48:54.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.684+0000 7fed13000640 1 -- 172.21.15.100:0/2103262359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0c0a5600 con 0x7fed0c069a60 2024-08-17T02:48:54.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.684+0000 7fed03400640 1 -- 172.21.15.100:0/2103262359 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc00cd90 con 0x7fed0c069a60 2024-08-17T02:48:54.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.685+0000 7fed13000640 1 -- 172.21.15.100:0/2103262359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0c157e30 con 0x7fed0c069a60 2024-08-17T02:48:54.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.685+0000 7fed13000640 1 -- 172.21.15.100:0/2103262359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0c0a5b00 con 0x7fed0c069a60 2024-08-17T02:48:54.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.686+0000 7fed03400640 1 -- 172.21.15.100:0/2103262359 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fecfc013680 con 0x7fed0c069a60 2024-08-17T02:48:54.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.687+0000 7fed03400640 1 --2- 172.21.15.100:0/2103262359 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fecec065150 0x7fecec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:54.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.687+0000 7fed03400640 1 -- 172.21.15.100:0/2103262359 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fecfc082780 con 0x7fed0c069a60 2024-08-17T02:48:54.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.687+0000 7fed0b400640 1 --2- 172.21.15.100:0/2103262359 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fecec065150 0x7fecec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:54.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.688+0000 7fed0b400640 1 --2- 172.21.15.100:0/2103262359 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fecec065150 0x7fecec067600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fecf8034000 tx=0x7fecf8032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:54.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.691+0000 7fed03400640 1 -- 172.21.15.100:0/2103262359 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fecfc0507c0 con 0x7fed0c069a60 2024-08-17T02:48:54.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.862+0000 7fed13000640 1 -- 172.21.15.100:0/2103262359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001028572.data", "var": "pg_num"} v 0) v1 -- 0x7fed0c071050 con 0x7fed0c069a60 2024-08-17T02:48:54.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.862+0000 7fed03400640 1 -- 172.21.15.100:0/2103262359 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001028572.data", "var": "pg_num"}]=0 v41) v1 ==== 124+0+11 (secure 0 0 0) 0x7fecfc021020 con 0x7fed0c069a60 2024-08-17T02:48:54.863 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-08-17T02:48:54.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.864+0000 7fed13000640 1 -- 172.21.15.100:0/2103262359 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fecec065150 msgr2=0x7fecec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:54.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.864+0000 7fed13000640 1 --2- 172.21.15.100:0/2103262359 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fecec065150 0x7fecec067600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fecf8034000 tx=0x7fecf8032000 comp rx=0 tx=0).stop 2024-08-17T02:48:54.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.864+0000 7fed13000640 1 -- 172.21.15.100:0/2103262359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed0c069a60 msgr2=0x7fed0c0aaf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:54.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.864+0000 7fed13000640 1 --2- 172.21.15.100:0/2103262359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed0c069a60 0x7fed0c0aaf90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fecfc00ea20 tx=0x7fecfc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.864+0000 7fed13000640 1 -- 172.21.15.100:0/2103262359 shutdown_connections 2024-08-17T02:48:54.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.864+0000 7fed13000640 1 --2- 172.21.15.100:0/2103262359 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fecec065150 0x7fecec067600 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.864+0000 7fed13000640 1 --2- 172.21.15.100:0/2103262359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed0c0c7e50 0x7fed0c16adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.864+0000 7fed13000640 1 --2- 172.21.15.100:0/2103262359 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed0c0ab7f0 0x7fed0c16a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.864+0000 7fed13000640 1 --2- 172.21.15.100:0/2103262359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed0c069a60 0x7fed0c0aaf90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:54.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.864+0000 7fed13000640 1 -- 172.21.15.100:0/2103262359 >> 172.21.15.100:0/2103262359 conn(0x7fed0c067750 msgr2=0x7fed0c0ca000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:54.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.864+0000 7fed13000640 1 -- 172.21.15.100:0/2103262359 shutdown_connections 2024-08-17T02:48:54.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:54.864+0000 7fed13000640 1 -- 172.21.15.100:0/2103262359 wait complete. 2024-08-17T02:48:54.880 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:48:55.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.027+0000 7f5172200640 1 Processor -- start 2024-08-17T02:48:55.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.027+0000 7f5172200640 1 -- start start 2024-08-17T02:48:55.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.028+0000 7f5172200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f516c06df00 0x7f516c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:55.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.028+0000 7f5172200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f516c155df0 0x7f516c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:55.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.028+0000 7f5172200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f516c156670 con 0x7f516c155a20 2024-08-17T02:48:55.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.028+0000 7f5172200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f516c0b0350 con 0x7f516c155df0 2024-08-17T02:48:55.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.028+0000 7f5172200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f516c06e5e0 con 0x7f516c06df00 2024-08-17T02:48:55.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.029+0000 7f516b400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f516c155a20 0x7f516c06d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46546/0 (socket says 172.21.15.100:46546) 2024-08-17T02:48:55.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.029+0000 7f516b400640 1 -- 172.21.15.100:0/3625542283 learned_addr learned my addr 172.21.15.100:0/3625542283 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:48:55.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.029+0000 7f516be00640 1 --2- 172.21.15.100:0/3625542283 >> v2:172.21.15.100:3300/0 conn(0x7f516c155df0 0x7f516c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:55.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.029+0000 7f516aa00640 1 --2- 172.21.15.100:0/3625542283 >> v2:172.21.15.123:3300/0 conn(0x7f516c06df00 0x7f516c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:55.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.029+0000 7f516a000640 1 -- 172.21.15.100:0/3625542283 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1016298311 0 0) 0x7f516c156670 con 0x7f516c155a20 2024-08-17T02:48:55.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.029+0000 7f516a000640 1 -- 172.21.15.100:0/3625542283 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51500034e0 con 0x7f516c155a20 2024-08-17T02:48:55.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.029+0000 7f516be00640 1 -- 172.21.15.100:0/3625542283 >> v2:172.21.15.123:3300/0 conn(0x7f516c06df00 msgr2=0x7f516c0adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:55.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.029+0000 7f516be00640 1 --2- 172.21.15.100:0/3625542283 >> v2:172.21.15.123:3300/0 conn(0x7f516c06df00 0x7f516c0adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.029+0000 7f516be00640 1 -- 172.21.15.100:0/3625542283 >> v1:172.21.15.100:6789/0 conn(0x7f516c155a20 legacy=0x7f516c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:55.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.029+0000 7f516be00640 1 -- 172.21.15.100:0/3625542283 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c06e8c0 con 0x7f516c155df0 2024-08-17T02:48:55.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.030+0000 7f516be00640 1 --2- 172.21.15.100:0/3625542283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f516c155df0 0x7f516c0ad9b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f516c06aa40 tx=0x7f5164009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3db69b5e4b1951 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:55.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.031+0000 7f516a000640 1 -- 172.21.15.100:0/3625542283 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5164007550 con 0x7f516c155df0 2024-08-17T02:48:55.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.031+0000 7f516a000640 1 -- 172.21.15.100:0/3625542283 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516402d050 con 0x7f516c155df0 2024-08-17T02:48:55.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.031+0000 7f516a000640 1 -- 172.21.15.100:0/3625542283 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5164007920 con 0x7f516c155df0 2024-08-17T02:48:55.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.031+0000 7f5172200640 1 -- 172.21.15.100:0/3625542283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f516c155df0 msgr2=0x7f516c0ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:55.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.031+0000 7f5172200640 1 --2- 172.21.15.100:0/3625542283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f516c155df0 0x7f516c0ad9b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f516c06aa40 tx=0x7f5164009780 comp rx=0 tx=0).stop 2024-08-17T02:48:55.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.031+0000 7f5172200640 1 -- 172.21.15.100:0/3625542283 shutdown_connections 2024-08-17T02:48:55.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.031+0000 7f5172200640 1 --2- 172.21.15.100:0/3625542283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f516c155df0 0x7f516c0ad9b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.031+0000 7f5172200640 1 --2- 172.21.15.100:0/3625542283 >> v2:172.21.15.123:3300/0 conn(0x7f516c06df00 0x7f516c0adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.031+0000 7f5172200640 1 -- 172.21.15.100:0/3625542283 >> 172.21.15.100:0/3625542283 conn(0x7f516c0cb9b0 msgr2=0x7f516c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:55.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.031+0000 7f5172200640 1 -- 172.21.15.100:0/3625542283 shutdown_connections 2024-08-17T02:48:55.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.031+0000 7f5172200640 1 -- 172.21.15.100:0/3625542283 wait complete. 2024-08-17T02:48:55.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.033+0000 7f5172200640 1 Processor -- start 2024-08-17T02:48:55.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.033+0000 7f5172200640 1 -- start start 2024-08-17T02:48:55.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.034+0000 7f5172200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f516c06df00 0x7f516c14cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:55.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.034+0000 7f5172200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f516c155a20 0x7f516c145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:55.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.034+0000 7f5172200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f516c155df0 0x7f516c069820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:55.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.034+0000 7f5172200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c166d70 con 0x7f516c06df00 2024-08-17T02:48:55.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.034+0000 7f5172200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c167b90 con 0x7f516c155df0 2024-08-17T02:48:55.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.034+0000 7f5172200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f516c16d380 con 0x7f516c155a20 2024-08-17T02:48:55.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.034+0000 7f516b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f516c06df00 0x7f516c14cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:55.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.034+0000 7f516b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f516c06df00 0x7f516c14cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38300/0 (socket says 172.21.15.100:38300) 2024-08-17T02:48:55.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.034+0000 7f516b400640 1 -- 172.21.15.100:0/223016304 learned_addr learned my addr 172.21.15.100:0/223016304 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:55.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.034+0000 7f516aa00640 1 --2- 172.21.15.100:0/223016304 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f516c155a20 0x7f516c145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:55.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.034+0000 7f516be00640 1 --2- 172.21.15.100:0/223016304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f516c155df0 0x7f516c069820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:55.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.034+0000 7f516b400640 1 -- 172.21.15.100:0/223016304 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f516c155a20 msgr2=0x7f516c145b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:55.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.034+0000 7f516b400640 1 --2- 172.21.15.100:0/223016304 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f516c155a20 0x7f516c145b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.034+0000 7f516b400640 1 -- 172.21.15.100:0/223016304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f516c155df0 msgr2=0x7f516c069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:55.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.034+0000 7f516b400640 1 --2- 172.21.15.100:0/223016304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f516c155df0 0x7f516c069820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.034+0000 7f516b400640 1 -- 172.21.15.100:0/223016304 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5164009a20 con 0x7f516c06df00 2024-08-17T02:48:55.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.034+0000 7f516be00640 1 --2- 172.21.15.100:0/223016304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f516c155df0 0x7f516c069820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:48:55.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.034+0000 7f516b400640 1 --2- 172.21.15.100:0/223016304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f516c06df00 0x7f516c14cda0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f515c00c5b0 tx=0x7f515c007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:55.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.035+0000 7f5162a00640 1 -- 172.21.15.100:0/223016304 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c005b70 con 0x7f516c06df00 2024-08-17T02:48:55.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.035+0000 7f5162a00640 1 -- 172.21.15.100:0/223016304 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515c005cf0 con 0x7f516c06df00 2024-08-17T02:48:55.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.035+0000 7f5162a00640 1 -- 172.21.15.100:0/223016304 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c007340 con 0x7f516c06df00 2024-08-17T02:48:55.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.035+0000 7f5172200640 1 -- 172.21.15.100:0/223016304 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f516c166f80 con 0x7f516c06df00 2024-08-17T02:48:55.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.035+0000 7f5172200640 1 -- 172.21.15.100:0/223016304 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516c167540 con 0x7f516c06df00 2024-08-17T02:48:55.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.036+0000 7f5172200640 1 -- 172.21.15.100:0/223016304 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f516c064db0 con 0x7f516c06df00 2024-08-17T02:48:55.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.037+0000 7f5162a00640 1 -- 172.21.15.100:0/223016304 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f515c01b400 con 0x7f516c06df00 2024-08-17T02:48:55.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.037+0000 7f5162a00640 1 --2- 172.21.15.100:0/223016304 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f514c065150 0x7f514c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:55.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.037+0000 7f5162a00640 1 -- 172.21.15.100:0/223016304 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f515c0820c0 con 0x7f516c06df00 2024-08-17T02:48:55.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.038+0000 7f516aa00640 1 --2- 172.21.15.100:0/223016304 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f514c065150 0x7f514c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:55.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.038+0000 7f516aa00640 1 --2- 172.21.15.100:0/223016304 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f514c065150 0x7f514c067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f516c0687d0 tx=0x7f5158008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:55.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.041+0000 7f5162a00640 1 -- 172.21.15.100:0/223016304 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f515c0500e0 con 0x7f516c06df00 2024-08-17T02:48:55.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.249+0000 7f5172200640 1 -- 172.21.15.100:0/223016304 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f516c0cb320 con 0x7f516c06df00 2024-08-17T02:48:55.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.250+0000 7f5162a00640 1 -- 172.21.15.100:0/223016304 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4627 (secure 0 0 0) 0x7f515c053700 con 0x7f516c06df00 2024-08-17T02:48:55.251 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:48:55.251 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1972998642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1972998642},{"type":"v1","addr":"172.21.15.100:6836","nonce":1972998642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3961484077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3961484077},{"type":"v1","addr":"172.21.15.100:6837","nonce":3961484077}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5173,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1672641445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":1672641445},{"type":"v1","addr":"172.21.15.123:6835","nonce":1672641445}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:42.789210+0000","modified":"2024-08-17T02:46:44.792554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4885":{"gid":4885,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.123:6834/1763367135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1763367135},{"type":"v1","addr":"172.21.15.123:6834","nonce":1763367135}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001028572","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:48:55.251 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 22 2024-08-17T02:48:55.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.252+0000 7f5172200640 1 -- 172.21.15.100:0/223016304 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f514c065150 msgr2=0x7f514c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:55.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.252+0000 7f5172200640 1 --2- 172.21.15.100:0/223016304 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f514c065150 0x7f514c067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f516c0687d0 tx=0x7f5158008040 comp rx=0 tx=0).stop 2024-08-17T02:48:55.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.252+0000 7f5172200640 1 -- 172.21.15.100:0/223016304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f516c06df00 msgr2=0x7f516c14cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:55.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.252+0000 7f5172200640 1 --2- 172.21.15.100:0/223016304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f516c06df00 0x7f516c14cda0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f515c00c5b0 tx=0x7f515c007d70 comp rx=0 tx=0).stop 2024-08-17T02:48:55.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.252+0000 7f5172200640 1 -- 172.21.15.100:0/223016304 shutdown_connections 2024-08-17T02:48:55.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.252+0000 7f5172200640 1 --2- 172.21.15.100:0/223016304 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f514c065150 0x7f514c067600 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.252+0000 7f5172200640 1 --2- 172.21.15.100:0/223016304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f516c155df0 0x7f516c069820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.252+0000 7f5172200640 1 --2- 172.21.15.100:0/223016304 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f516c155a20 0x7f516c145b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.252+0000 7f5172200640 1 --2- 172.21.15.100:0/223016304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f516c06df00 0x7f516c14cda0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.252+0000 7f5172200640 1 -- 172.21.15.100:0/223016304 >> 172.21.15.100:0/223016304 conn(0x7f516c0cb9b0 msgr2=0x7f516c158510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:55.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.252+0000 7f5172200640 1 -- 172.21.15.100:0/223016304 shutdown_connections 2024-08-17T02:48:55.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.252+0000 7f5172200640 1 -- 172.21.15.100:0/223016304 wait complete. 2024-08-17T02:48:55.268 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:48:55.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.417+0000 7ff0fec00640 1 Processor -- start 2024-08-17T02:48:55.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.417+0000 7ff0fec00640 1 -- start start 2024-08-17T02:48:55.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.418+0000 7ff0fec00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff0f80af6d0 0x7ff0f80aa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:55.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.418+0000 7ff0fec00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0f80ac820 0x7ff0f8159080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:55.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.418+0000 7ff0fec00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f80afb50 con 0x7ff0f8158cb0 2024-08-17T02:48:55.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.418+0000 7ff0fec00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f80aae50 con 0x7ff0f80af6d0 2024-08-17T02:48:55.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.418+0000 7ff0fec00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f80abc80 con 0x7ff0f80ac820 2024-08-17T02:48:55.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.419+0000 7ff0f7e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff0f8158cb0 0x7ff0f80ac110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:46556/0 (socket says 172.21.15.100:46556) 2024-08-17T02:48:55.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.419+0000 7ff0f7e00640 1 -- 172.21.15.100:0/498490379 learned_addr learned my addr 172.21.15.100:0/498490379 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:48:55.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.419+0000 7ff0ef400640 1 --2- 172.21.15.100:0/498490379 >> v2:172.21.15.123:3300/0 conn(0x7ff0f80af6d0 0x7ff0f80aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:55.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.419+0000 7ff0fcc00640 1 --2- 172.21.15.100:0/498490379 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0f80ac820 0x7ff0f8159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:55.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.419+0000 7ff0f7400640 1 -- 172.21.15.100:0/498490379 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732701924 0 0) 0x7ff0e8001110 con 0x7ff0f8158cb0 2024-08-17T02:48:55.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.419+0000 7ff0f7400640 1 -- 172.21.15.100:0/498490379 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0dc0034e0 con 0x7ff0f8158cb0 2024-08-17T02:48:55.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.419+0000 7ff0ef400640 1 -- 172.21.15.100:0/498490379 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0f80ac820 msgr2=0x7ff0f8159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:55.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.419+0000 7ff0ef400640 1 --2- 172.21.15.100:0/498490379 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0f80ac820 0x7ff0f8159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.419+0000 7ff0ef400640 1 -- 172.21.15.100:0/498490379 >> v1:172.21.15.100:6789/0 conn(0x7ff0f8158cb0 legacy=0x7ff0f80ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:55.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.419+0000 7ff0ef400640 1 -- 172.21.15.100:0/498490379 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f80ab070 con 0x7ff0f80af6d0 2024-08-17T02:48:55.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.419+0000 7ff0fcc00640 1 --2- 172.21.15.100:0/498490379 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0f80ac820 0x7ff0f8159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:48:55.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.420+0000 7ff0ef400640 1 --2- 172.21.15.100:0/498490379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f80af6d0 0x7ff0f80aa910 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0009850 tx=0x7ff0e00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=573dbb4bceb1680e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:55.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.421+0000 7ff0f7400640 1 -- 172.21.15.100:0/498490379 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e002ad80 con 0x7ff0f80af6d0 2024-08-17T02:48:55.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.421+0000 7ff0f7400640 1 -- 172.21.15.100:0/498490379 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e0032440 con 0x7ff0f80af6d0 2024-08-17T02:48:55.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.421+0000 7ff0f7400640 1 -- 172.21.15.100:0/498490379 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0032800 con 0x7ff0f80af6d0 2024-08-17T02:48:55.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.421+0000 7ff0fec00640 1 -- 172.21.15.100:0/498490379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f80af6d0 msgr2=0x7ff0f80aa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.421+0000 7ff0fec00640 1 --2- 172.21.15.100:0/498490379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f80af6d0 0x7ff0f80aa910 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0009850 tx=0x7ff0e00090f0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.421+0000 7ff0fec00640 1 -- 172.21.15.100:0/498490379 shutdown_connections 2024-08-17T02:48:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.421+0000 7ff0fec00640 1 --2- 172.21.15.100:0/498490379 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0f80ac820 0x7ff0f8159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.421+0000 7ff0fec00640 1 --2- 172.21.15.100:0/498490379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f80af6d0 0x7ff0f80aa910 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.421+0000 7ff0fec00640 1 -- 172.21.15.100:0/498490379 >> 172.21.15.100:0/498490379 conn(0x7ff0f8096a70 msgr2=0x7ff0f8096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.421+0000 7ff0fec00640 1 -- 172.21.15.100:0/498490379 shutdown_connections 2024-08-17T02:48:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.421+0000 7ff0fec00640 1 -- 172.21.15.100:0/498490379 wait complete. 2024-08-17T02:48:55.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.423+0000 7ff0fec00640 1 Processor -- start 2024-08-17T02:48:55.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.423+0000 7ff0fec00640 1 -- start start 2024-08-17T02:48:55.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.424+0000 7ff0fec00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0f80ac820 0x7ff0f81699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:55.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.424+0000 7ff0fec00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f80af6d0 0x7ff0f80c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:55.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.424+0000 7ff0fec00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0f8158cb0 0x7ff0f81683a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:55.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.424+0000 7ff0fec00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f80c7c00 con 0x7ff0f80ac820 2024-08-17T02:48:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.424+0000 7ff0fec00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f8169f00 con 0x7ff0f80af6d0 2024-08-17T02:48:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.424+0000 7ff0fec00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f80c6d10 con 0x7ff0f8158cb0 2024-08-17T02:48:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.424+0000 7ff0f7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0f80ac820 0x7ff0f81699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.424+0000 7ff0f7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0f80ac820 0x7ff0f81699c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38308/0 (socket says 172.21.15.100:38308) 2024-08-17T02:48:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.424+0000 7ff0f7e00640 1 -- 172.21.15.100:0/217624701 learned_addr learned my addr 172.21.15.100:0/217624701 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.424+0000 7ff0fcc00640 1 --2- 172.21.15.100:0/217624701 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0f8158cb0 0x7ff0f81683a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.424+0000 7ff0ef400640 1 --2- 172.21.15.100:0/217624701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f80af6d0 0x7ff0f80c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.424+0000 7ff0f7e00640 1 -- 172.21.15.100:0/217624701 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0f8158cb0 msgr2=0x7ff0f81683a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.424+0000 7ff0f7e00640 1 --2- 172.21.15.100:0/217624701 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0f8158cb0 0x7ff0f81683a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.424+0000 7ff0f7e00640 1 -- 172.21.15.100:0/217624701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f80af6d0 msgr2=0x7ff0f80c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.424+0000 7ff0f7e00640 1 --2- 172.21.15.100:0/217624701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f80af6d0 0x7ff0f80c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.424+0000 7ff0f7e00640 1 -- 172.21.15.100:0/217624701 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f0009a20 con 0x7ff0f80ac820 2024-08-17T02:48:55.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.424+0000 7ff0fcc00640 1 --2- 172.21.15.100:0/217624701 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0f8158cb0 0x7ff0f81683a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:48:55.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.424+0000 7ff0ef400640 1 --2- 172.21.15.100:0/217624701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f80af6d0 0x7ff0f80c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:48:55.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.424+0000 7ff0f7e00640 1 --2- 172.21.15.100:0/217624701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0f80ac820 0x7ff0f81699c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff0e800c7f0 tx=0x7ff0e8007ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:55.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.425+0000 7ff0efe00640 1 -- 172.21.15.100:0/217624701 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8007e30 con 0x7ff0f80ac820 2024-08-17T02:48:55.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.425+0000 7ff0efe00640 1 -- 172.21.15.100:0/217624701 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e8005870 con 0x7ff0f80ac820 2024-08-17T02:48:55.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.425+0000 7ff0efe00640 1 -- 172.21.15.100:0/217624701 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8005c30 con 0x7ff0f80ac820 2024-08-17T02:48:55.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.425+0000 7ff0fec00640 1 -- 172.21.15.100:0/217624701 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e0009390 con 0x7ff0f80ac820 2024-08-17T02:48:55.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.425+0000 7ff0fec00640 1 -- 172.21.15.100:0/217624701 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f80c75b0 con 0x7ff0f80ac820 2024-08-17T02:48:55.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.426+0000 7ff0fec00640 1 -- 172.21.15.100:0/217624701 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f8064db0 con 0x7ff0f80ac820 2024-08-17T02:48:55.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.427+0000 7ff0efe00640 1 -- 172.21.15.100:0/217624701 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff0e8007300 con 0x7ff0f80ac820 2024-08-17T02:48:55.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.428+0000 7ff0efe00640 1 --2- 172.21.15.100:0/217624701 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff0d4065150 0x7ff0d4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:55.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.428+0000 7ff0efe00640 1 -- 172.21.15.100:0/217624701 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7ff0e8081dd0 con 0x7ff0f80ac820 2024-08-17T02:48:55.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.428+0000 7ff0ef400640 1 --2- 172.21.15.100:0/217624701 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff0d4065150 0x7ff0d4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:55.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.429+0000 7ff0ef400640 1 --2- 172.21.15.100:0/217624701 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff0d4065150 0x7ff0d4067600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0034000 tx=0x7ff0e0032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:55.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.433+0000 7ff0efe00640 1 -- 172.21.15.100:0/217624701 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff0e804fdf0 con 0x7ff0f80ac820 2024-08-17T02:48:55.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.604+0000 7ff0fec00640 1 -- 172.21.15.100:0/217624701 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0f80afb50 con 0x7ff0f80ac820 2024-08-17T02:48:55.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.605+0000 7ff0efe00640 1 -- 172.21.15.100:0/217624701 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+15562 (secure 0 0 0) 0x7ff0f80afb50 con 0x7ff0f80ac820 2024-08-17T02:48:55.605 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:48:55.606 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":41,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:48:53.419744+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000001028572.meta","create_time":"2024-08-17T02:46:40.913393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001028572"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001028572.data","create_time":"2024-08-17T02:46:41.819233+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001028572"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6835/1541092259":"2024-08-18T02:48:50.211886+0000","172.21.15.123:6833/1541092259":"2024-08-18T02:48:50.211886+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:48:55.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.607+0000 7ff0fec00640 1 -- 172.21.15.100:0/217624701 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff0d4065150 msgr2=0x7ff0d4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:55.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.607+0000 7ff0fec00640 1 --2- 172.21.15.100:0/217624701 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff0d4065150 0x7ff0d4067600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0034000 tx=0x7ff0e0032000 comp rx=0 tx=0).stop 2024-08-17T02:48:55.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.607+0000 7ff0fec00640 1 -- 172.21.15.100:0/217624701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0f80ac820 msgr2=0x7ff0f81699c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:55.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.607+0000 7ff0fec00640 1 --2- 172.21.15.100:0/217624701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0f80ac820 0x7ff0f81699c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff0e800c7f0 tx=0x7ff0e8007ba0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.607+0000 7ff0fec00640 1 -- 172.21.15.100:0/217624701 shutdown_connections 2024-08-17T02:48:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.607+0000 7ff0fec00640 1 --2- 172.21.15.100:0/217624701 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff0d4065150 0x7ff0d4067600 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.607+0000 7ff0fec00640 1 --2- 172.21.15.100:0/217624701 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0f8158cb0 0x7ff0f81683a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.607+0000 7ff0fec00640 1 --2- 172.21.15.100:0/217624701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f80af6d0 0x7ff0f80c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.607+0000 7ff0fec00640 1 --2- 172.21.15.100:0/217624701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0f80ac820 0x7ff0f81699c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.607+0000 7ff0fec00640 1 -- 172.21.15.100:0/217624701 >> 172.21.15.100:0/217624701 conn(0x7ff0f8096a70 msgr2=0x7ff0f806aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.607+0000 7ff0fec00640 1 -- 172.21.15.100:0/217624701 shutdown_connections 2024-08-17T02:48:55.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.607+0000 7ff0fec00640 1 -- 172.21.15.100:0/217624701 wait complete. 2024-08-17T02:48:55.623 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000001028572 and related pools 2024-08-17T02:48:55.624 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:48:55.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.773+0000 7fcf07200640 1 Processor -- start 2024-08-17T02:48:55.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.773+0000 7fcf07200640 1 -- start start 2024-08-17T02:48:55.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.774+0000 7fcf07200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcf08069710 0x7fcf080ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:55.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.774+0000 7fcf07200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf080aec20 con 0x7fcf080ac540 2024-08-17T02:48:55.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.774+0000 7fcf07200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf080ae330 con 0x7fcf08158bd0 2024-08-17T02:48:55.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.774+0000 7fcf07200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf080acd30 con 0x7fcf08069710 2024-08-17T02:48:55.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.774+0000 7fcefd400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcf08069710 0x7fcf080ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:55.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.774+0000 7fcefd400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcf08069710 0x7fcf080ac000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38312/0 (socket says 172.21.15.100:38312) 2024-08-17T02:48:55.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.774+0000 7fcefd400640 1 -- 172.21.15.100:0/365856384 learned_addr learned my addr 172.21.15.100:0/365856384 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:55.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.775+0000 7fcefd400640 1 -- 172.21.15.100:0/365856384 >> v1:172.21.15.123:6789/0 conn(0x7fcf08158bd0 legacy=0x7fcf08069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:55.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.775+0000 7fcefd400640 1 -- 172.21.15.100:0/365856384 >> v1:172.21.15.100:6789/0 conn(0x7fcf080ac540 legacy=0x7fcf080af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:55.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.775+0000 7fcefd400640 1 -- 172.21.15.100:0/365856384 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf080ae5d0 con 0x7fcf08069710 2024-08-17T02:48:55.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.776+0000 7fcefd400640 1 --2- 172.21.15.100:0/365856384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf08069710 0x7fcf080ac000 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcef0009910 tx=0x7fcef00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1a9f61f543a2f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:55.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.776+0000 7fcf05400640 1 -- 172.21.15.100:0/365856384 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef002add0 con 0x7fcf08069710 2024-08-17T02:48:55.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.776+0000 7fcf05400640 1 -- 172.21.15.100:0/365856384 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef0032440 con 0x7fcf08069710 2024-08-17T02:48:55.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.776+0000 7fcf05400640 1 -- 172.21.15.100:0/365856384 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0032820 con 0x7fcf08069710 2024-08-17T02:48:55.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.777+0000 7fcf07200640 1 -- 172.21.15.100:0/365856384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf08069710 msgr2=0x7fcf080ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:55.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.777+0000 7fcf07200640 1 --2- 172.21.15.100:0/365856384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf08069710 0x7fcf080ac000 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcef0009910 tx=0x7fcef00091d0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.777+0000 7fcf07200640 1 -- 172.21.15.100:0/365856384 shutdown_connections 2024-08-17T02:48:55.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.777+0000 7fcf07200640 1 --2- 172.21.15.100:0/365856384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf08069710 0x7fcf080ac000 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.777+0000 7fcf07200640 1 -- 172.21.15.100:0/365856384 >> 172.21.15.100:0/365856384 conn(0x7fcf08096a70 msgr2=0x7fcf080cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:55.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.777+0000 7fcf07200640 1 -- 172.21.15.100:0/365856384 shutdown_connections 2024-08-17T02:48:55.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.777+0000 7fcf07200640 1 -- 172.21.15.100:0/365856384 wait complete. 2024-08-17T02:48:55.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.778+0000 7fcf07200640 1 Processor -- start 2024-08-17T02:48:55.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.778+0000 7fcf07200640 1 -- start start 2024-08-17T02:48:55.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.779+0000 7fcf07200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf08069710 0x7fcf080c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:55.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.779+0000 7fcf07200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf080ac540 0x7fcf080c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:55.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.779+0000 7fcf07200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf08158bd0 0x7fcf08152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:55.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.779+0000 7fcf07200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf080c82d0 con 0x7fcf08158bd0 2024-08-17T02:48:55.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.779+0000 7fcf07200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf080c85b0 con 0x7fcf08069710 2024-08-17T02:48:55.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.779+0000 7fcf07200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf080c8890 con 0x7fcf080ac540 2024-08-17T02:48:55.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.779+0000 7fcf06800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf08158bd0 0x7fcf08152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:55.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.779+0000 7fcf06800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf08158bd0 0x7fcf08152570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38318/0 (socket says 172.21.15.100:38318) 2024-08-17T02:48:55.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.779+0000 7fcf06800640 1 -- 172.21.15.100:0/3576877492 learned_addr learned my addr 172.21.15.100:0/3576877492 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:55.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.780+0000 7fcefd400640 1 --2- 172.21.15.100:0/3576877492 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf080ac540 0x7fcf080c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:55.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.780+0000 7fcf05e00640 1 --2- 172.21.15.100:0/3576877492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf08069710 0x7fcf080c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:55.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.780+0000 7fcf06800640 1 -- 172.21.15.100:0/3576877492 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf080ac540 msgr2=0x7fcf080c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:55.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.780+0000 7fcf06800640 1 --2- 172.21.15.100:0/3576877492 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf080ac540 0x7fcf080c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.780+0000 7fcf06800640 1 -- 172.21.15.100:0/3576877492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf08069710 msgr2=0x7fcf080c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:55.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.780+0000 7fcf06800640 1 --2- 172.21.15.100:0/3576877492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf08069710 0x7fcf080c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:55.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.780+0000 7fcf06800640 1 -- 172.21.15.100:0/3576877492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef0009450 con 0x7fcf08158bd0 2024-08-17T02:48:55.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.780+0000 7fcf06800640 1 --2- 172.21.15.100:0/3576877492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf08158bd0 0x7fcf08152570 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000c860 tx=0x7fcf00001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:55.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.780+0000 7fcefe000640 1 -- 172.21.15.100:0/3576877492 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0000ce50 con 0x7fcf08158bd0 2024-08-17T02:48:55.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.780+0000 7fcefe000640 1 -- 172.21.15.100:0/3576877492 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0000a850 con 0x7fcf08158bd0 2024-08-17T02:48:55.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.780+0000 7fcf07200640 1 -- 172.21.15.100:0/3576877492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf080c8b70 con 0x7fcf08158bd0 2024-08-17T02:48:55.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.780+0000 7fcefe000640 1 -- 172.21.15.100:0/3576877492 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0000ac10 con 0x7fcf08158bd0 2024-08-17T02:48:55.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.780+0000 7fcf07200640 1 -- 172.21.15.100:0/3576877492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf080c98b0 con 0x7fcf08158bd0 2024-08-17T02:48:55.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.781+0000 7fcf07200640 1 -- 172.21.15.100:0/3576877492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf08071050 con 0x7fcf08158bd0 2024-08-17T02:48:55.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.782+0000 7fcefe000640 1 -- 172.21.15.100:0/3576877492 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcf00012630 con 0x7fcf08158bd0 2024-08-17T02:48:55.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.783+0000 7fcefe000640 1 --2- 172.21.15.100:0/3576877492 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fcee4065150 0x7fcee4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:55.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.783+0000 7fcefe000640 1 -- 172.21.15.100:0/3576877492 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fcf000827f0 con 0x7fcf08158bd0 2024-08-17T02:48:55.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.783+0000 7fcf05e00640 1 --2- 172.21.15.100:0/3576877492 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fcee4065150 0x7fcee4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.784+0000 7fcf05e00640 1 --2- 172.21.15.100:0/3576877492 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fcee4065150 0x7fcee4067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcef8003720 tx=0x7fcef8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:55.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.787+0000 7fcefe000640 1 -- 172.21.15.100:0/3576877492 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcf00050790 con 0x7fcf08158bd0 2024-08-17T02:48:55.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.996+0000 7fcf07200640 1 -- 172.21.15.100:0/3576877492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf080ce850 con 0x7fcf08158bd0 2024-08-17T02:48:55.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.997+0000 7fcefe000640 1 -- 172.21.15.100:0/3576877492 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4627 (secure 0 0 0) 0x7fcf00053db0 con 0x7fcf08158bd0 2024-08-17T02:48:55.997 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:48:55.998 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1972998642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1972998642},{"type":"v1","addr":"172.21.15.100:6836","nonce":1972998642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3961484077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3961484077},{"type":"v1","addr":"172.21.15.100:6837","nonce":3961484077}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5173,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1672641445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":1672641445},{"type":"v1","addr":"172.21.15.123:6835","nonce":1672641445}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:42.789210+0000","modified":"2024-08-17T02:46:44.792554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4885":{"gid":4885,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.123:6834/1763367135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1763367135},{"type":"v1","addr":"172.21.15.123:6834","nonce":1763367135}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001028572","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:48:55.998 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 22 2024-08-17T02:48:56.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.999+0000 7fcf07200640 1 -- 172.21.15.100:0/3576877492 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fcee4065150 msgr2=0x7fcee4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:56.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.999+0000 7fcf07200640 1 --2- 172.21.15.100:0/3576877492 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fcee4065150 0x7fcee4067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcef8003720 tx=0x7fcef8009040 comp rx=0 tx=0).stop 2024-08-17T02:48:56.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.999+0000 7fcf07200640 1 -- 172.21.15.100:0/3576877492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf08158bd0 msgr2=0x7fcf08152570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:56.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.999+0000 7fcf07200640 1 --2- 172.21.15.100:0/3576877492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf08158bd0 0x7fcf08152570 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000c860 tx=0x7fcf00001690 comp rx=0 tx=0).stop 2024-08-17T02:48:56.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.999+0000 7fcf07200640 1 -- 172.21.15.100:0/3576877492 shutdown_connections 2024-08-17T02:48:56.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.999+0000 7fcf07200640 1 --2- 172.21.15.100:0/3576877492 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fcee4065150 0x7fcee4067600 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.999+0000 7fcf07200640 1 --2- 172.21.15.100:0/3576877492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf08158bd0 0x7fcf08152570 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.999+0000 7fcf07200640 1 --2- 172.21.15.100:0/3576877492 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf080ac540 0x7fcf080c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.999+0000 7fcf07200640 1 --2- 172.21.15.100:0/3576877492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf08069710 0x7fcf080c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.999+0000 7fcf07200640 1 -- 172.21.15.100:0/3576877492 >> 172.21.15.100:0/3576877492 conn(0x7fcf08096a70 msgr2=0x7fcf080ab530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:56.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.999+0000 7fcf07200640 1 -- 172.21.15.100:0/3576877492 shutdown_connections 2024-08-17T02:48:56.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:55.999+0000 7fcf07200640 1 -- 172.21.15.100:0/3576877492 wait complete. 2024-08-17T02:48:56.015 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:48:56.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.161+0000 7fa7d5200640 1 Processor -- start 2024-08-17T02:48:56.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.161+0000 7fa7d5200640 1 -- start start 2024-08-17T02:48:56.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.162+0000 7fa7d5200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa7d0155a20 0x7fa7d00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.162+0000 7fa7d5200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa7d0155df0 0x7fa7d00ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.162+0000 7fa7d5200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa7d006d7f0 0x7fa7d006dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.162+0000 7fa7d5200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d00b0350 con 0x7fa7d006d7f0 2024-08-17T02:48:56.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.162+0000 7fa7d5200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d006e1d0 con 0x7fa7d0155df0 2024-08-17T02:48:56.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.162+0000 7fa7d5200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d0156670 con 0x7fa7d0155a20 2024-08-17T02:48:56.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.163+0000 7fa7ce800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa7d006d7f0 0x7fa7d006dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.163+0000 7fa7ce800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa7d006d7f0 0x7fa7d006dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38322/0 (socket says 172.21.15.100:38322) 2024-08-17T02:48:56.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.163+0000 7fa7ce800640 1 -- 172.21.15.100:0/2859388680 learned_addr learned my addr 172.21.15.100:0/2859388680 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:56.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.163+0000 7fa7cde00640 1 --2- 172.21.15.100:0/2859388680 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa7d0155a20 0x7fa7d00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.163+0000 7fa7c5400640 1 --2- 172.21.15.100:0/2859388680 >> v2:172.21.15.123:3300/0 conn(0x7fa7d0155df0 0x7fa7d00ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.163+0000 7fa7ce800640 1 -- 172.21.15.100:0/2859388680 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa7d0155a20 msgr2=0x7fa7d00adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:56.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.163+0000 7fa7ce800640 1 --2- 172.21.15.100:0/2859388680 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa7d0155a20 0x7fa7d00adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.163+0000 7fa7ce800640 1 -- 172.21.15.100:0/2859388680 >> v2:172.21.15.123:3300/0 conn(0x7fa7d0155df0 msgr2=0x7fa7d00ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:56.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.163+0000 7fa7ce800640 1 --2- 172.21.15.100:0/2859388680 >> v2:172.21.15.123:3300/0 conn(0x7fa7d0155df0 0x7fa7d00ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.163+0000 7fa7ce800640 1 -- 172.21.15.100:0/2859388680 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d006e5e0 con 0x7fa7d006d7f0 2024-08-17T02:48:56.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.163+0000 7fa7cde00640 1 --2- 172.21.15.100:0/2859388680 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa7d0155a20 0x7fa7d00adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:48:56.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.163+0000 7fa7c5400640 1 --2- 172.21.15.100:0/2859388680 >> v2:172.21.15.123:3300/0 conn(0x7fa7d0155df0 0x7fa7d00ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:48:56.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.164+0000 7fa7ce800640 1 --2- 172.21.15.100:0/2859388680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d006d7f0 0x7fa7d006dc90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa7d006c4d0 tx=0x7fa7c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0c849e6f7ee178 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:56.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.165+0000 7fa7cd400640 1 -- 172.21.15.100:0/2859388680 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8031400 con 0x7fa7d006d7f0 2024-08-17T02:48:56.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.165+0000 7fa7cd400640 1 -- 172.21.15.100:0/2859388680 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c802d050 con 0x7fa7d006d7f0 2024-08-17T02:48:56.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.165+0000 7fa7cd400640 1 -- 172.21.15.100:0/2859388680 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80317d0 con 0x7fa7d006d7f0 2024-08-17T02:48:56.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.165+0000 7fa7d5200640 1 -- 172.21.15.100:0/2859388680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d006d7f0 msgr2=0x7fa7d006dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:56.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.165+0000 7fa7d5200640 1 --2- 172.21.15.100:0/2859388680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d006d7f0 0x7fa7d006dc90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa7d006c4d0 tx=0x7fa7c8009840 comp rx=0 tx=0).stop 2024-08-17T02:48:56.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.165+0000 7fa7d5200640 1 -- 172.21.15.100:0/2859388680 shutdown_connections 2024-08-17T02:48:56.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.165+0000 7fa7d5200640 1 --2- 172.21.15.100:0/2859388680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d006d7f0 0x7fa7d006dc90 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.165+0000 7fa7d5200640 1 --2- 172.21.15.100:0/2859388680 >> v2:172.21.15.123:3300/0 conn(0x7fa7d0155df0 0x7fa7d00ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.165+0000 7fa7d5200640 1 --2- 172.21.15.100:0/2859388680 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa7d0155a20 0x7fa7d00adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.165+0000 7fa7d5200640 1 -- 172.21.15.100:0/2859388680 >> 172.21.15.100:0/2859388680 conn(0x7fa7d00cb9b0 msgr2=0x7fa7d00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:56.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.165+0000 7fa7d5200640 1 -- 172.21.15.100:0/2859388680 shutdown_connections 2024-08-17T02:48:56.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.165+0000 7fa7d5200640 1 -- 172.21.15.100:0/2859388680 wait complete. 2024-08-17T02:48:56.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.167+0000 7fa7d5200640 1 Processor -- start 2024-08-17T02:48:56.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.167+0000 7fa7d5200640 1 -- start start 2024-08-17T02:48:56.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.168+0000 7fa7d5200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa7d006d7f0 0x7fa7d006a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.168+0000 7fa7d5200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d0155a20 0x7fa7d0169990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.168+0000 7fa7d5200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d0155df0 0x7fa7d013e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.168+0000 7fa7d5200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d0169ed0 con 0x7fa7d0155df0 2024-08-17T02:48:56.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.168+0000 7fa7d5200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00692f0 con 0x7fa7d0155a20 2024-08-17T02:48:56.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.168+0000 7fa7d5200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00695d0 con 0x7fa7d006d7f0 2024-08-17T02:48:56.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.168+0000 7fa7ce800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d0155df0 0x7fa7d013e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.168+0000 7fa7ce800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d0155df0 0x7fa7d013e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38326/0 (socket says 172.21.15.100:38326) 2024-08-17T02:48:56.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.168+0000 7fa7ce800640 1 -- 172.21.15.100:0/3736021552 learned_addr learned my addr 172.21.15.100:0/3736021552 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:56.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.168+0000 7fa7cde00640 1 --2- 172.21.15.100:0/3736021552 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa7d006d7f0 0x7fa7d006a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.168+0000 7fa7c5400640 1 --2- 172.21.15.100:0/3736021552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d0155a20 0x7fa7d0169990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.169+0000 7fa7ce800640 1 -- 172.21.15.100:0/3736021552 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa7d006d7f0 msgr2=0x7fa7d006a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:56.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.169+0000 7fa7ce800640 1 --2- 172.21.15.100:0/3736021552 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa7d006d7f0 0x7fa7d006a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.169+0000 7fa7ce800640 1 -- 172.21.15.100:0/3736021552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d0155a20 msgr2=0x7fa7d0169990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:56.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.169+0000 7fa7ce800640 1 --2- 172.21.15.100:0/3736021552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d0155a20 0x7fa7d0169990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.169+0000 7fa7ce800640 1 -- 172.21.15.100:0/3736021552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c8009ae0 con 0x7fa7d0155df0 2024-08-17T02:48:56.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.169+0000 7fa7ce800640 1 --2- 172.21.15.100:0/3736021552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d0155df0 0x7fa7d013e350 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa7c802acc0 tx=0x7fa7c8036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:56.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.169+0000 7fa7c6000640 1 -- 172.21.15.100:0/3736021552 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8007170 con 0x7fa7d0155df0 2024-08-17T02:48:56.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.169+0000 7fa7c6000640 1 -- 172.21.15.100:0/3736021552 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c8008e50 con 0x7fa7d0155df0 2024-08-17T02:48:56.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.169+0000 7fa7d5200640 1 -- 172.21.15.100:0/3736021552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d00698b0 con 0x7fa7d0155df0 2024-08-17T02:48:56.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.169+0000 7fa7c6000640 1 -- 172.21.15.100:0/3736021552 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c803b640 con 0x7fa7d0155df0 2024-08-17T02:48:56.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.169+0000 7fa7d5200640 1 -- 172.21.15.100:0/3736021552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d0069e70 con 0x7fa7d0155df0 2024-08-17T02:48:56.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.170+0000 7fa7d5200640 1 -- 172.21.15.100:0/3736021552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d0064db0 con 0x7fa7d0155df0 2024-08-17T02:48:56.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.171+0000 7fa7c6000640 1 -- 172.21.15.100:0/3736021552 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa7c8038050 con 0x7fa7d0155df0 2024-08-17T02:48:56.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.172+0000 7fa7c6000640 1 --2- 172.21.15.100:0/3736021552 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa7ac065150 0x7fa7ac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.173+0000 7fa7c6000640 1 -- 172.21.15.100:0/3736021552 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fa7c80a2980 con 0x7fa7d0155df0 2024-08-17T02:48:56.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.173+0000 7fa7cde00640 1 --2- 172.21.15.100:0/3736021552 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa7ac065150 0x7fa7ac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.173+0000 7fa7cde00640 1 --2- 172.21.15.100:0/3736021552 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa7ac065150 0x7fa7ac067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa7d014a410 tx=0x7fa7c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:56.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.177+0000 7fa7c6000640 1 -- 172.21.15.100:0/3736021552 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa7c8070a50 con 0x7fa7d0155df0 2024-08-17T02:48:56.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.388+0000 7fa7d5200640 1 -- 172.21.15.100:0/3736021552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7d01547d0 con 0x7fa7d0155df0 2024-08-17T02:48:56.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.388+0000 7fa7c6000640 1 -- 172.21.15.100:0/3736021552 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4627 (secure 0 0 0) 0x7fa7c8074070 con 0x7fa7d0155df0 2024-08-17T02:48:56.389 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:48:56.389 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1972998642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1972998642},{"type":"v1","addr":"172.21.15.100:6836","nonce":1972998642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3961484077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3961484077},{"type":"v1","addr":"172.21.15.100:6837","nonce":3961484077}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5173,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1672641445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":1672641445},{"type":"v1","addr":"172.21.15.123:6835","nonce":1672641445}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:42.789210+0000","modified":"2024-08-17T02:46:44.792554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4885},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4885":{"gid":4885,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.123:6834/1763367135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1763367135},{"type":"v1","addr":"172.21.15.123:6834","nonce":1763367135}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001028572","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:48:56.389 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 22 2024-08-17T02:48:56.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.390+0000 7fa7d5200640 1 -- 172.21.15.100:0/3736021552 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa7ac065150 msgr2=0x7fa7ac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:56.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.390+0000 7fa7d5200640 1 --2- 172.21.15.100:0/3736021552 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa7ac065150 0x7fa7ac067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa7d014a410 tx=0x7fa7c0008040 comp rx=0 tx=0).stop 2024-08-17T02:48:56.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.390+0000 7fa7d5200640 1 -- 172.21.15.100:0/3736021552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d0155df0 msgr2=0x7fa7d013e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:56.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.390+0000 7fa7d5200640 1 --2- 172.21.15.100:0/3736021552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d0155df0 0x7fa7d013e350 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa7c802acc0 tx=0x7fa7c8036000 comp rx=0 tx=0).stop 2024-08-17T02:48:56.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.390+0000 7fa7d5200640 1 -- 172.21.15.100:0/3736021552 shutdown_connections 2024-08-17T02:48:56.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.391+0000 7fa7d5200640 1 --2- 172.21.15.100:0/3736021552 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa7ac065150 0x7fa7ac067600 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.391+0000 7fa7d5200640 1 --2- 172.21.15.100:0/3736021552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d0155df0 0x7fa7d013e350 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.391+0000 7fa7d5200640 1 --2- 172.21.15.100:0/3736021552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d0155a20 0x7fa7d0169990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.391+0000 7fa7d5200640 1 --2- 172.21.15.100:0/3736021552 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa7d006d7f0 0x7fa7d006a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.391+0000 7fa7d5200640 1 -- 172.21.15.100:0/3736021552 >> 172.21.15.100:0/3736021552 conn(0x7fa7d00cb9b0 msgr2=0x7fa7d00cb140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:56.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.391+0000 7fa7d5200640 1 -- 172.21.15.100:0/3736021552 shutdown_connections 2024-08-17T02:48:56.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.391+0000 7fa7d5200640 1 -- 172.21.15.100:0/3736021552 wait complete. 2024-08-17T02:48:56.407 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:48:56.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.553+0000 7f0d09a00640 1 Processor -- start 2024-08-17T02:48:56.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.554+0000 7f0d09a00640 1 -- start start 2024-08-17T02:48:56.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.555+0000 7f0d09a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0d04155900 0x7f0d04155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.555+0000 7f0d09a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0d040b0270 0x7f0d04156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.555+0000 7f0d09a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d04157690 con 0x7f0d04157b20 2024-08-17T02:48:56.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.555+0000 7f0d09a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d04156a80 con 0x7f0d04155900 2024-08-17T02:48:56.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.555+0000 7f0d09a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d04156d60 con 0x7f0d040b0270 2024-08-17T02:48:56.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.555+0000 7f0cfb400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0d040b0270 0x7f0d04156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.555+0000 7f0d03e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0d04155900 0x7f0d04155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.555+0000 7f0cfb400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0d040b0270 0x7f0d04156210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.100:37048/0 (socket says 172.21.15.100:37048) 2024-08-17T02:48:56.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.556+0000 7f0cfb400640 1 -- 172.21.15.100:0/3912107351 learned_addr learned my addr 172.21.15.100:0/3912107351 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:56.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.556+0000 7f0d09000640 1 --1- 172.21.15.100:0/3912107351 >> v1:172.21.15.123:6789/0 conn(0x7f0d04157b20 0x7f0d04157fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.100:36054/0 (socket says 172.21.15.100:36054) 2024-08-17T02:48:56.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.556+0000 7f0cfb400640 1 -- 172.21.15.100:0/3912107351 >> v2:172.21.15.123:3300/0 conn(0x7f0d04155900 msgr2=0x7f0d04155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:56.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.556+0000 7f0cfb400640 1 --2- 172.21.15.100:0/3912107351 >> v2:172.21.15.123:3300/0 conn(0x7f0d04155900 0x7f0d04155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.556+0000 7f0cfb400640 1 -- 172.21.15.100:0/3912107351 >> v1:172.21.15.123:6789/0 conn(0x7f0d04157b20 legacy=0x7f0d04157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:56.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.556+0000 7f0cfb400640 1 -- 172.21.15.100:0/3912107351 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d04157040 con 0x7f0d040b0270 2024-08-17T02:48:56.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.556+0000 7f0d03e00640 1 --2- 172.21.15.100:0/3912107351 >> v2:172.21.15.123:3300/0 conn(0x7f0d04155900 0x7f0d04155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:48:56.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.557+0000 7f0cfb400640 1 --2- 172.21.15.100:0/3912107351 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0d040b0270 0x7f0d04156210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009910 tx=0x7f0cec0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44d422c3f31da5db server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:56.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.557+0000 7f0d03400640 1 -- 172.21.15.100:0/3912107351 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec02adb0 con 0x7f0d040b0270 2024-08-17T02:48:56.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.557+0000 7f0d03400640 1 -- 172.21.15.100:0/3912107351 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec032440 con 0x7f0d040b0270 2024-08-17T02:48:56.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.557+0000 7f0d03400640 1 -- 172.21.15.100:0/3912107351 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec032820 con 0x7f0d040b0270 2024-08-17T02:48:56.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.558+0000 7f0d09a00640 1 -- 172.21.15.100:0/3912107351 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0d040b0270 msgr2=0x7f0d04156210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:56.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.558+0000 7f0d09a00640 1 --2- 172.21.15.100:0/3912107351 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0d040b0270 0x7f0d04156210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009910 tx=0x7f0cec0091d0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.558+0000 7f0d09a00640 1 -- 172.21.15.100:0/3912107351 shutdown_connections 2024-08-17T02:48:56.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.558+0000 7f0d09a00640 1 --2- 172.21.15.100:0/3912107351 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0d040b0270 0x7f0d04156210 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.558+0000 7f0d09a00640 1 --2- 172.21.15.100:0/3912107351 >> v2:172.21.15.123:3300/0 conn(0x7f0d04155900 0x7f0d04155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.558+0000 7f0d09a00640 1 -- 172.21.15.100:0/3912107351 >> 172.21.15.100:0/3912107351 conn(0x7f0d04067750 msgr2=0x7f0d040cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:56.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.558+0000 7f0d09a00640 1 -- 172.21.15.100:0/3912107351 shutdown_connections 2024-08-17T02:48:56.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.558+0000 7f0d09a00640 1 -- 172.21.15.100:0/3912107351 wait complete. 2024-08-17T02:48:56.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.559+0000 7f0d09a00640 1 Processor -- start 2024-08-17T02:48:56.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.559+0000 7f0d09a00640 1 -- start start 2024-08-17T02:48:56.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.560+0000 7f0d09a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d040b0270 0x7f0d0416a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.560+0000 7f0d09a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0d04155900 0x7f0d0406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.560+0000 7f0d09a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d04157b20 0x7f0d0406dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.560+0000 7f0d09a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d040c6540 con 0x7f0d04157b20 2024-08-17T02:48:56.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.560+0000 7f0d09a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d040c5c30 con 0x7f0d040b0270 2024-08-17T02:48:56.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.560+0000 7f0d09a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d040a6450 con 0x7f0d04155900 2024-08-17T02:48:56.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.561+0000 7f0d09000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d04157b20 0x7f0d0406dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.561+0000 7f0d09000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d04157b20 0x7f0d0406dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38342/0 (socket says 172.21.15.100:38342) 2024-08-17T02:48:56.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.561+0000 7f0d09000640 1 -- 172.21.15.100:0/267739003 learned_addr learned my addr 172.21.15.100:0/267739003 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:56.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.561+0000 7f0d03e00640 1 --2- 172.21.15.100:0/267739003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d040b0270 0x7f0d0416a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.561+0000 7f0cfb400640 1 --2- 172.21.15.100:0/267739003 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0d04155900 0x7f0d0406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.561+0000 7f0d09000640 1 -- 172.21.15.100:0/267739003 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0d04155900 msgr2=0x7f0d0406da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:56.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.561+0000 7f0d09000640 1 --2- 172.21.15.100:0/267739003 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0d04155900 0x7f0d0406da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.561+0000 7f0d09000640 1 -- 172.21.15.100:0/267739003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d040b0270 msgr2=0x7f0d0416a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:56.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.561+0000 7f0d09000640 1 --2- 172.21.15.100:0/267739003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d040b0270 0x7f0d0416a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.561+0000 7f0d09000640 1 -- 172.21.15.100:0/267739003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf4009390 con 0x7f0d04157b20 2024-08-17T02:48:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.561+0000 7f0d09000640 1 --2- 172.21.15.100:0/267739003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d04157b20 0x7f0d0406dfa0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00c840 tx=0x7f0cfc0015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.562+0000 7f0cfbe00640 1 -- 172.21.15.100:0/267739003 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc00ce30 con 0x7f0d04157b20 2024-08-17T02:48:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.562+0000 7f0cfbe00640 1 -- 172.21.15.100:0/267739003 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cfc005d60 con 0x7f0d04157b20 2024-08-17T02:48:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.562+0000 7f0cfbe00640 1 -- 172.21.15.100:0/267739003 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc00a810 con 0x7f0d04157b20 2024-08-17T02:48:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.562+0000 7f0d09a00640 1 -- 172.21.15.100:0/267739003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cec009450 con 0x7f0d04157b20 2024-08-17T02:48:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.562+0000 7f0d09a00640 1 -- 172.21.15.100:0/267739003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d040c61d0 con 0x7f0d04157b20 2024-08-17T02:48:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.563+0000 7f0d09a00640 1 -- 172.21.15.100:0/267739003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d04071050 con 0x7f0d04157b20 2024-08-17T02:48:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.564+0000 7f0cfbe00640 1 -- 172.21.15.100:0/267739003 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0cfc00ac40 con 0x7f0d04157b20 2024-08-17T02:48:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.564+0000 7f0cfbe00640 1 --2- 172.21.15.100:0/267739003 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0ce0065150 0x7f0ce0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.565+0000 7f0cfbe00640 1 -- 172.21.15.100:0/267739003 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f0cfc082000 con 0x7f0d04157b20 2024-08-17T02:48:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.565+0000 7f0d03e00640 1 --2- 172.21.15.100:0/267739003 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0ce0065150 0x7f0ce0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.565+0000 7f0d03e00640 1 --2- 172.21.15.100:0/267739003 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0ce0065150 0x7f0ce0067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0d040a5d80 tx=0x7f0cf40090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:56.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.568+0000 7f0cfbe00640 1 -- 172.21.15.100:0/267739003 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0cfc050170 con 0x7f0d04157b20 2024-08-17T02:48:56.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.739+0000 7f0d09a00640 1 -- 172.21.15.100:0/267739003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d040c6680 con 0x7f0d04157b20 2024-08-17T02:48:56.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.740+0000 7f0cfbe00640 1 -- 172.21.15.100:0/267739003 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+15562 (secure 0 0 0) 0x7f0cfc053790 con 0x7f0d04157b20 2024-08-17T02:48:56.741 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:48:56.741 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":41,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:48:53.419744+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000001028572.meta","create_time":"2024-08-17T02:46:40.913393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001028572"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001028572.data","create_time":"2024-08-17T02:46:41.819233+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001028572"}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6835/1541092259":"2024-08-18T02:48:50.211886+0000","172.21.15.123:6833/1541092259":"2024-08-18T02:48:50.211886+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:48:56.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.742+0000 7f0d09a00640 1 -- 172.21.15.100:0/267739003 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0ce0065150 msgr2=0x7f0ce0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:56.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.742+0000 7f0d09a00640 1 --2- 172.21.15.100:0/267739003 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0ce0065150 0x7f0ce0067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0d040a5d80 tx=0x7f0cf40090f0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.742+0000 7f0d09a00640 1 -- 172.21.15.100:0/267739003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d04157b20 msgr2=0x7f0d0406dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:56.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.742+0000 7f0d09a00640 1 --2- 172.21.15.100:0/267739003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d04157b20 0x7f0d0406dfa0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00c840 tx=0x7f0cfc0015f0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.742+0000 7f0d09a00640 1 -- 172.21.15.100:0/267739003 shutdown_connections 2024-08-17T02:48:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.742+0000 7f0d09a00640 1 --2- 172.21.15.100:0/267739003 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f0ce0065150 0x7f0ce0067600 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.742+0000 7f0d09a00640 1 --2- 172.21.15.100:0/267739003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d04157b20 0x7f0d0406dfa0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.742+0000 7f0d09a00640 1 --2- 172.21.15.100:0/267739003 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0d04155900 0x7f0d0406da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.742+0000 7f0d09a00640 1 --2- 172.21.15.100:0/267739003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d040b0270 0x7f0d0416a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.742+0000 7f0d09a00640 1 -- 172.21.15.100:0/267739003 >> 172.21.15.100:0/267739003 conn(0x7f0d04067750 msgr2=0x7f0d04153560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.743+0000 7f0d09a00640 1 -- 172.21.15.100:0/267739003 shutdown_connections 2024-08-17T02:48:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.743+0000 7f0d09a00640 1 -- 172.21.15.100:0/267739003 wait complete. 2024-08-17T02:48:56.758 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000001028572 2024-08-17T02:48:56.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.906+0000 7f3f4fe00640 1 Processor -- start 2024-08-17T02:48:56.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.906+0000 7f3f4fe00640 1 -- start start 2024-08-17T02:48:56.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.907+0000 7f3f4fe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3f50156ad0 0x7f3f500cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.907+0000 7f3f4fe00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f500caaf0 con 0x7f3f5006dc80 2024-08-17T02:48:56.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.907+0000 7f3f4fe00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f50157300 con 0x7f3f50156ea0 2024-08-17T02:48:56.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.907+0000 7f3f4fe00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f500ca900 con 0x7f3f50156ad0 2024-08-17T02:48:56.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.907+0000 7f3f4f400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3f5006dc80 0x7f3f501577f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38204/0 (socket says 172.21.15.100:38204) 2024-08-17T02:48:56.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.907+0000 7f3f4f400640 1 -- 172.21.15.100:0/1510212584 learned_addr learned my addr 172.21.15.100:0/1510212584 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:48:56.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.908+0000 7f3f4ea00640 1 --2- 172.21.15.100:0/1510212584 >> v2:172.21.15.123:3300/0 conn(0x7f3f50156ad0 0x7f3f500cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.908+0000 7f3f4e000640 1 -- 172.21.15.100:0/1510212584 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224177365 0 0) 0x7f3f500caaf0 con 0x7f3f5006dc80 2024-08-17T02:48:56.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.908+0000 7f3f4e000640 1 -- 172.21.15.100:0/1510212584 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f340034e0 con 0x7f3f5006dc80 2024-08-17T02:48:56.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.908+0000 7f3f4e000640 1 -- 172.21.15.100:0/1510212584 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3085381874 0 0) 0x7f3f340034e0 con 0x7f3f5006dc80 2024-08-17T02:48:56.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.908+0000 7f3f4e000640 1 -- 172.21.15.100:0/1510212584 >> v2:172.21.15.123:3300/0 conn(0x7f3f50156ad0 msgr2=0x7f3f500cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:56.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.908+0000 7f3f4e000640 1 --2- 172.21.15.100:0/1510212584 >> v2:172.21.15.123:3300/0 conn(0x7f3f50156ad0 0x7f3f500cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.908+0000 7f3f4e000640 1 -- 172.21.15.100:0/1510212584 >> v1:172.21.15.123:6789/0 conn(0x7f3f50156ea0 legacy=0x7f3f5006d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:56.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.908+0000 7f3f4e000640 1 -- 172.21.15.100:0/1510212584 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f500cad90 con 0x7f3f5006dc80 2024-08-17T02:48:56.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.908+0000 7f3f4e000640 1 -- 172.21.15.100:0/1510212584 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1817143124 0 0) 0x7f3f480017f0 con 0x7f3f5006dc80 2024-08-17T02:48:56.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.908+0000 7f3f4e000640 1 -- 172.21.15.100:0/1510212584 >> v1:172.21.15.100:6789/0 conn(0x7f3f5006dc80 legacy=0x7f3f501577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:56.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.908+0000 7f3f4e000640 1 --2- 172.21.15.100:0/1510212584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f340039d0 0x7f3f34003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.908+0000 7f3f4e000640 1 --2- 172.21.15.100:0/1510212584 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f34004780 0x7f3f34004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.908+0000 7f3f4e000640 1 --2- 172.21.15.100:0/1510212584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f34005130 0x7f3f3400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.908+0000 7f3f4e000640 1 -- 172.21.15.100:0/1510212584 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3400c010 con 0x7f3f340039d0 2024-08-17T02:48:56.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.908+0000 7f3f4e000640 1 -- 172.21.15.100:0/1510212584 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3400c180 con 0x7f3f34005130 2024-08-17T02:48:56.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.908+0000 7f3f4e000640 1 -- 172.21.15.100:0/1510212584 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3400c340 con 0x7f3f34004780 2024-08-17T02:48:56.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.909+0000 7f3f4ea00640 1 --2- 172.21.15.100:0/1510212584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f340039d0 0x7f3f34003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.909+0000 7f3f46000640 1 --2- 172.21.15.100:0/1510212584 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f34004780 0x7f3f34004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.909+0000 7f3f4f400640 1 --2- 172.21.15.100:0/1510212584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f34005130 0x7f3f3400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.909+0000 7f3f4ea00640 1 -- 172.21.15.100:0/1510212584 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f34004780 msgr2=0x7f3f34004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:56.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.909+0000 7f3f4ea00640 1 --2- 172.21.15.100:0/1510212584 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f34004780 0x7f3f34004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.909+0000 7f3f4ea00640 1 -- 172.21.15.100:0/1510212584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f34005130 msgr2=0x7f3f3400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:56.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.909+0000 7f3f4ea00640 1 --2- 172.21.15.100:0/1510212584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f34005130 0x7f3f3400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.909+0000 7f3f4ea00640 1 -- 172.21.15.100:0/1510212584 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f340034e0 con 0x7f3f340039d0 2024-08-17T02:48:56.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.909+0000 7f3f4f400640 1 -- 172.21.15.100:0/1510212584 reap_dead start 2024-08-17T02:48:56.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.910+0000 7f3f4ea00640 1 --2- 172.21.15.100:0/1510212584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f340039d0 0x7f3f34003de0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009b70 tx=0x7f3f400090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25cbd9723d32db05 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:56.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.910+0000 7f3f4e000640 1 -- 172.21.15.100:0/1510212584 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40031400 con 0x7f3f340039d0 2024-08-17T02:48:56.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.910+0000 7f3f4e000640 1 -- 172.21.15.100:0/1510212584 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4002d050 con 0x7f3f340039d0 2024-08-17T02:48:56.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.910+0000 7f3f4e000640 1 -- 172.21.15.100:0/1510212584 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40031790 con 0x7f3f340039d0 2024-08-17T02:48:56.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.911+0000 7f3f4fe00640 1 -- 172.21.15.100:0/1510212584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f340039d0 msgr2=0x7f3f34003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:56.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.911+0000 7f3f4fe00640 1 --2- 172.21.15.100:0/1510212584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f340039d0 0x7f3f34003de0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009b70 tx=0x7f3f400090f0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.911+0000 7f3f4fe00640 1 -- 172.21.15.100:0/1510212584 shutdown_connections 2024-08-17T02:48:56.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.911+0000 7f3f4fe00640 1 --2- 172.21.15.100:0/1510212584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f340039d0 0x7f3f34003de0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.911+0000 7f3f4fe00640 1 -- 172.21.15.100:0/1510212584 >> 172.21.15.100:0/1510212584 conn(0x7f3f50067750 msgr2=0x7f3f500cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:56.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.911+0000 7f3f4fe00640 1 -- 172.21.15.100:0/1510212584 shutdown_connections 2024-08-17T02:48:56.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.911+0000 7f3f4fe00640 1 -- 172.21.15.100:0/1510212584 wait complete. 2024-08-17T02:48:56.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.912+0000 7f3f4fe00640 1 Processor -- start 2024-08-17T02:48:56.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.912+0000 7f3f4fe00640 1 -- start start 2024-08-17T02:48:56.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.913+0000 7f3f4fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f340039d0 0x7f3f5014c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.913+0000 7f3f4fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f50150640 0x7f3f500afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.913+0000 7f3f4fe00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f50150ab0 0x7f3f5014e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.913+0000 7f3f4fe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500ae8d0 con 0x7f3f340039d0 2024-08-17T02:48:56.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.913+0000 7f3f4fe00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500aeae0 con 0x7f3f50150640 2024-08-17T02:48:56.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.913+0000 7f3f4fe00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500aedc0 con 0x7f3f50150ab0 2024-08-17T02:48:56.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.913+0000 7f3f4ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f340039d0 0x7f3f5014c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.913+0000 7f3f4ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f340039d0 0x7f3f5014c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37890/0 (socket says 172.21.15.100:37890) 2024-08-17T02:48:56.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.913+0000 7f3f4ea00640 1 -- 172.21.15.100:0/3302484475 learned_addr learned my addr 172.21.15.100:0/3302484475 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:56.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.914+0000 7f3f46000640 1 --2- 172.21.15.100:0/3302484475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f50150640 0x7f3f500afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.914+0000 7f3f4f400640 1 --2- 172.21.15.100:0/3302484475 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f50150ab0 0x7f3f5014e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.914+0000 7f3f4ea00640 1 -- 172.21.15.100:0/3302484475 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f50150ab0 msgr2=0x7f3f5014e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:56.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.914+0000 7f3f4ea00640 1 --2- 172.21.15.100:0/3302484475 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f50150ab0 0x7f3f5014e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.914+0000 7f3f4ea00640 1 -- 172.21.15.100:0/3302484475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f50150640 msgr2=0x7f3f500afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:56.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.914+0000 7f3f4ea00640 1 --2- 172.21.15.100:0/3302484475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f50150640 0x7f3f500afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:56.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.914+0000 7f3f4ea00640 1 -- 172.21.15.100:0/3302484475 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f500af0a0 con 0x7f3f340039d0 2024-08-17T02:48:56.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.914+0000 7f3f4f400640 1 --2- 172.21.15.100:0/3302484475 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f50150ab0 0x7f3f5014e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:48:56.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.914+0000 7f3f4ea00640 1 --2- 172.21.15.100:0/3302484475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f340039d0 0x7f3f5014c000 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009b70 tx=0x7f3f40035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:56.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.914+0000 7f3f46a00640 1 -- 172.21.15.100:0/3302484475 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40030850 con 0x7f3f340039d0 2024-08-17T02:48:56.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.914+0000 7f3f46a00640 1 -- 172.21.15.100:0/3302484475 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f400309b0 con 0x7f3f340039d0 2024-08-17T02:48:56.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.914+0000 7f3f46a00640 1 -- 172.21.15.100:0/3302484475 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40030d70 con 0x7f3f340039d0 2024-08-17T02:48:56.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.914+0000 7f3f4fe00640 1 -- 172.21.15.100:0/3302484475 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f500af380 con 0x7f3f340039d0 2024-08-17T02:48:56.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.915+0000 7f3f4fe00640 1 -- 172.21.15.100:0/3302484475 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5014c540 con 0x7f3f340039d0 2024-08-17T02:48:56.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.915+0000 7f3f4fe00640 1 -- 172.21.15.100:0/3302484475 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f50071050 con 0x7f3f340039d0 2024-08-17T02:48:56.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.916+0000 7f3f46a00640 1 -- 172.21.15.100:0/3302484475 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3f40045620 con 0x7f3f340039d0 2024-08-17T02:48:56.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.917+0000 7f3f46a00640 1 --2- 172.21.15.100:0/3302484475 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3f2c065150 0x7f3f2c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:56.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.917+0000 7f3f46a00640 1 -- 172.21.15.100:0/3302484475 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f3f400a3610 con 0x7f3f340039d0 2024-08-17T02:48:56.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.917+0000 7f3f46000640 1 --2- 172.21.15.100:0/3302484475 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3f2c065150 0x7f3f2c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:56.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.918+0000 7f3f46000640 1 --2- 172.21.15.100:0/3302484475 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3f2c065150 0x7f3f2c067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800e440 tx=0x7f3f38007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:56.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:56.921+0000 7f3f46a00640 1 -- 172.21.15.100:0/3302484475 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3f400715b0 con 0x7f3f340039d0 2024-08-17T02:48:57.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.134+0000 7f3f4fe00640 1 -- 172.21.15.100:0/3302484475 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000001028572"} v 0) v1 -- 0x7f3f5006f480 con 0x7f3f340039d0 2024-08-17T02:48:57.135 INFO:tasks.ceph.mon.a.smithi100.stderr:2024-08-17T02:48:57.135+0000 7f3a9f600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:48:57.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.141+0000 7f3f46a00640 1 -- 172.21.15.100:0/3302484475 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000001028572"}]=0 volume_0000000001028572 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 195+0+0 (secure 0 0 0) 0x7f3f40074bd0 con 0x7f3f340039d0 2024-08-17T02:48:57.142 INFO:teuthology.orchestra.run.smithi100.stderr:volume_0000000001028572 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:48:57.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.144+0000 7f3f4fe00640 1 -- 172.21.15.100:0/3302484475 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3f2c065150 msgr2=0x7f3f2c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.144+0000 7f3f4fe00640 1 --2- 172.21.15.100:0/3302484475 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3f2c065150 0x7f3f2c067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800e440 tx=0x7f3f38007d30 comp rx=0 tx=0).stop 2024-08-17T02:48:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.144+0000 7f3f4fe00640 1 -- 172.21.15.100:0/3302484475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f340039d0 msgr2=0x7f3f5014c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.144+0000 7f3f4fe00640 1 --2- 172.21.15.100:0/3302484475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f340039d0 0x7f3f5014c000 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009b70 tx=0x7f3f40035000 comp rx=0 tx=0).stop 2024-08-17T02:48:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.144+0000 7f3f4fe00640 1 -- 172.21.15.100:0/3302484475 shutdown_connections 2024-08-17T02:48:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.144+0000 7f3f4fe00640 1 --2- 172.21.15.100:0/3302484475 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3f2c065150 0x7f3f2c067600 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.144+0000 7f3f4fe00640 1 --2- 172.21.15.100:0/3302484475 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3f50150ab0 0x7f3f5014e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.144+0000 7f3f4fe00640 1 --2- 172.21.15.100:0/3302484475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f50150640 0x7f3f500afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.144+0000 7f3f4fe00640 1 --2- 172.21.15.100:0/3302484475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f340039d0 0x7f3f5014c000 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.144+0000 7f3f4fe00640 1 -- 172.21.15.100:0/3302484475 >> 172.21.15.100:0/3302484475 conn(0x7f3f50067750 msgr2=0x7f3f50154760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.144+0000 7f3f4fe00640 1 -- 172.21.15.100:0/3302484475 shutdown_connections 2024-08-17T02:48:57.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.144+0000 7f3f4fe00640 1 -- 172.21.15.100:0/3302484475 wait complete. 2024-08-17T02:48:57.148 INFO:tasks.ceph.mds.d.smithi123.stderr: -3082> 2024-08-17T02:46:49.687+0000 7f2926000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:48:57.159 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000001028572 --yes-i-really-mean-it 2024-08-17T02:48:57.189 INFO:tasks.ceph.mds.d.smithi123.stdout:starting mds.d at 2024-08-17T02:48:57.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.308+0000 7f3267e00640 1 Processor -- start 2024-08-17T02:48:57.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.309+0000 7f3267e00640 1 -- start start 2024-08-17T02:48:57.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.310+0000 7f3267e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f32600af580 0x7f32600af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:57.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.310+0000 7f3267e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32600aff20 con 0x7f3260155980 2024-08-17T02:48:57.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.310+0000 7f3267e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3260158400 con 0x7f32600a54d0 2024-08-17T02:48:57.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.310+0000 7f3267e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32601577f0 con 0x7f32600af580 2024-08-17T02:48:57.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.310+0000 7f3265e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f32600af580 0x7f32600af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:57.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.310+0000 7f3265400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3260155980 0x7f3260156f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38212/0 (socket says 172.21.15.100:38212) 2024-08-17T02:48:57.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.310+0000 7f3265400640 1 -- 172.21.15.100:0/1434321072 learned_addr learned my addr 172.21.15.100:0/1434321072 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:48:57.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.310+0000 7f3265e00640 1 -- 172.21.15.100:0/1434321072 >> v1:172.21.15.123:6789/0 conn(0x7f32600a54d0 legacy=0x7f3260155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:57.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.311+0000 7f3265e00640 1 -- 172.21.15.100:0/1434321072 >> v1:172.21.15.100:6789/0 conn(0x7f3260155980 legacy=0x7f3260156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:57.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.311+0000 7f3265e00640 1 -- 172.21.15.100:0/1434321072 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3260157ad0 con 0x7f32600af580 2024-08-17T02:48:57.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.311+0000 7f325fe00640 1 -- 172.21.15.100:0/1434321072 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164749394 0 0) 0x7f3260158400 con 0x7f32600a54d0 2024-08-17T02:48:57.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.311+0000 7f3265e00640 1 --2- 172.21.15.100:0/1434321072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32600af580 0x7f32600af9e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3258009e60 tx=0x7f3258009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4321b07125081f1f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:57.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.312+0000 7f325fe00640 1 -- 172.21.15.100:0/1434321072 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258007550 con 0x7f32600af580 2024-08-17T02:48:57.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.312+0000 7f325fe00640 1 -- 172.21.15.100:0/1434321072 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325802d050 con 0x7f32600af580 2024-08-17T02:48:57.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.312+0000 7f325fe00640 1 -- 172.21.15.100:0/1434321072 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32580078e0 con 0x7f32600af580 2024-08-17T02:48:57.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.312+0000 7f3267e00640 1 -- 172.21.15.100:0/1434321072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32600af580 msgr2=0x7f32600af9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:57.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.312+0000 7f3267e00640 1 --2- 172.21.15.100:0/1434321072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32600af580 0x7f32600af9e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3258009e60 tx=0x7f3258009780 comp rx=0 tx=0).stop 2024-08-17T02:48:57.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.312+0000 7f3267e00640 1 -- 172.21.15.100:0/1434321072 shutdown_connections 2024-08-17T02:48:57.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.312+0000 7f3267e00640 1 --2- 172.21.15.100:0/1434321072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32600af580 0x7f32600af9e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:57.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.312+0000 7f3267e00640 1 -- 172.21.15.100:0/1434321072 >> 172.21.15.100:0/1434321072 conn(0x7f3260067750 msgr2=0x7f32600cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:57.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.312+0000 7f3267e00640 1 -- 172.21.15.100:0/1434321072 shutdown_connections 2024-08-17T02:48:57.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.312+0000 7f3267e00640 1 -- 172.21.15.100:0/1434321072 wait complete. 2024-08-17T02:48:57.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.314+0000 7f3267e00640 1 Processor -- start 2024-08-17T02:48:57.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.314+0000 7f3267e00640 1 -- start start 2024-08-17T02:48:57.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.315+0000 7f3267e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f32600a54d0 0x7f326014b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:57.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.315+0000 7f3267e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32600af580 0x7f326016c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:57.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.315+0000 7f3267e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260155980 0x7f32601509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:57.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.315+0000 7f3267e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326016cff0 con 0x7f3260155980 2024-08-17T02:48:57.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.315+0000 7f3267e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326016d2d0 con 0x7f32600af580 2024-08-17T02:48:57.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.315+0000 7f3267e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32600a9ed0 con 0x7f32600a54d0 2024-08-17T02:48:57.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.315+0000 7f3265e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260155980 0x7f32601509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:57.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.315+0000 7f3265e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260155980 0x7f32601509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37908/0 (socket says 172.21.15.100:37908) 2024-08-17T02:48:57.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.315+0000 7f3265e00640 1 -- 172.21.15.100:0/498973362 learned_addr learned my addr 172.21.15.100:0/498973362 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:57.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.315+0000 7f3264a00640 1 --2- 172.21.15.100:0/498973362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32600af580 0x7f326016c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:57.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.316+0000 7f3265400640 1 --2- 172.21.15.100:0/498973362 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f32600a54d0 0x7f326014b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:57.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.316+0000 7f3265e00640 1 -- 172.21.15.100:0/498973362 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f32600a54d0 msgr2=0x7f326014b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:57.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.316+0000 7f3265e00640 1 --2- 172.21.15.100:0/498973362 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f32600a54d0 0x7f326014b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:57.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.316+0000 7f3265e00640 1 -- 172.21.15.100:0/498973362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32600af580 msgr2=0x7f326016c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:57.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.316+0000 7f3265e00640 1 --2- 172.21.15.100:0/498973362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32600af580 0x7f326016c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:57.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.316+0000 7f3265e00640 1 -- 172.21.15.100:0/498973362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3258009a20 con 0x7f3260155980 2024-08-17T02:48:57.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.316+0000 7f3265e00640 1 --2- 172.21.15.100:0/498973362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260155980 0x7f32601509b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f32580099f0 tx=0x7f3258037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:57.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.316+0000 7f325cc00640 1 -- 172.21.15.100:0/498973362 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258007e50 con 0x7f3260155980 2024-08-17T02:48:57.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.316+0000 7f325cc00640 1 -- 172.21.15.100:0/498973362 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3258040070 con 0x7f3260155980 2024-08-17T02:48:57.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.316+0000 7f325cc00640 1 -- 172.21.15.100:0/498973362 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258031e80 con 0x7f3260155980 2024-08-17T02:48:57.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.316+0000 7f3267e00640 1 -- 172.21.15.100:0/498973362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32600aa1b0 con 0x7f3260155980 2024-08-17T02:48:57.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.317+0000 7f3267e00640 1 -- 172.21.15.100:0/498973362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f326014b930 con 0x7f3260155980 2024-08-17T02:48:57.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.318+0000 7f3267e00640 1 -- 172.21.15.100:0/498973362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32600a9d30 con 0x7f3260155980 2024-08-17T02:48:57.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.318+0000 7f325cc00640 1 -- 172.21.15.100:0/498973362 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3258042030 con 0x7f3260155980 2024-08-17T02:48:57.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.319+0000 7f325cc00640 1 --2- 172.21.15.100:0/498973362 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3240065150 0x7f3240067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:57.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.319+0000 7f325cc00640 1 -- 172.21.15.100:0/498973362 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f32580a3e80 con 0x7f3260155980 2024-08-17T02:48:57.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.319+0000 7f3265400640 1 --2- 172.21.15.100:0/498973362 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3240065150 0x7f3240067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:57.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.320+0000 7f3265400640 1 --2- 172.21.15.100:0/498973362 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3240065150 0x7f3240067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3254005840 tx=0x7f3254009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:57.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.323+0000 7f325cc00640 1 -- 172.21.15.100:0/498973362 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f32600a9d30 con 0x7f3260155980 2024-08-17T02:48:57.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:57.533+0000 7f3267e00640 1 -- 172.21.15.100:0/498973362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000001028572", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f32600a9d30 con 0x7f3260155980 2024-08-17T02:48:58.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.146+0000 7f325cc00640 1 -- 172.21.15.100:0/498973362 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000001028572", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 121+0+0 (secure 0 0 0) 0x7f32600a9d30 con 0x7f3260155980 2024-08-17T02:48:58.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.148+0000 7f3267e00640 1 -- 172.21.15.100:0/498973362 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3240065150 msgr2=0x7f3240067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:58.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.148+0000 7f3267e00640 1 --2- 172.21.15.100:0/498973362 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3240065150 0x7f3240067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3254005840 tx=0x7f3254009040 comp rx=0 tx=0).stop 2024-08-17T02:48:58.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.149+0000 7f3267e00640 1 -- 172.21.15.100:0/498973362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260155980 msgr2=0x7f32601509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:58.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.149+0000 7f3267e00640 1 --2- 172.21.15.100:0/498973362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260155980 0x7f32601509b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f32580099f0 tx=0x7f3258037000 comp rx=0 tx=0).stop 2024-08-17T02:48:58.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.149+0000 7f3267e00640 1 -- 172.21.15.100:0/498973362 shutdown_connections 2024-08-17T02:48:58.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.149+0000 7f3267e00640 1 --2- 172.21.15.100:0/498973362 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3240065150 0x7f3240067600 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:58.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.149+0000 7f3267e00640 1 --2- 172.21.15.100:0/498973362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3260155980 0x7f32601509b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:58.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.149+0000 7f3267e00640 1 --2- 172.21.15.100:0/498973362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32600af580 0x7f326016c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:58.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.149+0000 7f3267e00640 1 --2- 172.21.15.100:0/498973362 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f32600a54d0 0x7f326014b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:58.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.149+0000 7f3267e00640 1 -- 172.21.15.100:0/498973362 >> 172.21.15.100:0/498973362 conn(0x7f3260067750 msgr2=0x7f326014e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:58.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.149+0000 7f3267e00640 1 -- 172.21.15.100:0/498973362 shutdown_connections 2024-08-17T02:48:58.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.149+0000 7f3267e00640 1 -- 172.21.15.100:0/498973362 wait complete. 2024-08-17T02:48:58.165 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000001028572.meta cephfs.volume_0000000001028572.meta --yes-i-really-really-mean-it 2024-08-17T02:48:58.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.316+0000 7f2593000640 1 Processor -- start 2024-08-17T02:48:58.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.316+0000 7f2593000640 1 -- start start 2024-08-17T02:48:58.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.318+0000 7f2593000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f258c06e5f0 0x7f258c0c8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:58.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.318+0000 7f2593000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258c0ae9b0 con 0x7f258c156c60 2024-08-17T02:48:58.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.318+0000 7f2593000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258c0ab320 con 0x7f258c156890 2024-08-17T02:48:58.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.318+0000 7f2593000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258c0aa730 con 0x7f258c06e5f0 2024-08-17T02:48:58.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.318+0000 7f2591000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f258c156c60 0x7f258c0ca3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38214/0 (socket says 172.21.15.100:38214) 2024-08-17T02:48:58.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.318+0000 7f2591000640 1 -- 172.21.15.100:0/1355657853 learned_addr learned my addr 172.21.15.100:0/1355657853 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:48:58.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.318+0000 7f2583400640 1 --2- 172.21.15.100:0/1355657853 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f258c06e5f0 0x7f258c0c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:58.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.318+0000 7f258b400640 1 -- 172.21.15.100:0/1355657853 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1056273667 0 0) 0x7f258c0ae9b0 con 0x7f258c156c60 2024-08-17T02:48:58.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.319+0000 7f258b400640 1 -- 172.21.15.100:0/1355657853 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25700034e0 con 0x7f258c156c60 2024-08-17T02:48:58.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.319+0000 7f258b400640 1 -- 172.21.15.100:0/1355657853 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833476562 0 0) 0x7f258c0ab320 con 0x7f258c156890 2024-08-17T02:48:58.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.319+0000 7f258b400640 1 -- 172.21.15.100:0/1355657853 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f258c0ae9b0 con 0x7f258c156890 2024-08-17T02:48:58.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.319+0000 7f2583400640 1 -- 172.21.15.100:0/1355657853 >> v1:172.21.15.123:6789/0 conn(0x7f258c156890 legacy=0x7f258c06dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:58.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.319+0000 7f2583400640 1 -- 172.21.15.100:0/1355657853 >> v1:172.21.15.100:6789/0 conn(0x7f258c156c60 legacy=0x7f258c0ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:58.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.319+0000 7f2583400640 1 -- 172.21.15.100:0/1355657853 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258c0aa9f0 con 0x7f258c06e5f0 2024-08-17T02:48:58.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.320+0000 7f2583400640 1 --2- 172.21.15.100:0/1355657853 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f258c06e5f0 0x7f258c0c8130 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2574009880 tx=0x7f25740090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9650cbeccbe3792 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:58.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.320+0000 7f258b400640 1 -- 172.21.15.100:0/1355657853 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257402ad80 con 0x7f258c06e5f0 2024-08-17T02:48:58.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.320+0000 7f258b400640 1 -- 172.21.15.100:0/1355657853 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2574032440 con 0x7f258c06e5f0 2024-08-17T02:48:58.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.320+0000 7f258b400640 1 -- 172.21.15.100:0/1355657853 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25740327c0 con 0x7f258c06e5f0 2024-08-17T02:48:58.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.321+0000 7f2593000640 1 -- 172.21.15.100:0/1355657853 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f258c06e5f0 msgr2=0x7f258c0c8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:58.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.321+0000 7f2593000640 1 --2- 172.21.15.100:0/1355657853 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f258c06e5f0 0x7f258c0c8130 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2574009880 tx=0x7f25740090f0 comp rx=0 tx=0).stop 2024-08-17T02:48:58.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.321+0000 7f2593000640 1 -- 172.21.15.100:0/1355657853 shutdown_connections 2024-08-17T02:48:58.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.321+0000 7f2593000640 1 --2- 172.21.15.100:0/1355657853 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f258c06e5f0 0x7f258c0c8130 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:58.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.321+0000 7f2593000640 1 -- 172.21.15.100:0/1355657853 >> 172.21.15.100:0/1355657853 conn(0x7f258c067750 msgr2=0x7f258c06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:58.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.321+0000 7f2593000640 1 -- 172.21.15.100:0/1355657853 shutdown_connections 2024-08-17T02:48:58.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.321+0000 7f2593000640 1 -- 172.21.15.100:0/1355657853 wait complete. 2024-08-17T02:48:58.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.322+0000 7f2593000640 1 Processor -- start 2024-08-17T02:48:58.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.322+0000 7f2593000640 1 -- start start 2024-08-17T02:48:58.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.323+0000 7f2593000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f258c06e5f0 0x7f258c151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:58.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.323+0000 7f2593000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f258c156890 0x7f258c0afae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:58.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.323+0000 7f2593000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f258c156c60 0x7f258c0b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:58.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.323+0000 7f2593000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c0ac0c0 con 0x7f258c156890 2024-08-17T02:48:58.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.323+0000 7f2593000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c151890 con 0x7f258c06e5f0 2024-08-17T02:48:58.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.323+0000 7f2593000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258c0ab790 con 0x7f258c156c60 2024-08-17T02:48:58.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.323+0000 7f2583400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f258c156890 0x7f258c0afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:58.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.323+0000 7f2583400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f258c156890 0x7f258c0afae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37920/0 (socket says 172.21.15.100:37920) 2024-08-17T02:48:58.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.323+0000 7f2583400640 1 -- 172.21.15.100:0/1005477965 learned_addr learned my addr 172.21.15.100:0/1005477965 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:58.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.324+0000 7f2591000640 1 --2- 172.21.15.100:0/1005477965 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f258c156c60 0x7f258c0b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:58.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.324+0000 7f258be00640 1 --2- 172.21.15.100:0/1005477965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f258c06e5f0 0x7f258c151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:58.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.324+0000 7f2583400640 1 -- 172.21.15.100:0/1005477965 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f258c156c60 msgr2=0x7f258c0b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:58.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.324+0000 7f2583400640 1 --2- 172.21.15.100:0/1005477965 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f258c156c60 0x7f258c0b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:58.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.324+0000 7f2583400640 1 -- 172.21.15.100:0/1005477965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f258c06e5f0 msgr2=0x7f258c151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:58.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.324+0000 7f2583400640 1 --2- 172.21.15.100:0/1005477965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f258c06e5f0 0x7f258c151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:58.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.324+0000 7f2583400640 1 -- 172.21.15.100:0/1005477965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2574009390 con 0x7f258c156890 2024-08-17T02:48:58.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.324+0000 7f2583400640 1 --2- 172.21.15.100:0/1005477965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f258c156890 0x7f258c0afae0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f25740097d0 tx=0x7f2574032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:58.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.324+0000 7f2583e00640 1 -- 172.21.15.100:0/1005477965 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574031880 con 0x7f258c156890 2024-08-17T02:48:58.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.324+0000 7f2583e00640 1 -- 172.21.15.100:0/1005477965 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2574031a00 con 0x7f258c156890 2024-08-17T02:48:58.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.324+0000 7f2583e00640 1 -- 172.21.15.100:0/1005477965 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574031dc0 con 0x7f258c156890 2024-08-17T02:48:58.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.324+0000 7f2593000640 1 -- 172.21.15.100:0/1005477965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f258c0aba70 con 0x7f258c156890 2024-08-17T02:48:58.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.325+0000 7f2593000640 1 -- 172.21.15.100:0/1005477965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f258c0ac550 con 0x7f258c156890 2024-08-17T02:48:58.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.326+0000 7f2593000640 1 -- 172.21.15.100:0/1005477965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f258c0ac270 con 0x7f258c156890 2024-08-17T02:48:58.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.326+0000 7f2583e00640 1 -- 172.21.15.100:0/1005477965 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f257403c400 con 0x7f258c156890 2024-08-17T02:48:58.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.327+0000 7f2583e00640 1 --2- 172.21.15.100:0/1005477965 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f2568065150 0x7f2568067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:58.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.327+0000 7f2583e00640 1 -- 172.21.15.100:0/1005477965 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f25740a2550 con 0x7f258c156890 2024-08-17T02:48:58.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.327+0000 7f258be00640 1 --2- 172.21.15.100:0/1005477965 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f2568065150 0x7f2568067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:58.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.328+0000 7f258be00640 1 --2- 172.21.15.100:0/1005477965 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f2568065150 0x7f2568067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f257c0037e0 tx=0x7f257c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:58.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.332+0000 7f2583e00640 1 -- 172.21.15.100:0/1005477965 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f258c0ac270 con 0x7f258c156890 2024-08-17T02:48:58.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:58.502+0000 7f2593000640 1 -- 172.21.15.100:0/1005477965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001028572.meta", "pool2": "cephfs.volume_0000000001028572.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f258c0ac270 con 0x7f258c156890 2024-08-17T02:48:59.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.456+0000 7f2583e00640 1 -- 172.21.15.100:0/1005477965 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001028572.meta", "pool2": "cephfs.volume_0000000001028572.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000001028572.meta' removed v43) v1 ==== 241+0+0 (secure 0 0 0) 0x7f258c0ac270 con 0x7f258c156890 2024-08-17T02:48:59.457 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs.volume_0000000001028572.meta' removed 2024-08-17T02:48:59.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.460+0000 7f2593000640 1 -- 172.21.15.100:0/1005477965 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f2568065150 msgr2=0x7f2568067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:59.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.460+0000 7f2593000640 1 --2- 172.21.15.100:0/1005477965 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f2568065150 0x7f2568067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f257c0037e0 tx=0x7f257c009040 comp rx=0 tx=0).stop 2024-08-17T02:48:59.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.460+0000 7f2593000640 1 -- 172.21.15.100:0/1005477965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f258c156890 msgr2=0x7f258c0afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:59.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.460+0000 7f2593000640 1 --2- 172.21.15.100:0/1005477965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f258c156890 0x7f258c0afae0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f25740097d0 tx=0x7f2574032000 comp rx=0 tx=0).stop 2024-08-17T02:48:59.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.460+0000 7f2593000640 1 -- 172.21.15.100:0/1005477965 shutdown_connections 2024-08-17T02:48:59.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.460+0000 7f2593000640 1 --2- 172.21.15.100:0/1005477965 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f2568065150 0x7f2568067600 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:59.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.460+0000 7f2593000640 1 --2- 172.21.15.100:0/1005477965 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f258c156c60 0x7f258c0b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:59.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.460+0000 7f2593000640 1 --2- 172.21.15.100:0/1005477965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f258c156890 0x7f258c0afae0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:59.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.460+0000 7f2593000640 1 --2- 172.21.15.100:0/1005477965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f258c06e5f0 0x7f258c151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:59.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.460+0000 7f2593000640 1 -- 172.21.15.100:0/1005477965 >> 172.21.15.100:0/1005477965 conn(0x7f258c067750 msgr2=0x7f258c06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:59.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.460+0000 7f2593000640 1 -- 172.21.15.100:0/1005477965 shutdown_connections 2024-08-17T02:48:59.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.460+0000 7f2593000640 1 -- 172.21.15.100:0/1005477965 wait complete. 2024-08-17T02:48:59.481 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000001028572.data cephfs.volume_0000000001028572.data --yes-i-really-really-mean-it 2024-08-17T02:48:59.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.633+0000 7f5272c00640 1 Processor -- start 2024-08-17T02:48:59.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.634+0000 7f5272c00640 1 -- start start 2024-08-17T02:48:59.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.635+0000 7f5272c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f526c155880 0x7f526c0ae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:59.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.635+0000 7f5272c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f526c0aeb70 0x7f526c0af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:59.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.635+0000 7f5272c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526c157840 con 0x7f526c155c50 2024-08-17T02:48:59.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.635+0000 7f5272c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526c156c30 con 0x7f526c155880 2024-08-17T02:48:59.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.635+0000 7f5272c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526c156f10 con 0x7f526c0aeb70 2024-08-17T02:48:59.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.635+0000 7f5271800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f526c155880 0x7f526c0ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:59.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.635+0000 7f5271800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f526c155880 0x7f526c0ae630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37928/0 (socket says 172.21.15.100:37928) 2024-08-17T02:48:59.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.635+0000 7f5271800640 1 -- 172.21.15.100:0/1211041930 learned_addr learned my addr 172.21.15.100:0/1211041930 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:59.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.635+0000 7f5270e00640 1 --2- 172.21.15.100:0/1211041930 >> v2:172.21.15.123:3300/0 conn(0x7f526c0aeb70 0x7f526c0af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:59.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.636+0000 7f5271800640 1 -- 172.21.15.100:0/1211041930 >> v2:172.21.15.123:3300/0 conn(0x7f526c0aeb70 msgr2=0x7f526c0af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:59.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.636+0000 7f5271800640 1 --2- 172.21.15.100:0/1211041930 >> v2:172.21.15.123:3300/0 conn(0x7f526c0aeb70 0x7f526c0af0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:59.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.636+0000 7f5271800640 1 -- 172.21.15.100:0/1211041930 >> v1:172.21.15.100:6789/0 conn(0x7f526c155c50 legacy=0x7f526c1596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:59.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.636+0000 7f526be00640 1 -- 172.21.15.100:0/1211041930 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434281543 0 0) 0x7f526c157840 con 0x7f526c155c50 2024-08-17T02:48:59.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.636+0000 7f5271800640 1 -- 172.21.15.100:0/1211041930 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526c1571f0 con 0x7f526c155880 2024-08-17T02:48:59.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.637+0000 7f5271800640 1 --2- 172.21.15.100:0/1211041930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f526c155880 0x7f526c0ae630 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f526c0682e0 tx=0x7f526000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a55c8988272623f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:59.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.637+0000 7f526be00640 1 -- 172.21.15.100:0/1211041930 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260031650 con 0x7f526c155880 2024-08-17T02:48:59.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.637+0000 7f526be00640 1 -- 172.21.15.100:0/1211041930 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52600317b0 con 0x7f526c155880 2024-08-17T02:48:59.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.637+0000 7f526be00640 1 -- 172.21.15.100:0/1211041930 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260031b50 con 0x7f526c155880 2024-08-17T02:48:59.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.638+0000 7f5272c00640 1 -- 172.21.15.100:0/1211041930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f526c155880 msgr2=0x7f526c0ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:59.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.638+0000 7f5272c00640 1 --2- 172.21.15.100:0/1211041930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f526c155880 0x7f526c0ae630 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f526c0682e0 tx=0x7f526000b460 comp rx=0 tx=0).stop 2024-08-17T02:48:59.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.638+0000 7f5272c00640 1 -- 172.21.15.100:0/1211041930 shutdown_connections 2024-08-17T02:48:59.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.638+0000 7f5272c00640 1 --2- 172.21.15.100:0/1211041930 >> v2:172.21.15.123:3300/0 conn(0x7f526c0aeb70 0x7f526c0af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:59.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.638+0000 7f5272c00640 1 --2- 172.21.15.100:0/1211041930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f526c155880 0x7f526c0ae630 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:59.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.638+0000 7f5272c00640 1 -- 172.21.15.100:0/1211041930 >> 172.21.15.100:0/1211041930 conn(0x7f526c067750 msgr2=0x7f526c0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:59.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.638+0000 7f5272c00640 1 -- 172.21.15.100:0/1211041930 shutdown_connections 2024-08-17T02:48:59.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.638+0000 7f5272c00640 1 -- 172.21.15.100:0/1211041930 wait complete. 2024-08-17T02:48:59.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.639+0000 7f5272c00640 1 Processor -- start 2024-08-17T02:48:59.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.639+0000 7f5272c00640 1 -- start start 2024-08-17T02:48:59.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.640+0000 7f5272c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f526c0aeb70 0x7f526c13a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:59.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.640+0000 7f5272c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f526c155880 0x7f526c06db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:59.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.640+0000 7f5272c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f526c155c50 0x7f526c06e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:59.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.640+0000 7f5272c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526c13a970 con 0x7f526c155c50 2024-08-17T02:48:59.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.640+0000 7f5272c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526c145670 con 0x7f526c155880 2024-08-17T02:48:59.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.640+0000 7f5272c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526c145c30 con 0x7f526c0aeb70 2024-08-17T02:48:59.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.640+0000 7f5272200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f526c155c50 0x7f526c06e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:59.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.641+0000 7f5272200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f526c155c50 0x7f526c06e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37934/0 (socket says 172.21.15.100:37934) 2024-08-17T02:48:59.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.641+0000 7f5272200640 1 -- 172.21.15.100:0/2662446362 learned_addr learned my addr 172.21.15.100:0/2662446362 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:48:59.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.641+0000 7f5271800640 1 --2- 172.21.15.100:0/2662446362 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f526c0aeb70 0x7f526c13a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:59.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.641+0000 7f5270e00640 1 --2- 172.21.15.100:0/2662446362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f526c155880 0x7f526c06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:59.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.641+0000 7f5272200640 1 -- 172.21.15.100:0/2662446362 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f526c0aeb70 msgr2=0x7f526c13a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:59.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.641+0000 7f5272200640 1 --2- 172.21.15.100:0/2662446362 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f526c0aeb70 0x7f526c13a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:59.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.641+0000 7f5272200640 1 -- 172.21.15.100:0/2662446362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f526c155880 msgr2=0x7f526c06db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:59.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.641+0000 7f5272200640 1 --2- 172.21.15.100:0/2662446362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f526c155880 0x7f526c06db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:59.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.641+0000 7f5272200640 1 -- 172.21.15.100:0/2662446362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526000b700 con 0x7f526c155c50 2024-08-17T02:48:59.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.641+0000 7f5270e00640 1 --2- 172.21.15.100:0/2662446362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f526c155880 0x7f526c06db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:48:59.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.641+0000 7f5272200640 1 --2- 172.21.15.100:0/2662446362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f526c155c50 0x7f526c06e050 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f526400c810 tx=0x7f52640015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:59.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.642+0000 7f5268c00640 1 -- 172.21.15.100:0/2662446362 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526400ce00 con 0x7f526c155c50 2024-08-17T02:48:59.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.642+0000 7f5268c00640 1 -- 172.21.15.100:0/2662446362 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526400a850 con 0x7f526c155c50 2024-08-17T02:48:59.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.642+0000 7f5268c00640 1 -- 172.21.15.100:0/2662446362 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526400ac10 con 0x7f526c155c50 2024-08-17T02:48:59.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.642+0000 7f5272c00640 1 -- 172.21.15.100:0/2662446362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526c154b20 con 0x7f526c155c50 2024-08-17T02:48:59.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.642+0000 7f5272c00640 1 -- 172.21.15.100:0/2662446362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526c1458c0 con 0x7f526c155c50 2024-08-17T02:48:59.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.643+0000 7f5272c00640 1 -- 172.21.15.100:0/2662446362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f526c148a30 con 0x7f526c155c50 2024-08-17T02:48:59.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.643+0000 7f5268c00640 1 -- 172.21.15.100:0/2662446362 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5264012420 con 0x7f526c155c50 2024-08-17T02:48:59.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.644+0000 7f5268c00640 1 --2- 172.21.15.100:0/2662446362 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f524c065150 0x7f524c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:59.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.644+0000 7f5268c00640 1 -- 172.21.15.100:0/2662446362 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5448+0+0 (secure 0 0 0) 0x7f52640826a0 con 0x7f526c155c50 2024-08-17T02:48:59.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.644+0000 7f5271800640 1 --2- 172.21.15.100:0/2662446362 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f524c065150 0x7f524c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:59.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.645+0000 7f5271800640 1 --2- 172.21.15.100:0/2662446362 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f524c065150 0x7f524c067600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5260037000 tx=0x7f526003a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:59.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.648+0000 7f5268c00640 1 -- 172.21.15.100:0/2662446362 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5264054250 con 0x7f526c155c50 2024-08-17T02:48:59.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:48:59.823+0000 7f5272c00640 1 -- 172.21.15.100:0/2662446362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001028572.data", "pool2": "cephfs.volume_0000000001028572.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f526c145da0 con 0x7f526c155c50 2024-08-17T02:49:00.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.456+0000 7f5268c00640 1 -- 172.21.15.100:0/2662446362 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001028572.data", "pool2": "cephfs.volume_0000000001028572.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000001028572.data' removed v44) v1 ==== 241+0+0 (secure 0 0 0) 0x7f5264053de0 con 0x7f526c155c50 2024-08-17T02:49:00.457 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs.volume_0000000001028572.data' removed 2024-08-17T02:49:00.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.462+0000 7f5272c00640 1 -- 172.21.15.100:0/2662446362 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f524c065150 msgr2=0x7f524c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:00.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.462+0000 7f5272c00640 1 --2- 172.21.15.100:0/2662446362 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f524c065150 0x7f524c067600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5260037000 tx=0x7f526003a000 comp rx=0 tx=0).stop 2024-08-17T02:49:00.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.462+0000 7f5272c00640 1 -- 172.21.15.100:0/2662446362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f526c155c50 msgr2=0x7f526c06e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:00.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.462+0000 7f5272c00640 1 --2- 172.21.15.100:0/2662446362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f526c155c50 0x7f526c06e050 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f526400c810 tx=0x7f52640015f0 comp rx=0 tx=0).stop 2024-08-17T02:49:00.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.462+0000 7f5272c00640 1 -- 172.21.15.100:0/2662446362 shutdown_connections 2024-08-17T02:49:00.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.462+0000 7f5272c00640 1 --2- 172.21.15.100:0/2662446362 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f524c065150 0x7f524c067600 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:00.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.462+0000 7f5272c00640 1 --2- 172.21.15.100:0/2662446362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f526c155c50 0x7f526c06e050 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:00.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.462+0000 7f5272c00640 1 --2- 172.21.15.100:0/2662446362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f526c155880 0x7f526c06db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:00.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.462+0000 7f5272c00640 1 --2- 172.21.15.100:0/2662446362 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f526c0aeb70 0x7f526c13a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:00.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.462+0000 7f5272c00640 1 -- 172.21.15.100:0/2662446362 >> 172.21.15.100:0/2662446362 conn(0x7f526c067750 msgr2=0x7f526c1589c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:00.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.463+0000 7f5272c00640 1 -- 172.21.15.100:0/2662446362 shutdown_connections 2024-08-17T02:49:00.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.463+0000 7f5272c00640 1 -- 172.21.15.100:0/2662446362 wait complete. 2024-08-17T02:49:00.483 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-17T02:49:00.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.634+0000 7fd05ca00640 1 Processor -- start 2024-08-17T02:49:00.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.634+0000 7fd05ca00640 1 -- start start 2024-08-17T02:49:00.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.635+0000 7fd05ca00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd058158c70 0x7fd0580ac960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:00.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.635+0000 7fd05ca00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd05806dec0 0x7fd0580c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:00.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.635+0000 7fd05ca00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0580ac4d0 con 0x7fd0580acea0 2024-08-17T02:49:00.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.635+0000 7fd05ca00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0580ab8c0 con 0x7fd058158c70 2024-08-17T02:49:00.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.635+0000 7fd05ca00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0580abba0 con 0x7fd05806dec0 2024-08-17T02:49:00.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.636+0000 7fd055e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd058158c70 0x7fd0580ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:00.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.636+0000 7fd04fe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd0580acea0 0x7fd05806d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38230/0 (socket says 172.21.15.100:38230) 2024-08-17T02:49:00.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.636+0000 7fd04fe00640 1 -- 172.21.15.100:0/2170252224 learned_addr learned my addr 172.21.15.100:0/2170252224 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:49:00.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.636+0000 7fd055e00640 1 -- 172.21.15.100:0/2170252224 >> v2:172.21.15.123:3300/0 conn(0x7fd05806dec0 msgr2=0x7fd0580c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:00.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.636+0000 7fd056800640 1 --2- 172.21.15.100:0/2170252224 >> v2:172.21.15.123:3300/0 conn(0x7fd05806dec0 0x7fd0580c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:00.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.636+0000 7fd055400640 1 -- 172.21.15.100:0/2170252224 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443440195 0 0) 0x7fd0580ac4d0 con 0x7fd0580acea0 2024-08-17T02:49:00.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.636+0000 7fd055e00640 1 --2- 172.21.15.100:0/2170252224 >> v2:172.21.15.123:3300/0 conn(0x7fd05806dec0 0x7fd0580c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:00.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.636+0000 7fd055e00640 1 -- 172.21.15.100:0/2170252224 >> v1:172.21.15.100:6789/0 conn(0x7fd0580acea0 legacy=0x7fd05806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:00.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.636+0000 7fd055e00640 1 -- 172.21.15.100:0/2170252224 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0580abe80 con 0x7fd058158c70 2024-08-17T02:49:00.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.636+0000 7fd056800640 1 --2- 172.21.15.100:0/2170252224 >> v2:172.21.15.123:3300/0 conn(0x7fd05806dec0 0x7fd0580c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:00.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.637+0000 7fd055e00640 1 --2- 172.21.15.100:0/2170252224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd058158c70 0x7fd0580ac960 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd058067cb0 tx=0x7fd0480090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102b25a2c0bdeb4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:00.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.637+0000 7fd055400640 1 -- 172.21.15.100:0/2170252224 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04802ad20 con 0x7fd058158c70 2024-08-17T02:49:00.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.637+0000 7fd055400640 1 -- 172.21.15.100:0/2170252224 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04802ae80 con 0x7fd058158c70 2024-08-17T02:49:00.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.637+0000 7fd055400640 1 -- 172.21.15.100:0/2170252224 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd048032670 con 0x7fd058158c70 2024-08-17T02:49:00.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.638+0000 7fd05ca00640 1 -- 172.21.15.100:0/2170252224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd058158c70 msgr2=0x7fd0580ac960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:00.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.638+0000 7fd05ca00640 1 --2- 172.21.15.100:0/2170252224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd058158c70 0x7fd0580ac960 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd058067cb0 tx=0x7fd0480090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:00.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.638+0000 7fd05ca00640 1 -- 172.21.15.100:0/2170252224 shutdown_connections 2024-08-17T02:49:00.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.638+0000 7fd05ca00640 1 --2- 172.21.15.100:0/2170252224 >> v2:172.21.15.123:3300/0 conn(0x7fd05806dec0 0x7fd0580c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:00.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.638+0000 7fd05ca00640 1 --2- 172.21.15.100:0/2170252224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd058158c70 0x7fd0580ac960 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:00.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.638+0000 7fd05ca00640 1 -- 172.21.15.100:0/2170252224 >> 172.21.15.100:0/2170252224 conn(0x7fd058067750 msgr2=0x7fd0580cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:00.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.638+0000 7fd05ca00640 1 -- 172.21.15.100:0/2170252224 shutdown_connections 2024-08-17T02:49:00.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.638+0000 7fd05ca00640 1 -- 172.21.15.100:0/2170252224 wait complete. 2024-08-17T02:49:00.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.639+0000 7fd05ca00640 1 Processor -- start 2024-08-17T02:49:00.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.640+0000 7fd05ca00640 1 -- start start 2024-08-17T02:49:00.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.640+0000 7fd05ca00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd05806dec0 0x7fd058157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:00.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.640+0000 7fd05ca00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd0580acea0 0x7fd0580c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:00.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.640+0000 7fd05ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd058158c70 0x7fd058157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:00.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.640+0000 7fd05ca00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0581575b0 con 0x7fd058158c70 2024-08-17T02:49:00.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.640+0000 7fd05ca00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd058156be0 con 0x7fd05806dec0 2024-08-17T02:49:00.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.640+0000 7fd05ca00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0581583d0 con 0x7fd0580acea0 2024-08-17T02:49:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.641+0000 7fd056800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd058158c70 0x7fd058157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.641+0000 7fd056800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd058158c70 0x7fd058157070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37964/0 (socket says 172.21.15.100:37964) 2024-08-17T02:49:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.641+0000 7fd056800640 1 -- 172.21.15.100:0/3014968703 learned_addr learned my addr 172.21.15.100:0/3014968703 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.641+0000 7fd04fe00640 1 --2- 172.21.15.100:0/3014968703 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd0580acea0 0x7fd0580c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.641+0000 7fd055e00640 1 --2- 172.21.15.100:0/3014968703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd05806dec0 0x7fd058157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.641+0000 7fd056800640 1 -- 172.21.15.100:0/3014968703 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd0580acea0 msgr2=0x7fd0580c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.641+0000 7fd056800640 1 --2- 172.21.15.100:0/3014968703 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd0580acea0 0x7fd0580c9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.641+0000 7fd056800640 1 -- 172.21.15.100:0/3014968703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd05806dec0 msgr2=0x7fd058157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.641+0000 7fd056800640 1 --2- 172.21.15.100:0/3014968703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd05806dec0 0x7fd058157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.641+0000 7fd056800640 1 -- 172.21.15.100:0/3014968703 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd048009390 con 0x7fd058158c70 2024-08-17T02:49:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.641+0000 7fd056800640 1 --2- 172.21.15.100:0/3014968703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd058158c70 0x7fd058157070 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd05000cef0 tx=0x7fd050007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.642+0000 7fd04d600640 1 -- 172.21.15.100:0/3014968703 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050016420 con 0x7fd058158c70 2024-08-17T02:49:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.642+0000 7fd04d600640 1 -- 172.21.15.100:0/3014968703 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0500165c0 con 0x7fd058158c70 2024-08-17T02:49:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.642+0000 7fd04d600640 1 -- 172.21.15.100:0/3014968703 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050016980 con 0x7fd058158c70 2024-08-17T02:49:00.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.642+0000 7fd05ca00640 1 -- 172.21.15.100:0/3014968703 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd058156590 con 0x7fd058158c70 2024-08-17T02:49:00.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.642+0000 7fd05ca00640 1 -- 172.21.15.100:0/3014968703 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0581561b0 con 0x7fd058158c70 2024-08-17T02:49:00.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.643+0000 7fd05ca00640 1 -- 172.21.15.100:0/3014968703 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0581563d0 con 0x7fd058158c70 2024-08-17T02:49:00.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.643+0000 7fd04d600640 1 -- 172.21.15.100:0/3014968703 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd05000e3f0 con 0x7fd058158c70 2024-08-17T02:49:00.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.644+0000 7fd04d600640 1 --2- 172.21.15.100:0/3014968703 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd034065180 0x7fd034067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:00.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.644+0000 7fd04d600640 1 -- 172.21.15.100:0/3014968703 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fd050012070 con 0x7fd058158c70 2024-08-17T02:49:00.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.644+0000 7fd055e00640 1 --2- 172.21.15.100:0/3014968703 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd034065180 0x7fd034067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:00.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.645+0000 7fd055e00640 1 --2- 172.21.15.100:0/3014968703 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd034065180 0x7fd034067630 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd048034000 tx=0x7fd048032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:00.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.649+0000 7fd04d600640 1 -- 172.21.15.100:0/3014968703 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd05004ee40 con 0x7fd058158c70 2024-08-17T02:49:00.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.823+0000 7fd05ca00640 1 -- 172.21.15.100:0/3014968703 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd058071050 con 0x7fd058158c70 2024-08-17T02:49:00.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.827+0000 7fd04d600640 1 -- 172.21.15.100:0/3014968703 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd050050ec0 con 0x7fd058158c70 2024-08-17T02:49:00.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.829+0000 7fd05ca00640 1 -- 172.21.15.100:0/3014968703 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd034065180 msgr2=0x7fd034067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:00.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.829+0000 7fd05ca00640 1 --2- 172.21.15.100:0/3014968703 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd034065180 0x7fd034067630 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd048034000 tx=0x7fd048032000 comp rx=0 tx=0).stop 2024-08-17T02:49:00.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.829+0000 7fd05ca00640 1 -- 172.21.15.100:0/3014968703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd058158c70 msgr2=0x7fd058157070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:00.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.829+0000 7fd05ca00640 1 --2- 172.21.15.100:0/3014968703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd058158c70 0x7fd058157070 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd05000cef0 tx=0x7fd050007830 comp rx=0 tx=0).stop 2024-08-17T02:49:00.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.830+0000 7fd05ca00640 1 -- 172.21.15.100:0/3014968703 shutdown_connections 2024-08-17T02:49:00.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.830+0000 7fd05ca00640 1 --2- 172.21.15.100:0/3014968703 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd034065180 0x7fd034067630 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:00.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.830+0000 7fd05ca00640 1 --2- 172.21.15.100:0/3014968703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd058158c70 0x7fd058157070 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:00.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.830+0000 7fd05ca00640 1 --2- 172.21.15.100:0/3014968703 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd0580acea0 0x7fd0580c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:00.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.830+0000 7fd05ca00640 1 --2- 172.21.15.100:0/3014968703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd05806dec0 0x7fd058157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:00.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.830+0000 7fd05ca00640 1 -- 172.21.15.100:0/3014968703 >> 172.21.15.100:0/3014968703 conn(0x7fd058067750 msgr2=0x7fd05806d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:00.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.830+0000 7fd05ca00640 1 -- 172.21.15.100:0/3014968703 shutdown_connections 2024-08-17T02:49:00.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.830+0000 7fd05ca00640 1 -- 172.21.15.100:0/3014968703 wait complete. 2024-08-17T02:49:00.845 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:49:00.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.993+0000 7fcf6da00640 1 Processor -- start 2024-08-17T02:49:00.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.993+0000 7fcf6da00640 1 -- start start 2024-08-17T02:49:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.994+0000 7fcf6da00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcf68158ea0 0x7fcf680afb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.994+0000 7fcf6da00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf68067d60 con 0x7fcf680ac780 2024-08-17T02:49:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.994+0000 7fcf6da00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf68068600 con 0x7fcf68158ad0 2024-08-17T02:49:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.994+0000 7fcf6da00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf680b01d0 con 0x7fcf68158ea0 2024-08-17T02:49:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.994+0000 7fcf67400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcf680ac780 0x7fcf680af410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38244/0 (socket says 172.21.15.100:38244) 2024-08-17T02:49:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.994+0000 7fcf67400640 1 -- 172.21.15.100:0/3879567663 learned_addr learned my addr 172.21.15.100:0/3879567663 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:49:00.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.995+0000 7fcf6d000640 1 --2- 172.21.15.100:0/3879567663 >> v2:172.21.15.123:3300/0 conn(0x7fcf68158ea0 0x7fcf680afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:00.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.995+0000 7fcf66a00640 1 -- 172.21.15.100:0/3879567663 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1700825416 0 0) 0x7fcf68067d60 con 0x7fcf680ac780 2024-08-17T02:49:00.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.995+0000 7fcf66a00640 1 -- 172.21.15.100:0/3879567663 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf4c0034e0 con 0x7fcf680ac780 2024-08-17T02:49:00.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.995+0000 7fcf6d000640 1 -- 172.21.15.100:0/3879567663 >> v1:172.21.15.123:6789/0 conn(0x7fcf68158ad0 legacy=0x7fcf680ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:00.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.995+0000 7fcf6d000640 1 -- 172.21.15.100:0/3879567663 >> v1:172.21.15.100:6789/0 conn(0x7fcf680ac780 legacy=0x7fcf680af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:00.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.995+0000 7fcf6d000640 1 -- 172.21.15.100:0/3879567663 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf68067fb0 con 0x7fcf68158ea0 2024-08-17T02:49:00.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.996+0000 7fcf6d000640 1 --2- 172.21.15.100:0/3879567663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf68158ea0 0x7fcf680afb20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009e60 tx=0x7fcf60009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef3fd29ad13bf95a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:00.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.996+0000 7fcf66a00640 1 -- 172.21.15.100:0/3879567663 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60007550 con 0x7fcf68158ea0 2024-08-17T02:49:00.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.996+0000 7fcf66a00640 1 -- 172.21.15.100:0/3879567663 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6002d050 con 0x7fcf68158ea0 2024-08-17T02:49:00.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.996+0000 7fcf66a00640 1 -- 172.21.15.100:0/3879567663 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf600078c0 con 0x7fcf68158ea0 2024-08-17T02:49:00.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.997+0000 7fcf6da00640 1 -- 172.21.15.100:0/3879567663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf68158ea0 msgr2=0x7fcf680afb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:00.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.997+0000 7fcf6da00640 1 --2- 172.21.15.100:0/3879567663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf68158ea0 0x7fcf680afb20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009e60 tx=0x7fcf60009780 comp rx=0 tx=0).stop 2024-08-17T02:49:00.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.997+0000 7fcf6da00640 1 -- 172.21.15.100:0/3879567663 shutdown_connections 2024-08-17T02:49:00.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.997+0000 7fcf6da00640 1 --2- 172.21.15.100:0/3879567663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf68158ea0 0x7fcf680afb20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:00.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.997+0000 7fcf6da00640 1 -- 172.21.15.100:0/3879567663 >> 172.21.15.100:0/3879567663 conn(0x7fcf68096a70 msgr2=0x7fcf68096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:00.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.997+0000 7fcf6da00640 1 -- 172.21.15.100:0/3879567663 shutdown_connections 2024-08-17T02:49:00.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.997+0000 7fcf6da00640 1 -- 172.21.15.100:0/3879567663 wait complete. 2024-08-17T02:49:00.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.999+0000 7fcf6da00640 1 Processor -- start 2024-08-17T02:49:00.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:00.999+0000 7fcf6da00640 1 -- start start 2024-08-17T02:49:01.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.000+0000 7fcf6da00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf680ac780 0x7fcf680c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:01.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.000+0000 7fcf6da00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf68158ad0 0x7fcf681528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:01.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.000+0000 7fcf6da00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf68158ea0 0x7fcf680c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:01.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.000+0000 7fcf6da00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf680caeb0 con 0x7fcf68158ea0 2024-08-17T02:49:01.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.000+0000 7fcf6da00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf680c8610 con 0x7fcf68158ad0 2024-08-17T02:49:01.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.000+0000 7fcf6da00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf680aad80 con 0x7fcf680ac780 2024-08-17T02:49:01.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.000+0000 7fcf6d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf68158ea0 0x7fcf680c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:01.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.000+0000 7fcf6d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf68158ea0 0x7fcf680c9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37976/0 (socket says 172.21.15.100:37976) 2024-08-17T02:49:01.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.000+0000 7fcf6d000640 1 -- 172.21.15.100:0/859149331 learned_addr learned my addr 172.21.15.100:0/859149331 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:01.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.000+0000 7fcf67e00640 1 --2- 172.21.15.100:0/859149331 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf680ac780 0x7fcf680c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:01.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.000+0000 7fcf67400640 1 --2- 172.21.15.100:0/859149331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf68158ad0 0x7fcf681528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:01.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.000+0000 7fcf6d000640 1 -- 172.21.15.100:0/859149331 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf680ac780 msgr2=0x7fcf680c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:01.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.000+0000 7fcf6d000640 1 --2- 172.21.15.100:0/859149331 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf680ac780 0x7fcf680c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:01.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.000+0000 7fcf6d000640 1 -- 172.21.15.100:0/859149331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf68158ad0 msgr2=0x7fcf681528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:01.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.000+0000 7fcf6d000640 1 --2- 172.21.15.100:0/859149331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf68158ad0 0x7fcf681528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:01.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.000+0000 7fcf6d000640 1 -- 172.21.15.100:0/859149331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf60009a20 con 0x7fcf68158ea0 2024-08-17T02:49:01.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.001+0000 7fcf6d000640 1 --2- 172.21.15.100:0/859149331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf68158ea0 0x7fcf680c9fc0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcf600097c0 tx=0x7fcf60037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:01.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.001+0000 7fcf5f400640 1 -- 172.21.15.100:0/859149331 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60031bf0 con 0x7fcf68158ea0 2024-08-17T02:49:01.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.001+0000 7fcf5f400640 1 -- 172.21.15.100:0/859149331 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf60031d70 con 0x7fcf68158ea0 2024-08-17T02:49:01.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.001+0000 7fcf6da00640 1 -- 172.21.15.100:0/859149331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf680c8840 con 0x7fcf68158ea0 2024-08-17T02:49:01.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.001+0000 7fcf5f400640 1 -- 172.21.15.100:0/859149331 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6003c670 con 0x7fcf68158ea0 2024-08-17T02:49:01.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.001+0000 7fcf6da00640 1 -- 172.21.15.100:0/859149331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf680c8bd0 con 0x7fcf68158ea0 2024-08-17T02:49:01.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.002+0000 7fcf6da00640 1 -- 172.21.15.100:0/859149331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf68071050 con 0x7fcf68158ea0 2024-08-17T02:49:01.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.003+0000 7fcf5f400640 1 -- 172.21.15.100:0/859149331 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcf60003040 con 0x7fcf68158ea0 2024-08-17T02:49:01.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.004+0000 7fcf5f400640 1 --2- 172.21.15.100:0/859149331 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fcf480651d0 0x7fcf48067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:01.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.004+0000 7fcf5f400640 1 -- 172.21.15.100:0/859149331 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fcf600a3610 con 0x7fcf68158ea0 2024-08-17T02:49:01.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.004+0000 7fcf67e00640 1 --2- 172.21.15.100:0/859149331 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fcf480651d0 0x7fcf48067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:01.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.005+0000 7fcf67e00640 1 --2- 172.21.15.100:0/859149331 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fcf480651d0 0x7fcf48067680 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcf58007fd0 tx=0x7fcf58000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:01.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.008+0000 7fcf5f400640 1 -- 172.21.15.100:0/859149331 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcf60071980 con 0x7fcf68158ea0 2024-08-17T02:49:01.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.246+0000 7fcf6da00640 1 -- 172.21.15.100:0/859149331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7fcf680aaec0 con 0x7fcf68158ea0 2024-08-17T02:49:01.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.465+0000 7fcf5f400640 1 -- 172.21.15.100:0/859149331 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v157) v1 ==== 135+0+0 (secure 0 0 0) 0x7fcf60074fa0 con 0x7fcf68158ea0 2024-08-17T02:49:01.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.467+0000 7fcf6da00640 1 -- 172.21.15.100:0/859149331 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fcf480651d0 msgr2=0x7fcf48067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.467+0000 7fcf6da00640 1 --2- 172.21.15.100:0/859149331 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fcf480651d0 0x7fcf48067680 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcf58007fd0 tx=0x7fcf58000bc0 comp rx=0 tx=0).stop 2024-08-17T02:49:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.467+0000 7fcf6da00640 1 -- 172.21.15.100:0/859149331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf68158ea0 msgr2=0x7fcf680c9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.467+0000 7fcf6da00640 1 --2- 172.21.15.100:0/859149331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf68158ea0 0x7fcf680c9fc0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcf600097c0 tx=0x7fcf60037000 comp rx=0 tx=0).stop 2024-08-17T02:49:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.468+0000 7fcf6da00640 1 -- 172.21.15.100:0/859149331 shutdown_connections 2024-08-17T02:49:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.468+0000 7fcf6da00640 1 --2- 172.21.15.100:0/859149331 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fcf480651d0 0x7fcf48067680 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.468+0000 7fcf6da00640 1 --2- 172.21.15.100:0/859149331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf68158ea0 0x7fcf680c9fc0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.468+0000 7fcf6da00640 1 --2- 172.21.15.100:0/859149331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf68158ad0 0x7fcf681528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.468+0000 7fcf6da00640 1 --2- 172.21.15.100:0/859149331 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf680ac780 0x7fcf680c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.468+0000 7fcf6da00640 1 -- 172.21.15.100:0/859149331 >> 172.21.15.100:0/859149331 conn(0x7fcf68096a70 msgr2=0x7fcf680ce210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.468+0000 7fcf6da00640 1 -- 172.21.15.100:0/859149331 shutdown_connections 2024-08-17T02:49:01.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:01.468+0000 7fcf6da00640 1 -- 172.21.15.100:0/859149331 wait complete. 2024-08-17T02:49:01.487 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-17T02:49:01.487 INFO:tasks.cephfs_test_runner: 2024-08-17T02:49:01.487 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:49:01.487 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:49:01.487 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:49:01.487 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:49:01.488 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:49:01.488 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:49:01.488 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:49:01.488 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:49:01.488 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:49:01.488 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:49:01.488 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:49:01.488 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:49:01.488 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:49:01.488 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:49:01.488 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:49:01.488 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:49:01.488 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:49:01.488 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:49:01.488 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:49:01.488 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:49:01.488 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:49:01.489 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:49:01.489 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:49:01.489 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi100 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000001028572 --yes-i-really-mean-it' 2024-08-17T02:49:01.489 INFO:tasks.cephfs_test_runner: 2024-08-17T02:49:01.489 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:49:01.489 INFO:tasks.cephfs_test_runner:Ran 1 test in 169.116s 2024-08-17T02:49:01.489 INFO:tasks.cephfs_test_runner: 2024-08-17T02:49:01.489 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-17T02:49:01.489 INFO:tasks.cephfs_test_runner: 2024-08-17T02:49:01.489 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:49:01.489 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:49:01.489 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:49:01.489 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:49:01.490 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:49:01.490 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:49:01.490 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:49:01.490 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:49:01.490 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:49:01.490 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:49:01.490 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:49:01.490 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:49:01.490 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:49:01.490 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:49:01.490 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:49:01.490 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:49:01.490 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:49:01.490 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:49:01.490 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:49:01.490 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:49:01.491 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:49:01.491 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:49:01.491 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:49:01.491 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi100 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000001028572 --yes-i-really-mean-it' 2024-08-17T02:49:01.491 INFO:tasks.cephfs_test_runner: 2024-08-17T02:49:01.491 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:49:01.737 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=809553eeab584c0d86890487b5d2c7c6 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:49:01.739 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-17T02:49:01.748 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-17T02:49:01.772 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-17T02:49:01.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:01.773 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-08-17T02:49:01.812 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:49:01.812 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:49:01.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:01.813 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:49:01.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:01.910 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:49:02.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:02.185 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-08-17T02:49:02.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:02.494 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-08-17T02:49:02.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:02.530 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-08-17T02:49:02.629 INFO:teuthology.orchestra.run.smithi100.stderr:Cannot find device "ceph-brx" 2024-08-17T02:49:02.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:49:02.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:02.633 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-08-17T02:49:02.673 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:49:02.673 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:49:02.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:02.673 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:49:02.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:02.775 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:49:03.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:03.042 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-08-17T02:49:03.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:03.358 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-08-17T02:49:03.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:03.394 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-08-17T02:49:03.494 INFO:teuthology.orchestra.run.smithi123.stderr:Cannot find device "ceph-brx" 2024-08-17T02:49:03.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:49:03.496 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-17T02:49:03.506 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-17T02:49:03.506 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:49:03.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.664+0000 7f601b400640 1 Processor -- start 2024-08-17T02:49:03.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.664+0000 7f601b400640 1 -- start start 2024-08-17T02:49:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.665+0000 7f601b400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f601406df00 0x7f60140adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.665+0000 7f601b400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6014155df0 0x7f60140ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.665+0000 7f601b400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6014156670 con 0x7f6014155a20 2024-08-17T02:49:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.665+0000 7f601b400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60140b0350 con 0x7f601406df00 2024-08-17T02:49:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.665+0000 7f601b400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601406e5e0 con 0x7f6014155df0 2024-08-17T02:49:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.665+0000 7f6018a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6014155a20 0x7f601406d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38252/0 (socket says 172.21.15.100:38252) 2024-08-17T02:49:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.665+0000 7f6018a00640 1 -- 172.21.15.100:0/2543992832 learned_addr learned my addr 172.21.15.100:0/2543992832 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:49:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.666+0000 7f600be00640 1 --2- 172.21.15.100:0/2543992832 >> v2:172.21.15.123:3300/0 conn(0x7f601406df00 0x7f60140adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.666+0000 7f6019400640 1 --2- 172.21.15.100:0/2543992832 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6014155df0 0x7f60140ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.666+0000 7f6013e00640 1 -- 172.21.15.100:0/2543992832 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926066395 0 0) 0x7f6014156670 con 0x7f6014155a20 2024-08-17T02:49:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.666+0000 7f6013e00640 1 -- 172.21.15.100:0/2543992832 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ff80034e0 con 0x7f6014155a20 2024-08-17T02:49:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.666+0000 7f600be00640 1 -- 172.21.15.100:0/2543992832 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6014155df0 msgr2=0x7f60140ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.666+0000 7f600be00640 1 --2- 172.21.15.100:0/2543992832 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6014155df0 0x7f60140ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.666+0000 7f600be00640 1 -- 172.21.15.100:0/2543992832 >> v1:172.21.15.100:6789/0 conn(0x7f6014155a20 legacy=0x7f601406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.666+0000 7f600be00640 1 -- 172.21.15.100:0/2543992832 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601406e8c0 con 0x7f601406df00 2024-08-17T02:49:03.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.667+0000 7f600be00640 1 --2- 172.21.15.100:0/2543992832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f601406df00 0x7f60140adf10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009850 tx=0x7f5ffc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c93194ff0796ed93 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:03.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.667+0000 7f6013e00640 1 -- 172.21.15.100:0/2543992832 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc02ad90 con 0x7f601406df00 2024-08-17T02:49:03.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.667+0000 7f6013e00640 1 -- 172.21.15.100:0/2543992832 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ffc032440 con 0x7f601406df00 2024-08-17T02:49:03.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.667+0000 7f6013e00640 1 -- 172.21.15.100:0/2543992832 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc032820 con 0x7f601406df00 2024-08-17T02:49:03.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.668+0000 7f601b400640 1 -- 172.21.15.100:0/2543992832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f601406df00 msgr2=0x7f60140adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:03.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.668+0000 7f601b400640 1 --2- 172.21.15.100:0/2543992832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f601406df00 0x7f60140adf10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009850 tx=0x7f5ffc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:03.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.668+0000 7f601b400640 1 -- 172.21.15.100:0/2543992832 shutdown_connections 2024-08-17T02:49:03.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.668+0000 7f601b400640 1 --2- 172.21.15.100:0/2543992832 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6014155df0 0x7f60140ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:03.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.668+0000 7f601b400640 1 --2- 172.21.15.100:0/2543992832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f601406df00 0x7f60140adf10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:03.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.668+0000 7f601b400640 1 -- 172.21.15.100:0/2543992832 >> 172.21.15.100:0/2543992832 conn(0x7f60140cb9b0 msgr2=0x7f60140cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:03.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.668+0000 7f601b400640 1 -- 172.21.15.100:0/2543992832 shutdown_connections 2024-08-17T02:49:03.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.668+0000 7f601b400640 1 -- 172.21.15.100:0/2543992832 wait complete. 2024-08-17T02:49:03.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.670+0000 7f601b400640 1 Processor -- start 2024-08-17T02:49:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.670+0000 7f601b400640 1 -- start start 2024-08-17T02:49:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.671+0000 7f601b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f601406df00 0x7f601416a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.671+0000 7f601b400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6014155a20 0x7f60140a6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.671+0000 7f601b400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6014155df0 0x7f60140a6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.671+0000 7f601b400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60141500f0 con 0x7f601406df00 2024-08-17T02:49:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.671+0000 7f601b400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60140ab240 con 0x7f6014155a20 2024-08-17T02:49:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.671+0000 7f601b400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601416acd0 con 0x7f6014155df0 2024-08-17T02:49:03.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.671+0000 7f6018a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f601406df00 0x7f601416a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:03.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.671+0000 7f6018a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f601406df00 0x7f601416a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37992/0 (socket says 172.21.15.100:37992) 2024-08-17T02:49:03.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.671+0000 7f6018a00640 1 -- 172.21.15.100:0/1995359802 learned_addr learned my addr 172.21.15.100:0/1995359802 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:03.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.671+0000 7f600be00640 1 --2- 172.21.15.100:0/1995359802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6014155a20 0x7f60140a6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:03.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.671+0000 7f6019400640 1 --2- 172.21.15.100:0/1995359802 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6014155df0 0x7f60140a6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:03.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.671+0000 7f600be00640 1 -- 172.21.15.100:0/1995359802 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6014155df0 msgr2=0x7f60140a6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:03.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.671+0000 7f600be00640 1 --2- 172.21.15.100:0/1995359802 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6014155df0 0x7f60140a6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:03.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.671+0000 7f600be00640 1 -- 172.21.15.100:0/1995359802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f601406df00 msgr2=0x7f601416a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:03.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.671+0000 7f600be00640 1 --2- 172.21.15.100:0/1995359802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f601406df00 0x7f601416a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:03.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.671+0000 7f600be00640 1 -- 172.21.15.100:0/1995359802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc009390 con 0x7f6014155a20 2024-08-17T02:49:03.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.672+0000 7f6018a00640 1 --2- 172.21.15.100:0/1995359802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f601406df00 0x7f601416a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:49:03.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.672+0000 7f600be00640 1 --2- 172.21.15.100:0/1995359802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6014155a20 0x7f60140a6e80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc031000 tx=0x7f5ffc032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:03.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.672+0000 7f6010c00640 1 -- 172.21.15.100:0/1995359802 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc031c00 con 0x7f6014155a20 2024-08-17T02:49:03.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.672+0000 7f6010c00640 1 -- 172.21.15.100:0/1995359802 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ffc031da0 con 0x7f6014155a20 2024-08-17T02:49:03.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.672+0000 7f601b400640 1 -- 172.21.15.100:0/1995359802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601416afb0 con 0x7f6014155a20 2024-08-17T02:49:03.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.672+0000 7f6010c00640 1 -- 172.21.15.100:0/1995359802 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc03d670 con 0x7f6014155a20 2024-08-17T02:49:03.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.672+0000 7f601b400640 1 -- 172.21.15.100:0/1995359802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601416b570 con 0x7f6014155a20 2024-08-17T02:49:03.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.673+0000 7f601b400640 1 -- 172.21.15.100:0/1995359802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60140ab010 con 0x7f6014155a20 2024-08-17T02:49:03.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.674+0000 7f6010c00640 1 -- 172.21.15.100:0/1995359802 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5ffc039040 con 0x7f6014155a20 2024-08-17T02:49:03.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.675+0000 7f6010c00640 1 --2- 172.21.15.100:0/1995359802 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ff0065150 0x7f5ff0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:03.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.675+0000 7f6010c00640 1 -- 172.21.15.100:0/1995359802 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f5ffc0a2570 con 0x7f6014155a20 2024-08-17T02:49:03.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.675+0000 7f6018a00640 1 --2- 172.21.15.100:0/1995359802 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ff0065150 0x7f5ff0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:03.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.676+0000 7f6018a00640 1 --2- 172.21.15.100:0/1995359802 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ff0065150 0x7f5ff0067600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6004007fd0 tx=0x7f6004009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:03.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.679+0000 7f6010c00640 1 -- 172.21.15.100:0/1995359802 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5ffc070960 con 0x7f6014155a20 2024-08-17T02:49:03.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.851+0000 7f601b400640 1 -- 172.21.15.100:0/1995359802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6014064db0 con 0x7f6014155a20 2024-08-17T02:49:03.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.852+0000 7f6010c00640 1 -- 172.21.15.100:0/1995359802 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12445 (secure 0 0 0) 0x7f5ffc037090 con 0x7f6014155a20 2024-08-17T02:49:03.853 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:49:03.853 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":44,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:49:00.452031+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6834/1763367135":"2024-08-18T02:48:57.135611+0000","172.21.15.123:6832/1763367135":"2024-08-18T02:48:57.135611+0000","172.21.15.123:6835/1541092259":"2024-08-18T02:48:50.211886+0000","172.21.15.123:6833/1541092259":"2024-08-18T02:48:50.211886+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:49:03.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.855+0000 7f601b400640 1 -- 172.21.15.100:0/1995359802 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ff0065150 msgr2=0x7f5ff0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:03.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.855+0000 7f601b400640 1 --2- 172.21.15.100:0/1995359802 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ff0065150 0x7f5ff0067600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6004007fd0 tx=0x7f6004009040 comp rx=0 tx=0).stop 2024-08-17T02:49:03.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.855+0000 7f601b400640 1 -- 172.21.15.100:0/1995359802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6014155a20 msgr2=0x7f60140a6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:03.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.855+0000 7f601b400640 1 --2- 172.21.15.100:0/1995359802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6014155a20 0x7f60140a6e80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc031000 tx=0x7f5ffc032000 comp rx=0 tx=0).stop 2024-08-17T02:49:03.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.855+0000 7f601b400640 1 -- 172.21.15.100:0/1995359802 shutdown_connections 2024-08-17T02:49:03.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.855+0000 7f601b400640 1 --2- 172.21.15.100:0/1995359802 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f5ff0065150 0x7f5ff0067600 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:03.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.855+0000 7f601b400640 1 --2- 172.21.15.100:0/1995359802 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6014155df0 0x7f60140a6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:03.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.855+0000 7f601b400640 1 --2- 172.21.15.100:0/1995359802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6014155a20 0x7f60140a6e80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:03.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.855+0000 7f601b400640 1 --2- 172.21.15.100:0/1995359802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f601406df00 0x7f601416a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:03.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.855+0000 7f601b400640 1 -- 172.21.15.100:0/1995359802 >> 172.21.15.100:0/1995359802 conn(0x7f60140cb9b0 msgr2=0x7f60140ad9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:03.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.855+0000 7f601b400640 1 -- 172.21.15.100:0/1995359802 shutdown_connections 2024-08-17T02:49:03.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:03.855+0000 7f601b400640 1 -- 172.21.15.100:0/1995359802 wait complete. 2024-08-17T02:49:03.871 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:49:03.872 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:49:04.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.019+0000 7f7e72200640 1 Processor -- start 2024-08-17T02:49:04.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.019+0000 7f7e72200640 1 -- start start 2024-08-17T02:49:04.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.020+0000 7f7e72200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7e6c158bd0 0x7f7e6c069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:04.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.020+0000 7f7e72200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7e6c0ac710 0x7f7e6c0af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:04.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.020+0000 7f7e72200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e6c0aec20 con 0x7f7e6c069540 2024-08-17T02:49:04.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.020+0000 7f7e72200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e6c0699c0 con 0x7f7e6c158bd0 2024-08-17T02:49:04.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.020+0000 7f7e72200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e6c0acb10 con 0x7f7e6c0ac710 2024-08-17T02:49:04.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.020+0000 7f7e70e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7e6c158bd0 0x7f7e6c069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:04.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.020+0000 7f7e70e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7e6c158bd0 0x7f7e6c069000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37998/0 (socket says 172.21.15.100:37998) 2024-08-17T02:49:04.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.020+0000 7f7e70e00640 1 -- 172.21.15.100:0/3332201510 learned_addr learned my addr 172.21.15.100:0/3332201510 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:04.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.020+0000 7f7e71800640 1 --2- 172.21.15.100:0/3332201510 >> v2:172.21.15.123:3300/0 conn(0x7f7e6c0ac710 0x7f7e6c0af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:04.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.021+0000 7f7e70e00640 1 -- 172.21.15.100:0/3332201510 >> v2:172.21.15.123:3300/0 conn(0x7f7e6c0ac710 msgr2=0x7f7e6c0af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:04.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.021+0000 7f7e70e00640 1 --2- 172.21.15.100:0/3332201510 >> v2:172.21.15.123:3300/0 conn(0x7f7e6c0ac710 0x7f7e6c0af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.021+0000 7f7e70e00640 1 -- 172.21.15.100:0/3332201510 >> v1:172.21.15.123:6789/0 conn(0x7f7e6c069540 legacy=0x7f7e6c0ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:04.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.021+0000 7f7e70e00640 1 -- 172.21.15.100:0/3332201510 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c0ae330 con 0x7f7e6c158bd0 2024-08-17T02:49:04.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.021+0000 7f7e71800640 1 --2- 172.21.15.100:0/3332201510 >> v2:172.21.15.123:3300/0 conn(0x7f7e6c0ac710 0x7f7e6c0af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:04.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.022+0000 7f7e70e00640 1 --2- 172.21.15.100:0/3332201510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e6c158bd0 0x7f7e6c069000 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0aeb90 tx=0x7f7e5c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acdfe236897c05c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:04.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.022+0000 7f7e6be00640 1 -- 172.21.15.100:0/3332201510 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c02ad90 con 0x7f7e6c158bd0 2024-08-17T02:49:04.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.022+0000 7f7e6be00640 1 -- 172.21.15.100:0/3332201510 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c032440 con 0x7f7e6c158bd0 2024-08-17T02:49:04.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.022+0000 7f7e6be00640 1 -- 172.21.15.100:0/3332201510 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c0327e0 con 0x7f7e6c158bd0 2024-08-17T02:49:04.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.022+0000 7f7e72200640 1 -- 172.21.15.100:0/3332201510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e6c158bd0 msgr2=0x7f7e6c069000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:04.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.022+0000 7f7e72200640 1 --2- 172.21.15.100:0/3332201510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e6c158bd0 0x7f7e6c069000 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0aeb90 tx=0x7f7e5c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.022+0000 7f7e72200640 1 -- 172.21.15.100:0/3332201510 shutdown_connections 2024-08-17T02:49:04.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.022+0000 7f7e72200640 1 --2- 172.21.15.100:0/3332201510 >> v2:172.21.15.123:3300/0 conn(0x7f7e6c0ac710 0x7f7e6c0af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.022+0000 7f7e72200640 1 --2- 172.21.15.100:0/3332201510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e6c158bd0 0x7f7e6c069000 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.022+0000 7f7e72200640 1 -- 172.21.15.100:0/3332201510 >> 172.21.15.100:0/3332201510 conn(0x7f7e6c096a70 msgr2=0x7f7e6c0cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:04.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.023+0000 7f7e72200640 1 -- 172.21.15.100:0/3332201510 shutdown_connections 2024-08-17T02:49:04.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.023+0000 7f7e72200640 1 -- 172.21.15.100:0/3332201510 wait complete. 2024-08-17T02:49:04.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.024+0000 7f7e72200640 1 Processor -- start 2024-08-17T02:49:04.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.024+0000 7f7e72200640 1 -- start start 2024-08-17T02:49:04.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.025+0000 7f7e72200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e6c069540 0x7f7e6c1533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:04.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.025+0000 7f7e72200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7e6c0ac710 0x7f7e6c15e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:04.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.025+0000 7f7e72200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e6c158bd0 0x7f7e6c0b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:04.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.025+0000 7f7e72200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c15f6d0 con 0x7f7e6c158bd0 2024-08-17T02:49:04.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.025+0000 7f7e72200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c0c6fd0 con 0x7f7e6c069540 2024-08-17T02:49:04.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.025+0000 7f7e72200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c15f110 con 0x7f7e6c0ac710 2024-08-17T02:49:04.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.025+0000 7f7e71800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e6c158bd0 0x7f7e6c0b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:04.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.025+0000 7f7e71800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e6c158bd0 0x7f7e6c0b0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38006/0 (socket says 172.21.15.100:38006) 2024-08-17T02:49:04.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.025+0000 7f7e71800640 1 -- 172.21.15.100:0/3133356823 learned_addr learned my addr 172.21.15.100:0/3133356823 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:04.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.025+0000 7f7e70e00640 1 --2- 172.21.15.100:0/3133356823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e6c069540 0x7f7e6c1533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:04.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.025+0000 7f7e63e00640 1 --2- 172.21.15.100:0/3133356823 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7e6c0ac710 0x7f7e6c15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:04.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.026+0000 7f7e71800640 1 -- 172.21.15.100:0/3133356823 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7e6c0ac710 msgr2=0x7f7e6c15e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:04.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.026+0000 7f7e71800640 1 --2- 172.21.15.100:0/3133356823 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7e6c0ac710 0x7f7e6c15e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.026+0000 7f7e71800640 1 -- 172.21.15.100:0/3133356823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e6c069540 msgr2=0x7f7e6c1533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:04.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.026+0000 7f7e71800640 1 --2- 172.21.15.100:0/3133356823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e6c069540 0x7f7e6c1533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.026+0000 7f7e71800640 1 -- 172.21.15.100:0/3133356823 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c009450 con 0x7f7e6c158bd0 2024-08-17T02:49:04.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.026+0000 7f7e70e00640 1 --2- 172.21.15.100:0/3133356823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e6c069540 0x7f7e6c1533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:49:04.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.026+0000 7f7e71800640 1 --2- 172.21.15.100:0/3133356823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e6c158bd0 0x7f7e6c0b0c20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400d180 tx=0x7f7e64009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:04.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.026+0000 7f7e68c00640 1 -- 172.21.15.100:0/3133356823 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64015440 con 0x7f7e6c158bd0 2024-08-17T02:49:04.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.026+0000 7f7e68c00640 1 -- 172.21.15.100:0/3133356823 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6400f040 con 0x7f7e6c158bd0 2024-08-17T02:49:04.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.026+0000 7f7e68c00640 1 -- 172.21.15.100:0/3133356823 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64015810 con 0x7f7e6c158bd0 2024-08-17T02:49:04.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.026+0000 7f7e72200640 1 -- 172.21.15.100:0/3133356823 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6c15f3f0 con 0x7f7e6c158bd0 2024-08-17T02:49:04.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.026+0000 7f7e72200640 1 -- 172.21.15.100:0/3133356823 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6c0b3640 con 0x7f7e6c158bd0 2024-08-17T02:49:04.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.027+0000 7f7e72200640 1 -- 172.21.15.100:0/3133356823 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6c071050 con 0x7f7e6c158bd0 2024-08-17T02:49:04.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.028+0000 7f7e68c00640 1 -- 172.21.15.100:0/3133356823 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7e6401e3b0 con 0x7f7e6c158bd0 2024-08-17T02:49:04.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.029+0000 7f7e68c00640 1 --2- 172.21.15.100:0/3133356823 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7e48065180 0x7f7e48067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:04.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.029+0000 7f7e68c00640 1 -- 172.21.15.100:0/3133356823 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7e64082bb0 con 0x7f7e6c158bd0 2024-08-17T02:49:04.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.029+0000 7f7e70e00640 1 --2- 172.21.15.100:0/3133356823 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7e48065180 0x7f7e48067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:04.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.030+0000 7f7e70e00640 1 --2- 172.21.15.100:0/3133356823 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7e48065180 0x7f7e48067630 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c034000 tx=0x7f7e5c032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:04.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.033+0000 7f7e68c00640 1 -- 172.21.15.100:0/3133356823 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7e64050f20 con 0x7f7e6c158bd0 2024-08-17T02:49:04.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.204+0000 7f7e72200640 1 -- 172.21.15.100:0/3133356823 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7e6c0c6ae0 con 0x7f7e48065180 2024-08-17T02:49:04.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.206+0000 7f7e68c00640 1 -- 172.21.15.100:0/3133356823 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50799 (secure 0 0 0) 0x7f7e5c0327f0 con 0x7f7e48065180 2024-08-17T02:49:04.207 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:49:04.208 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-08-17T02:49:04.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.209+0000 7f7e72200640 1 -- 172.21.15.100:0/3133356823 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7e48065180 msgr2=0x7f7e48067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:04.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.209+0000 7f7e72200640 1 --2- 172.21.15.100:0/3133356823 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7e48065180 0x7f7e48067630 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c034000 tx=0x7f7e5c032000 comp rx=0 tx=0).stop 2024-08-17T02:49:04.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.209+0000 7f7e72200640 1 -- 172.21.15.100:0/3133356823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e6c158bd0 msgr2=0x7f7e6c0b0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:04.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.209+0000 7f7e72200640 1 --2- 172.21.15.100:0/3133356823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e6c158bd0 0x7f7e6c0b0c20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400d180 tx=0x7f7e64009a50 comp rx=0 tx=0).stop 2024-08-17T02:49:04.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.209+0000 7f7e72200640 1 -- 172.21.15.100:0/3133356823 shutdown_connections 2024-08-17T02:49:04.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.209+0000 7f7e72200640 1 --2- 172.21.15.100:0/3133356823 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7e48065180 0x7f7e48067630 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.209+0000 7f7e72200640 1 --2- 172.21.15.100:0/3133356823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e6c158bd0 0x7f7e6c0b0c20 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.209+0000 7f7e72200640 1 --2- 172.21.15.100:0/3133356823 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7e6c0ac710 0x7f7e6c15e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.209+0000 7f7e72200640 1 --2- 172.21.15.100:0/3133356823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e6c069540 0x7f7e6c1533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.209+0000 7f7e72200640 1 -- 172.21.15.100:0/3133356823 >> 172.21.15.100:0/3133356823 conn(0x7f7e6c096a70 msgr2=0x7f7e6c0af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:04.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.209+0000 7f7e72200640 1 -- 172.21.15.100:0/3133356823 shutdown_connections 2024-08-17T02:49:04.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.209+0000 7f7e72200640 1 -- 172.21.15.100:0/3133356823 wait complete. 2024-08-17T02:49:04.225 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-08-17T02:49:03.138587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2388012,"kb_used_data":4996,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586708,"statfs":{"total":773094113280,"available":770648788992,"internally_reserved":0,"allocated":5115904,"data_stored":2798065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001028"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-08-17T02:48:53.630222+0000","last_change":"2024-08-17T02:45:37.011679+0000","last_active":"2024-08-17T02:48:53.630222+0000","last_peered":"2024-08-17T02:48:53.630222+0000","last_clean":"2024-08-17T02:48:53.630222+0000","last_became_active":"2024-08-17T02:45:37.010559+0000","last_became_peered":"2024-08-17T02:45:37.010559+0000","last_unstale":"2024-08-17T02:48:53.630222+0000","last_undegraded":"2024-08-17T02:48:53.630222+0000","last_fullsized":"2024-08-17T02:48:53.630222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:35.708391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:35.708391+0000","last_clean_scrub_stamp":"2024-08-17T02:45:35.708391+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:11.380093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542187,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302576,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069264,"statfs":{"total":96636764160,"available":96326926336,"internally_reserved":0,"allocated":1085440,"data_stored":794365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.65400000000000003,"15min":0.628},"min":{"1min":0.55500000000000005,"5min":0.372,"15min":0.372},"max":{"1min":0.91400000000000003,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.68700000000000006,"15min":0.66900000000000004},"min":{"1min":0.497,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90500000000000003,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.57899999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.70099999999999996,"15min":0.68200000000000005},"min":{"1min":0.624,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95399999999999996,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.68799999999999994,"15min":0.65900000000000003},"min":{"1min":0.58399999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.89400000000000002,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.498}]},{"osd":2,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69399999999999995,"15min":0.67200000000000004},"min":{"1min":0.60699999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88100000000000001,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73399999999999999,"15min":0.71999999999999997},"min":{"1min":0.65100000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92600000000000005,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.65400000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.70799999999999996,"15min":0.68799999999999994},"min":{"1min":0.63,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92900000000000005,"5min":1.034,"15min":1.034},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.747,"15min":0.745},"min":{"1min":0.60199999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.95799999999999996,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.56599999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66500000000000004,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.746,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64000000000000001,"15min":0.64900000000000002},"min":{"1min":0.47999999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.871,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.83499999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66800000000000004,"15min":0.68999999999999995},"min":{"1min":0.49399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98199999999999998,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.69199999999999995,"15min":0.70999999999999996},"min":{"1min":0.47899999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88,"5min":1.071,"15min":1.071},"last":0.63600000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.876,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.70899999999999996,"15min":0.72799999999999998},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.78700000000000003,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.90200000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542187,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297832,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074008,"statfs":{"total":96636764160,"available":96331784192,"internally_reserved":0,"allocated":483328,"data_stored":198366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":1.0569999999999999,"15min":1.198},"min":{"1min":0.52400000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0389999999999999,"5min":12.430999999999999,"15min":12.430999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.97799999999999998,"15min":1.0940000000000001},"min":{"1min":0.57299999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95799999999999996,"5min":10.391,"15min":10.391},"last":0.64500000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":1.044,"15min":1.1839999999999999},"min":{"1min":0.59099999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96499999999999997,"5min":11.654,"15min":11.654},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":1.044,"15min":1.1779999999999999},"min":{"1min":0.59499999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97599999999999998,"5min":11.484,"15min":11.484},"last":0.57799999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71599999999999997,"15min":0.70799999999999996},"min":{"1min":0.5,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90700000000000003,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":1.0620000000000001,"15min":1.2090000000000001},"min":{"1min":0.55500000000000005,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.94299999999999995,"5min":12.025,"15min":12.025},"last":0.65900000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":1.079,"15min":1.23},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98099999999999998,"5min":12.073,"15min":12.073},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":1.083,"15min":1.2230000000000001},"min":{"1min":0.60099999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.0129999999999999,"5min":12.374000000000001,"15min":12.374000000000001},"last":0.628}]},{"osd":4,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.96899999999999997,"15min":1.131},"min":{"1min":0.42599999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.88100000000000001,"5min":11.545999999999999,"15min":11.545999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.64200000000000002,"15min":0.66900000000000004},"min":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79900000000000004,"5min":2.202,"15min":2.202},"last":0.44}]},{"osd":5,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":1.02,"15min":1.212},"min":{"1min":0.45500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.80100000000000005,"5min":12.111000000000001,"15min":12.111000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":1.042,"15min":1.2170000000000001},"min":{"1min":0.443,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0649999999999999,"5min":12.477,"15min":12.477},"last":0.53500000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.97099999999999997,"15min":1.115},"min":{"1min":0.502,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94099999999999995,"5min":10.526999999999999,"15min":10.526999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":1.1399999999999999,"15min":1.3340000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.86099999999999999,"5min":13.638,"15min":13.638},"last":0.70799999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542188,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297836,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074004,"statfs":{"total":96636764160,"available":96331780096,"internally_reserved":0,"allocated":491520,"data_stored":203977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63100000000000001,"15min":0.60899999999999999},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.79500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65100000000000002,"15min":0.63800000000000001},"min":{"1min":0.54300000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.81899999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63500000000000001,"15min":0.621},"min":{"1min":0.51100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.86699999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66000000000000003,"15min":0.63800000000000001},"min":{"1min":0.58999999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84699999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.86399999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.624},"min":{"1min":0.46600000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86599999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.51000000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.84399999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.69599999999999995,"15min":0.68999999999999995},"min":{"1min":0.56999999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.85899999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69099999999999995,"15min":0.68100000000000005},"min":{"1min":0.59499999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.89400000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":1.024}]},{"osd":4,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78700000000000003,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.623},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60099999999999998,"15min":0.60399999999999998},"min":{"1min":0.45400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.58899999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.65300000000000002,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80700000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.83399999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68600000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69499999999999995,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90300000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":1.012},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.82699999999999996,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76200000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297832,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074008,"statfs":{"total":96636764160,"available":96331784192,"internally_reserved":0,"allocated":487424,"data_stored":199258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67100000000000004,"15min":0.63900000000000001},"min":{"1min":0.50600000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88900000000000001,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63600000000000001,"15min":0.61499999999999999},"min":{"1min":0.52700000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.80000000000000004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.70699999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63900000000000001,"15min":0.61799999999999999},"min":{"1min":0.51500000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.79300000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65900000000000003,"15min":0.63500000000000001},"min":{"1min":0.51700000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84999999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65700000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68799999999999994,"15min":0.66600000000000004},"min":{"1min":0.55300000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86899999999999999,"5min":1.286,"15min":1.286},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71799999999999997,"15min":0.69799999999999995},"min":{"1min":0.56899999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.85599999999999998,"5min":1.609,"15min":1.609},"last":0.66900000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.69899999999999995,"15min":0.67900000000000005},"min":{"1min":0.59699999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85099999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67500000000000004,"15min":0.64900000000000002},"min":{"1min":0.57699999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84499999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.58199999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.66300000000000003,"15min":0.68500000000000005},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.752,"5min":1.077,"15min":1.077},"last":0.75},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92100000000000004,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.62}]},{"osd":6,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63700000000000001,"15min":0.65700000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90400000000000003,"5min":1.198,"15min":1.198},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.88700000000000001,"5min":1.145,"15min":1.145},"last":0.628}]},{"osd":7,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.48499999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88500000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.83799999999999997,"5min":1.101,"15min":1.101},"last":0.61199999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542188,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297844,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":499712,"data_stored":204533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.29699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67000000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.47299999999999998,"15min":0.45900000000000002},"min":{"1min":0.311,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74099999999999999,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.33800000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65500000000000003,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.41799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76700000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.69199999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64100000000000001,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.434},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55700000000000005,"15min":0.55100000000000005},"min":{"1min":0.46300000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.56699999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.74099999999999999,"15min":0.71799999999999997},"min":{"1min":0.65100000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.75600000000000001,"15min":0.752},"min":{"1min":0.58399999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.042,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.55400000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.75700000000000001,"15min":0.747},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2,"5min":1.212,"15min":1.212},"last":0.629},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77500000000000002,"15min":0.77100000000000002},"min":{"1min":0.628,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.90900000000000003,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78400000000000003,"15min":0.77800000000000002},"min":{"1min":0.61899999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0249999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80800000000000005,"15min":0.79000000000000004},"min":{"1min":0.64500000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.66400000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.78200000000000003,"15min":0.75800000000000001},"min":{"1min":0.628,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.63300000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.58999999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542187,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297848,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":503808,"data_stored":205481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.44800000000000001,"15min":0.44},"min":{"1min":0.35699999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67200000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44900000000000001,"15min":0.44600000000000001},"min":{"1min":0.35099999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.57099999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.40999999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.495,"15min":0.497},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.63900000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.42099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.60999999999999999,"5min":1.139,"15min":1.139},"last":0.38100000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.48399999999999999,"15min":0.46200000000000002},"min":{"1min":0.42499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.58899999999999997,"15min":0.57799999999999996},"min":{"1min":0.49099999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72499999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.48399999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.77600000000000002,"15min":0.77400000000000002},"min":{"1min":0.67200000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.997,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.75900000000000001,"15min":0.747},"min":{"1min":0.621,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.72199999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.78000000000000003,"15min":0.77800000000000002},"min":{"1min":0.64200000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.002,"5min":1.135,"15min":1.135},"last":0.79100000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.80300000000000005,"15min":0.80500000000000005},"min":{"1min":0.61599999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0569999999999999,"5min":1.103,"15min":1.103},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.80700000000000005,"15min":0.79900000000000004},"min":{"1min":0.70599999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.77300000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.82099999999999995,"15min":0.81699999999999995},"min":{"1min":0.68600000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.61799999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0209999999999999,"5min":1.038,"15min":1.038},"last":0.90000000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542187,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297836,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074004,"statfs":{"total":96636764160,"available":96331780096,"internally_reserved":0,"allocated":491520,"data_stored":203977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.40999999999999998},"min":{"1min":0.312,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66000000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.314},{"interface":"front","average":{"1min":0.496,"5min":0.44700000000000001,"15min":0.42999999999999999},"min":{"1min":0.37,"5min":0.246,"15min":0.246},"max":{"1min":0.63300000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.439}]},{"osd":2,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.39700000000000002,"15min":0.373},"min":{"1min":0.35399999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.40799999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.69799999999999995,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.54600000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59399999999999997,"15min":0.57299999999999995},"min":{"1min":0.53100000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78900000000000003,"5min":1.054,"15min":1.054},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.75700000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.69099999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.63,"15min":0.59799999999999998},"min":{"1min":0.50600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66500000000000004,"15min":0.64300000000000002},"min":{"1min":0.59599999999999997,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.091,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.59499999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.65800000000000003,"15min":0.63400000000000001},"min":{"1min":0.56100000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93799999999999994,"5min":1.002,"15min":1.002},"last":0.63},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.66300000000000003,"15min":0.64300000000000002},"min":{"1min":0.55600000000000005,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.998,"5min":1.042,"15min":1.042},"last":0.66700000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.73199999999999998,"15min":0.71799999999999997},"min":{"1min":0.65400000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.995,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.73099999999999998,"15min":0.70399999999999996},"min":{"1min":0.627,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.054,"5min":1.256,"15min":1.256},"last":0.61399999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.57999999999999996,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.749,"15min":0.73099999999999998},"min":{"1min":0.73599999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0229999999999999,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.746}]}]},{"osd":0,"up_from":14,"seq":60129542188,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298408,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073432,"statfs":{"total":96636764160,"available":96331194368,"internally_reserved":0,"allocated":1073152,"data_stored":788108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.434,"15min":0.442},"min":{"1min":0.32200000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66300000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.50600000000000001},"min":{"1min":0.42499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75700000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48099999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51600000000000001,"15min":0.53100000000000003},"min":{"1min":0.40300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.65400000000000003,"5min":0.878,"15min":0.878},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.53500000000000003,"15min":0.54700000000000004},"min":{"1min":0.375,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.63200000000000001,"5min":1.111,"15min":1.111},"last":0.36899999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.498,"15min":0.48399999999999999},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77600000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.51600000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.91000000000000003,"5min":1.115,"15min":1.115},"last":0.46300000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72699999999999998,"15min":0.71399999999999997},"min":{"1min":0.503,"5min":0.496,"15min":0.496},"max":{"1min":0.90900000000000003,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.78000000000000003,"15min":0.79000000000000004},"min":{"1min":0.62,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96699999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.67600000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73299999999999998,"15min":0.73099999999999998},"min":{"1min":0.54500000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75,"15min":0.73799999999999999},"min":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66100000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.81699999999999995,"15min":0.81299999999999994},"min":{"1min":0.623,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0760000000000001,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.79000000000000004,"15min":0.77400000000000002},"min":{"1min":0.68600000000000005,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.59799999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79800000000000004,"15min":0.78800000000000003},"min":{"1min":0.63200000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.089,"5min":1.091,"15min":1.091},"last":0.748},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79800000000000004,"15min":0.79400000000000004},"min":{"1min":0.57599999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.73899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:49:04.227 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:49:04.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.374+0000 7f0056400640 1 Processor -- start 2024-08-17T02:49:04.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.374+0000 7f0056400640 1 -- start start 2024-08-17T02:49:04.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.376+0000 7f0056400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0050155a20 0x7f00500adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:04.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.376+0000 7f0056400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f005006df00 0x7f00500ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:04.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.376+0000 7f0056400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0050156670 con 0x7f0050155df0 2024-08-17T02:49:04.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.376+0000 7f0056400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00500b0350 con 0x7f005006df00 2024-08-17T02:49:04.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.376+0000 7f0056400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005006e5e0 con 0x7f0050155a20 2024-08-17T02:49:04.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.376+0000 7f0047e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0050155df0 0x7f005006d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38254/0 (socket says 172.21.15.100:38254) 2024-08-17T02:49:04.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.376+0000 7f0047e00640 1 -- 172.21.15.100:0/1066866747 learned_addr learned my addr 172.21.15.100:0/1066866747 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:49:04.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.376+0000 7f004fe00640 1 --2- 172.21.15.100:0/1066866747 >> v2:172.21.15.123:3300/0 conn(0x7f005006df00 0x7f00500ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:04.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.376+0000 7f004f400640 1 --2- 172.21.15.100:0/1066866747 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0050155a20 0x7f00500adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:04.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.376+0000 7f004fe00640 1 -- 172.21.15.100:0/1066866747 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0050155a20 msgr2=0x7f00500adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:04.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.376+0000 7f004fe00640 1 --2- 172.21.15.100:0/1066866747 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0050155a20 0x7f00500adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.376+0000 7f004fe00640 1 -- 172.21.15.100:0/1066866747 >> v1:172.21.15.100:6789/0 conn(0x7f0050155df0 legacy=0x7f005006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:04.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.376+0000 7f004fe00640 1 -- 172.21.15.100:0/1066866747 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005006e8c0 con 0x7f005006df00 2024-08-17T02:49:04.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.376+0000 7f004ea00640 1 -- 172.21.15.100:0/1066866747 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48268755 0 0) 0x7f0050156670 con 0x7f0050155df0 2024-08-17T02:49:04.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.376+0000 7f004f400640 1 --2- 172.21.15.100:0/1066866747 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0050155a20 0x7f00500adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:49:04.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.377+0000 7f004fe00640 1 --2- 172.21.15.100:0/1066866747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f005006df00 0x7f00500ad9b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0048009e60 tx=0x7f0048009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd09507168df2aff server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:04.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.378+0000 7f004ea00640 1 -- 172.21.15.100:0/1066866747 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0048007550 con 0x7f005006df00 2024-08-17T02:49:04.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.378+0000 7f004ea00640 1 -- 172.21.15.100:0/1066866747 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004802d050 con 0x7f005006df00 2024-08-17T02:49:04.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.378+0000 7f004ea00640 1 -- 172.21.15.100:0/1066866747 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00480078e0 con 0x7f005006df00 2024-08-17T02:49:04.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.378+0000 7f0056400640 1 -- 172.21.15.100:0/1066866747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f005006df00 msgr2=0x7f00500ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:04.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.378+0000 7f0056400640 1 --2- 172.21.15.100:0/1066866747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f005006df00 0x7f00500ad9b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0048009e60 tx=0x7f0048009780 comp rx=0 tx=0).stop 2024-08-17T02:49:04.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.378+0000 7f0056400640 1 -- 172.21.15.100:0/1066866747 shutdown_connections 2024-08-17T02:49:04.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.378+0000 7f0056400640 1 --2- 172.21.15.100:0/1066866747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f005006df00 0x7f00500ad9b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.378+0000 7f0056400640 1 --2- 172.21.15.100:0/1066866747 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0050155a20 0x7f00500adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.378+0000 7f0056400640 1 -- 172.21.15.100:0/1066866747 >> 172.21.15.100:0/1066866747 conn(0x7f00500cb9b0 msgr2=0x7f00500cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:04.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.378+0000 7f0056400640 1 -- 172.21.15.100:0/1066866747 shutdown_connections 2024-08-17T02:49:04.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.378+0000 7f0056400640 1 -- 172.21.15.100:0/1066866747 wait complete. 2024-08-17T02:49:04.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.380+0000 7f0056400640 1 Processor -- start 2024-08-17T02:49:04.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.380+0000 7f0056400640 1 -- start start 2024-08-17T02:49:04.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.381+0000 7f0056400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f005006df00 0x7f00500ace70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:04.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.381+0000 7f0056400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0050155a20 0x7f00500ab510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:04.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.381+0000 7f0056400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0050155df0 0x7f005014fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:04.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.381+0000 7f0056400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00500ad3b0 con 0x7f005006df00 2024-08-17T02:49:04.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.381+0000 7f0056400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00500ac9e0 con 0x7f0050155a20 2024-08-17T02:49:04.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.381+0000 7f0056400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00500abdd0 con 0x7f0050155df0 2024-08-17T02:49:04.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.381+0000 7f004f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f005006df00 0x7f00500ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:04.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.381+0000 7f004f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f005006df00 0x7f00500ace70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38018/0 (socket says 172.21.15.100:38018) 2024-08-17T02:49:04.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.381+0000 7f004f400640 1 -- 172.21.15.100:0/1133071416 learned_addr learned my addr 172.21.15.100:0/1133071416 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:04.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.381+0000 7f004fe00640 1 --2- 172.21.15.100:0/1133071416 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0050155df0 0x7f005014fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:04.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.381+0000 7f0047e00640 1 --2- 172.21.15.100:0/1133071416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0050155a20 0x7f00500ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:04.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.381+0000 7f004f400640 1 -- 172.21.15.100:0/1133071416 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0050155df0 msgr2=0x7f005014fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:04.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.381+0000 7f004f400640 1 --2- 172.21.15.100:0/1133071416 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0050155df0 0x7f005014fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.381+0000 7f004f400640 1 -- 172.21.15.100:0/1133071416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0050155a20 msgr2=0x7f00500ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:04.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.381+0000 7f004f400640 1 --2- 172.21.15.100:0/1133071416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0050155a20 0x7f00500ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.381+0000 7f004f400640 1 -- 172.21.15.100:0/1133071416 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0040009390 con 0x7f005006df00 2024-08-17T02:49:04.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.381+0000 7f004fe00640 1 --2- 172.21.15.100:0/1133071416 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0050155df0 0x7f005014fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:04.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.382+0000 7f004f400640 1 --2- 172.21.15.100:0/1133071416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f005006df00 0x7f00500ace70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f004000ec80 tx=0x7f00400090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:04.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.382+0000 7f0046a00640 1 -- 172.21.15.100:0/1133071416 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004000eec0 con 0x7f005006df00 2024-08-17T02:49:04.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.382+0000 7f0046a00640 1 -- 172.21.15.100:0/1133071416 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004000cbc0 con 0x7f005006df00 2024-08-17T02:49:04.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.382+0000 7f0046a00640 1 -- 172.21.15.100:0/1133071416 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0040013470 con 0x7f005006df00 2024-08-17T02:49:04.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.382+0000 7f0056400640 1 -- 172.21.15.100:0/1133071416 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0048009a20 con 0x7f005006df00 2024-08-17T02:49:04.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.382+0000 7f0056400640 1 -- 172.21.15.100:0/1133071416 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00500ac390 con 0x7f005006df00 2024-08-17T02:49:04.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.383+0000 7f0056400640 1 -- 172.21.15.100:0/1133071416 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0050064db0 con 0x7f005006df00 2024-08-17T02:49:04.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.384+0000 7f0046a00640 1 -- 172.21.15.100:0/1133071416 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f00400137e0 con 0x7f005006df00 2024-08-17T02:49:04.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.385+0000 7f0046a00640 1 --2- 172.21.15.100:0/1133071416 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f002c065150 0x7f002c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:04.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.385+0000 7f0046a00640 1 -- 172.21.15.100:0/1133071416 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0040082580 con 0x7f005006df00 2024-08-17T02:49:04.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.386+0000 7f0047e00640 1 --2- 172.21.15.100:0/1133071416 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f002c065150 0x7f002c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:04.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.386+0000 7f0047e00640 1 --2- 172.21.15.100:0/1133071416 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f002c065150 0x7f002c067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0050150fa0 tx=0x7f0038009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:04.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.389+0000 7f0046a00640 1 -- 172.21.15.100:0/1133071416 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0040050840 con 0x7f005006df00 2024-08-17T02:49:04.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.559+0000 7f0056400640 1 -- 172.21.15.100:0/1133071416 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00500acb20 con 0x7f002c065150 2024-08-17T02:49:04.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.561+0000 7f0046a00640 1 -- 172.21.15.100:0/1133071416 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50799 (secure 0 0 0) 0x7f003800c450 con 0x7f002c065150 2024-08-17T02:49:04.562 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:49:04.562 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-08-17T02:49:04.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.563+0000 7f0056400640 1 -- 172.21.15.100:0/1133071416 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f002c065150 msgr2=0x7f002c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:04.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.563+0000 7f0056400640 1 --2- 172.21.15.100:0/1133071416 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f002c065150 0x7f002c067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0050150fa0 tx=0x7f0038009040 comp rx=0 tx=0).stop 2024-08-17T02:49:04.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.563+0000 7f0056400640 1 -- 172.21.15.100:0/1133071416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f005006df00 msgr2=0x7f00500ace70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:04.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.563+0000 7f0056400640 1 --2- 172.21.15.100:0/1133071416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f005006df00 0x7f00500ace70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f004000ec80 tx=0x7f00400090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.563+0000 7f0056400640 1 -- 172.21.15.100:0/1133071416 shutdown_connections 2024-08-17T02:49:04.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.563+0000 7f0056400640 1 --2- 172.21.15.100:0/1133071416 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f002c065150 0x7f002c067600 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.563+0000 7f0056400640 1 --2- 172.21.15.100:0/1133071416 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0050155df0 0x7f005014fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.563+0000 7f0056400640 1 --2- 172.21.15.100:0/1133071416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0050155a20 0x7f00500ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.563+0000 7f0056400640 1 --2- 172.21.15.100:0/1133071416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f005006df00 0x7f00500ace70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.563+0000 7f0056400640 1 -- 172.21.15.100:0/1133071416 >> 172.21.15.100:0/1133071416 conn(0x7f00500cb9b0 msgr2=0x7f0050157a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:04.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.563+0000 7f0056400640 1 -- 172.21.15.100:0/1133071416 shutdown_connections 2024-08-17T02:49:04.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.563+0000 7f0056400640 1 -- 172.21.15.100:0/1133071416 wait complete. 2024-08-17T02:49:04.578 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-08-17T02:49:03.138587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2388012,"kb_used_data":4996,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586708,"statfs":{"total":773094113280,"available":770648788992,"internally_reserved":0,"allocated":5115904,"data_stored":2798065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001028"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-08-17T02:48:53.630222+0000","last_change":"2024-08-17T02:45:37.011679+0000","last_active":"2024-08-17T02:48:53.630222+0000","last_peered":"2024-08-17T02:48:53.630222+0000","last_clean":"2024-08-17T02:48:53.630222+0000","last_became_active":"2024-08-17T02:45:37.010559+0000","last_became_peered":"2024-08-17T02:45:37.010559+0000","last_unstale":"2024-08-17T02:48:53.630222+0000","last_undegraded":"2024-08-17T02:48:53.630222+0000","last_fullsized":"2024-08-17T02:48:53.630222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:35.708391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:35.708391+0000","last_clean_scrub_stamp":"2024-08-17T02:45:35.708391+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:11.380093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542187,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302576,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069264,"statfs":{"total":96636764160,"available":96326926336,"internally_reserved":0,"allocated":1085440,"data_stored":794365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.65400000000000003,"15min":0.628},"min":{"1min":0.55500000000000005,"5min":0.372,"15min":0.372},"max":{"1min":0.91400000000000003,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.68700000000000006,"15min":0.66900000000000004},"min":{"1min":0.497,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90500000000000003,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.57899999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.70099999999999996,"15min":0.68200000000000005},"min":{"1min":0.624,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95399999999999996,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.68799999999999994,"15min":0.65900000000000003},"min":{"1min":0.58399999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.89400000000000002,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.498}]},{"osd":2,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69399999999999995,"15min":0.67200000000000004},"min":{"1min":0.60699999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88100000000000001,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73399999999999999,"15min":0.71999999999999997},"min":{"1min":0.65100000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92600000000000005,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.65400000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.70799999999999996,"15min":0.68799999999999994},"min":{"1min":0.63,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92900000000000005,"5min":1.034,"15min":1.034},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.747,"15min":0.745},"min":{"1min":0.60199999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.95799999999999996,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.56599999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66500000000000004,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.746,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64000000000000001,"15min":0.64900000000000002},"min":{"1min":0.47999999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.871,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.83499999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66800000000000004,"15min":0.68999999999999995},"min":{"1min":0.49399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98199999999999998,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.69199999999999995,"15min":0.70999999999999996},"min":{"1min":0.47899999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88,"5min":1.071,"15min":1.071},"last":0.63600000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.876,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.70899999999999996,"15min":0.72799999999999998},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.78700000000000003,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.90200000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542187,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297832,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074008,"statfs":{"total":96636764160,"available":96331784192,"internally_reserved":0,"allocated":483328,"data_stored":198366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":1.0569999999999999,"15min":1.198},"min":{"1min":0.52400000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0389999999999999,"5min":12.430999999999999,"15min":12.430999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.97799999999999998,"15min":1.0940000000000001},"min":{"1min":0.57299999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95799999999999996,"5min":10.391,"15min":10.391},"last":0.64500000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":1.044,"15min":1.1839999999999999},"min":{"1min":0.59099999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96499999999999997,"5min":11.654,"15min":11.654},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":1.044,"15min":1.1779999999999999},"min":{"1min":0.59499999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97599999999999998,"5min":11.484,"15min":11.484},"last":0.57799999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71599999999999997,"15min":0.70799999999999996},"min":{"1min":0.5,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90700000000000003,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":1.0620000000000001,"15min":1.2090000000000001},"min":{"1min":0.55500000000000005,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.94299999999999995,"5min":12.025,"15min":12.025},"last":0.65900000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":1.079,"15min":1.23},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98099999999999998,"5min":12.073,"15min":12.073},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":1.083,"15min":1.2230000000000001},"min":{"1min":0.60099999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.0129999999999999,"5min":12.374000000000001,"15min":12.374000000000001},"last":0.628}]},{"osd":4,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.96899999999999997,"15min":1.131},"min":{"1min":0.42599999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.88100000000000001,"5min":11.545999999999999,"15min":11.545999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.64200000000000002,"15min":0.66900000000000004},"min":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79900000000000004,"5min":2.202,"15min":2.202},"last":0.44}]},{"osd":5,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":1.02,"15min":1.212},"min":{"1min":0.45500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.80100000000000005,"5min":12.111000000000001,"15min":12.111000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":1.042,"15min":1.2170000000000001},"min":{"1min":0.443,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0649999999999999,"5min":12.477,"15min":12.477},"last":0.53500000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.97099999999999997,"15min":1.115},"min":{"1min":0.502,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94099999999999995,"5min":10.526999999999999,"15min":10.526999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":1.1399999999999999,"15min":1.3340000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.86099999999999999,"5min":13.638,"15min":13.638},"last":0.70799999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542188,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297836,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074004,"statfs":{"total":96636764160,"available":96331780096,"internally_reserved":0,"allocated":491520,"data_stored":203977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63100000000000001,"15min":0.60899999999999999},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.79500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65100000000000002,"15min":0.63800000000000001},"min":{"1min":0.54300000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.81899999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63500000000000001,"15min":0.621},"min":{"1min":0.51100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.86699999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66000000000000003,"15min":0.63800000000000001},"min":{"1min":0.58999999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84699999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.86399999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.624},"min":{"1min":0.46600000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86599999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.51000000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.84399999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.69599999999999995,"15min":0.68999999999999995},"min":{"1min":0.56999999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.85899999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69099999999999995,"15min":0.68100000000000005},"min":{"1min":0.59499999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.89400000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":1.024}]},{"osd":4,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78700000000000003,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.623},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60099999999999998,"15min":0.60399999999999998},"min":{"1min":0.45400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.58899999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.65300000000000002,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80700000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.83399999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68600000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69499999999999995,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90300000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":1.012},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.82699999999999996,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76200000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297832,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074008,"statfs":{"total":96636764160,"available":96331784192,"internally_reserved":0,"allocated":487424,"data_stored":199258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67100000000000004,"15min":0.63900000000000001},"min":{"1min":0.50600000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88900000000000001,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63600000000000001,"15min":0.61499999999999999},"min":{"1min":0.52700000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.80000000000000004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.70699999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63900000000000001,"15min":0.61799999999999999},"min":{"1min":0.51500000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.79300000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65900000000000003,"15min":0.63500000000000001},"min":{"1min":0.51700000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84999999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65700000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68799999999999994,"15min":0.66600000000000004},"min":{"1min":0.55300000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86899999999999999,"5min":1.286,"15min":1.286},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71799999999999997,"15min":0.69799999999999995},"min":{"1min":0.56899999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.85599999999999998,"5min":1.609,"15min":1.609},"last":0.66900000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.69899999999999995,"15min":0.67900000000000005},"min":{"1min":0.59699999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85099999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67500000000000004,"15min":0.64900000000000002},"min":{"1min":0.57699999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84499999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.58199999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.66300000000000003,"15min":0.68500000000000005},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.752,"5min":1.077,"15min":1.077},"last":0.75},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92100000000000004,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.62}]},{"osd":6,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63700000000000001,"15min":0.65700000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90400000000000003,"5min":1.198,"15min":1.198},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.88700000000000001,"5min":1.145,"15min":1.145},"last":0.628}]},{"osd":7,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.48499999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88500000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.83799999999999997,"5min":1.101,"15min":1.101},"last":0.61199999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542188,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297844,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":499712,"data_stored":204533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.29699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67000000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.47299999999999998,"15min":0.45900000000000002},"min":{"1min":0.311,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74099999999999999,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.33800000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65500000000000003,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.41799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76700000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.69199999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64100000000000001,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.434},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55700000000000005,"15min":0.55100000000000005},"min":{"1min":0.46300000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.56699999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.74099999999999999,"15min":0.71799999999999997},"min":{"1min":0.65100000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.75600000000000001,"15min":0.752},"min":{"1min":0.58399999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.042,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.55400000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.75700000000000001,"15min":0.747},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2,"5min":1.212,"15min":1.212},"last":0.629},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77500000000000002,"15min":0.77100000000000002},"min":{"1min":0.628,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.90900000000000003,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78400000000000003,"15min":0.77800000000000002},"min":{"1min":0.61899999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0249999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80800000000000005,"15min":0.79000000000000004},"min":{"1min":0.64500000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.66400000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.78200000000000003,"15min":0.75800000000000001},"min":{"1min":0.628,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.63300000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.58999999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542187,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297848,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":503808,"data_stored":205481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.44800000000000001,"15min":0.44},"min":{"1min":0.35699999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67200000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44900000000000001,"15min":0.44600000000000001},"min":{"1min":0.35099999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.57099999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.40999999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.495,"15min":0.497},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.63900000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.42099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.60999999999999999,"5min":1.139,"15min":1.139},"last":0.38100000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.48399999999999999,"15min":0.46200000000000002},"min":{"1min":0.42499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.58899999999999997,"15min":0.57799999999999996},"min":{"1min":0.49099999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72499999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.48399999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.77600000000000002,"15min":0.77400000000000002},"min":{"1min":0.67200000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.997,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.75900000000000001,"15min":0.747},"min":{"1min":0.621,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.72199999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.78000000000000003,"15min":0.77800000000000002},"min":{"1min":0.64200000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.002,"5min":1.135,"15min":1.135},"last":0.79100000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.80300000000000005,"15min":0.80500000000000005},"min":{"1min":0.61599999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0569999999999999,"5min":1.103,"15min":1.103},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.80700000000000005,"15min":0.79900000000000004},"min":{"1min":0.70599999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.77300000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.82099999999999995,"15min":0.81699999999999995},"min":{"1min":0.68600000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.61799999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0209999999999999,"5min":1.038,"15min":1.038},"last":0.90000000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542187,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297836,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074004,"statfs":{"total":96636764160,"available":96331780096,"internally_reserved":0,"allocated":491520,"data_stored":203977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.40999999999999998},"min":{"1min":0.312,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66000000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.314},{"interface":"front","average":{"1min":0.496,"5min":0.44700000000000001,"15min":0.42999999999999999},"min":{"1min":0.37,"5min":0.246,"15min":0.246},"max":{"1min":0.63300000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.439}]},{"osd":2,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.39700000000000002,"15min":0.373},"min":{"1min":0.35399999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.40799999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.69799999999999995,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.54600000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59399999999999997,"15min":0.57299999999999995},"min":{"1min":0.53100000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78900000000000003,"5min":1.054,"15min":1.054},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.75700000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.69099999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.63,"15min":0.59799999999999998},"min":{"1min":0.50600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66500000000000004,"15min":0.64300000000000002},"min":{"1min":0.59599999999999997,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.091,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.59499999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.65800000000000003,"15min":0.63400000000000001},"min":{"1min":0.56100000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93799999999999994,"5min":1.002,"15min":1.002},"last":0.63},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.66300000000000003,"15min":0.64300000000000002},"min":{"1min":0.55600000000000005,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.998,"5min":1.042,"15min":1.042},"last":0.66700000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.73199999999999998,"15min":0.71799999999999997},"min":{"1min":0.65400000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.995,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.73099999999999998,"15min":0.70399999999999996},"min":{"1min":0.627,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.054,"5min":1.256,"15min":1.256},"last":0.61399999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.57999999999999996,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.749,"15min":0.73099999999999998},"min":{"1min":0.73599999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0229999999999999,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.746}]}]},{"osd":0,"up_from":14,"seq":60129542188,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298408,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073432,"statfs":{"total":96636764160,"available":96331194368,"internally_reserved":0,"allocated":1073152,"data_stored":788108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.434,"15min":0.442},"min":{"1min":0.32200000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66300000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.50600000000000001},"min":{"1min":0.42499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75700000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48099999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51600000000000001,"15min":0.53100000000000003},"min":{"1min":0.40300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.65400000000000003,"5min":0.878,"15min":0.878},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.53500000000000003,"15min":0.54700000000000004},"min":{"1min":0.375,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.63200000000000001,"5min":1.111,"15min":1.111},"last":0.36899999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.498,"15min":0.48399999999999999},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77600000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.51600000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.91000000000000003,"5min":1.115,"15min":1.115},"last":0.46300000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72699999999999998,"15min":0.71399999999999997},"min":{"1min":0.503,"5min":0.496,"15min":0.496},"max":{"1min":0.90900000000000003,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.78000000000000003,"15min":0.79000000000000004},"min":{"1min":0.62,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96699999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.67600000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73299999999999998,"15min":0.73099999999999998},"min":{"1min":0.54500000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75,"15min":0.73799999999999999},"min":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66100000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.81699999999999995,"15min":0.81299999999999994},"min":{"1min":0.623,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0760000000000001,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.79000000000000004,"15min":0.77400000000000002},"min":{"1min":0.68600000000000005,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.59799999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79800000000000004,"15min":0.78800000000000003},"min":{"1min":0.63200000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.089,"5min":1.091,"15min":1.091},"last":0.748},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79800000000000004,"15min":0.79400000000000004},"min":{"1min":0.57599999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.73899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:49:04.580 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:49:04.580 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:49:04.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.730+0000 7f1d68a00640 1 Processor -- start 2024-08-17T02:49:04.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.730+0000 7f1d68a00640 1 -- start start 2024-08-17T02:49:04.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.731+0000 7f1d68a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1d640ccca0 0x7f1d64163870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:04.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.731+0000 7f1d68a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d640cadc0 con 0x7f1d640ceb40 2024-08-17T02:49:04.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.731+0000 7f1d68a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d640cb060 con 0x7f1d64159ca0 2024-08-17T02:49:04.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.731+0000 7f1d68a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d640cd6e0 con 0x7f1d640ccca0 2024-08-17T02:49:04.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.731+0000 7f1d62a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1d640ceb40 0x7f1d640cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38266/0 (socket says 172.21.15.100:38266) 2024-08-17T02:49:04.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.731+0000 7f1d62a00640 1 -- 172.21.15.100:0/428742027 learned_addr learned my addr 172.21.15.100:0/428742027 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:49:04.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.731+0000 7f1d63e00640 1 --2- 172.21.15.100:0/428742027 >> v2:172.21.15.100:3300/0 conn(0x7f1d640ccca0 0x7f1d64163870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:04.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.732+0000 7f1d62000640 1 -- 172.21.15.100:0/428742027 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544686626 0 0) 0x7f1d640cadc0 con 0x7f1d640ceb40 2024-08-17T02:49:04.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.732+0000 7f1d63e00640 1 -- 172.21.15.100:0/428742027 >> v1:172.21.15.123:6789/0 conn(0x7f1d64159ca0 legacy=0x7f1d640ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:04.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.732+0000 7f1d63e00640 1 -- 172.21.15.100:0/428742027 >> v1:172.21.15.100:6789/0 conn(0x7f1d640ceb40 legacy=0x7f1d640cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:04.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.732+0000 7f1d63e00640 1 -- 172.21.15.100:0/428742027 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d640cb300 con 0x7f1d640ccca0 2024-08-17T02:49:04.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.733+0000 7f1d63e00640 1 --2- 172.21.15.100:0/428742027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d640ccca0 0x7f1d64163870 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c009de0 tx=0x7f1d5c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09547456ea2f381 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:04.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.733+0000 7f1d62000640 1 -- 172.21.15.100:0/428742027 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c007550 con 0x7f1d640ccca0 2024-08-17T02:49:04.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.733+0000 7f1d62000640 1 -- 172.21.15.100:0/428742027 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c02d050 con 0x7f1d640ccca0 2024-08-17T02:49:04.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.733+0000 7f1d62000640 1 -- 172.21.15.100:0/428742027 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c0078e0 con 0x7f1d640ccca0 2024-08-17T02:49:04.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.733+0000 7f1d68a00640 1 -- 172.21.15.100:0/428742027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d640ccca0 msgr2=0x7f1d64163870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:04.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.733+0000 7f1d68a00640 1 --2- 172.21.15.100:0/428742027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d640ccca0 0x7f1d64163870 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c009de0 tx=0x7f1d5c009780 comp rx=0 tx=0).stop 2024-08-17T02:49:04.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.734+0000 7f1d68a00640 1 -- 172.21.15.100:0/428742027 shutdown_connections 2024-08-17T02:49:04.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.734+0000 7f1d68a00640 1 --2- 172.21.15.100:0/428742027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d640ccca0 0x7f1d64163870 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.734+0000 7f1d68a00640 1 -- 172.21.15.100:0/428742027 >> 172.21.15.100:0/428742027 conn(0x7f1d64098e00 msgr2=0x7f1d6406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:04.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.734+0000 7f1d68a00640 1 -- 172.21.15.100:0/428742027 shutdown_connections 2024-08-17T02:49:04.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.734+0000 7f1d68a00640 1 -- 172.21.15.100:0/428742027 wait complete. 2024-08-17T02:49:04.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.735+0000 7f1d68a00640 1 Processor -- start 2024-08-17T02:49:04.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.735+0000 7f1d68a00640 1 -- start start 2024-08-17T02:49:04.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.736+0000 7f1d68a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d640ccca0 0x7f1d641696f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:04.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.736+0000 7f1d68a00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d640ceb40 0x7f1d6416ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:04.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.736+0000 7f1d68a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d64159ca0 0x7f1d640c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:04.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.736+0000 7f1d68a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d64169c30 con 0x7f1d640ccca0 2024-08-17T02:49:04.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.736+0000 7f1d68a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d640c7b90 con 0x7f1d64159ca0 2024-08-17T02:49:04.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.736+0000 7f1d68a00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6416bfd0 con 0x7f1d640ceb40 2024-08-17T02:49:04.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.736+0000 7f1d63400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d640ccca0 0x7f1d641696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:04.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.736+0000 7f1d63400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d640ccca0 0x7f1d641696f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38046/0 (socket says 172.21.15.100:38046) 2024-08-17T02:49:04.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.736+0000 7f1d63400640 1 -- 172.21.15.100:0/4163274991 learned_addr learned my addr 172.21.15.100:0/4163274991 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:04.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.737+0000 7f1d62a00640 1 --2- 172.21.15.100:0/4163274991 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d640ceb40 0x7f1d6416ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:04.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.737+0000 7f1d63400640 1 -- 172.21.15.100:0/4163274991 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d640ceb40 msgr2=0x7f1d6416ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:04.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.737+0000 7f1d63400640 1 --2- 172.21.15.100:0/4163274991 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d640ceb40 0x7f1d6416ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.737+0000 7f1d63400640 1 -- 172.21.15.100:0/4163274991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d64159ca0 msgr2=0x7f1d640c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:04.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.737+0000 7f1d63e00640 1 --2- 172.21.15.100:0/4163274991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d64159ca0 0x7f1d640c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:04.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.737+0000 7f1d63400640 1 --2- 172.21.15.100:0/4163274991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d64159ca0 0x7f1d640c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.737+0000 7f1d63400640 1 -- 172.21.15.100:0/4163274991 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d5c009a20 con 0x7f1d640ccca0 2024-08-17T02:49:04.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.737+0000 7f1d62a00640 1 --2- 172.21.15.100:0/4163274991 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d640ceb40 0x7f1d6416ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:04.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.737+0000 7f1d63e00640 1 --2- 172.21.15.100:0/4163274991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d64159ca0 0x7f1d640c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:04.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.737+0000 7f1d63400640 1 --2- 172.21.15.100:0/4163274991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d640ccca0 0x7f1d641696f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1d5400c810 tx=0x7f1d54007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:04.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.737+0000 7f1d5aa00640 1 -- 172.21.15.100:0/4163274991 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5400a640 con 0x7f1d640ccca0 2024-08-17T02:49:04.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.737+0000 7f1d5aa00640 1 -- 172.21.15.100:0/4163274991 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5400a7c0 con 0x7f1d640ccca0 2024-08-17T02:49:04.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.737+0000 7f1d68a00640 1 -- 172.21.15.100:0/4163274991 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d640c6f80 con 0x7f1d640ccca0 2024-08-17T02:49:04.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.737+0000 7f1d5aa00640 1 -- 172.21.15.100:0/4163274991 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5400abc0 con 0x7f1d640ccca0 2024-08-17T02:49:04.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.737+0000 7f1d68a00640 1 -- 172.21.15.100:0/4163274991 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d640c7540 con 0x7f1d640ccca0 2024-08-17T02:49:04.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.739+0000 7f1d68a00640 1 -- 172.21.15.100:0/4163274991 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d64071050 con 0x7f1d640ccca0 2024-08-17T02:49:04.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.739+0000 7f1d5aa00640 1 -- 172.21.15.100:0/4163274991 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1d54012420 con 0x7f1d640ccca0 2024-08-17T02:49:04.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.740+0000 7f1d5aa00640 1 --2- 172.21.15.100:0/4163274991 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1d44065150 0x7f1d44067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:04.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.740+0000 7f1d5aa00640 1 -- 172.21.15.100:0/4163274991 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f1d54081e20 con 0x7f1d640ccca0 2024-08-17T02:49:04.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.740+0000 7f1d62a00640 1 --2- 172.21.15.100:0/4163274991 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1d44065150 0x7f1d44067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:04.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.741+0000 7f1d62a00640 1 --2- 172.21.15.100:0/4163274991 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1d44065150 0x7f1d44067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1d640b2330 tx=0x7f1d50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:04.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.744+0000 7f1d5aa00640 1 -- 172.21.15.100:0/4163274991 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1d540500e0 con 0x7f1d640ccca0 2024-08-17T02:49:04.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.928+0000 7f1d68a00640 1 -- 172.21.15.100:0/4163274991 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d640c7cd0 con 0x7f1d44065150 2024-08-17T02:49:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.930+0000 7f1d5aa00640 1 -- 172.21.15.100:0/4163274991 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50799 (secure 0 0 0) 0x7f1d50001460 con 0x7f1d44065150 2024-08-17T02:49:04.931 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:49:04.932 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-08-17T02:49:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.932+0000 7f1d68a00640 1 -- 172.21.15.100:0/4163274991 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1d44065150 msgr2=0x7f1d44067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:04.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.932+0000 7f1d68a00640 1 --2- 172.21.15.100:0/4163274991 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1d44065150 0x7f1d44067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1d640b2330 tx=0x7f1d50009040 comp rx=0 tx=0).stop 2024-08-17T02:49:04.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.932+0000 7f1d68a00640 1 -- 172.21.15.100:0/4163274991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d640ccca0 msgr2=0x7f1d641696f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:04.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.932+0000 7f1d68a00640 1 --2- 172.21.15.100:0/4163274991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d640ccca0 0x7f1d641696f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1d5400c810 tx=0x7f1d54007ef0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.933+0000 7f1d68a00640 1 -- 172.21.15.100:0/4163274991 shutdown_connections 2024-08-17T02:49:04.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.933+0000 7f1d68a00640 1 --2- 172.21.15.100:0/4163274991 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f1d44065150 0x7f1d44067600 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.933+0000 7f1d68a00640 1 --2- 172.21.15.100:0/4163274991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d64159ca0 0x7f1d640c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.933+0000 7f1d68a00640 1 --2- 172.21.15.100:0/4163274991 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d640ceb40 0x7f1d6416ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.933+0000 7f1d68a00640 1 --2- 172.21.15.100:0/4163274991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d640ccca0 0x7f1d641696f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:04.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.933+0000 7f1d68a00640 1 -- 172.21.15.100:0/4163274991 >> 172.21.15.100:0/4163274991 conn(0x7f1d64098e00 msgr2=0x7f1d64155ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:04.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.933+0000 7f1d68a00640 1 -- 172.21.15.100:0/4163274991 shutdown_connections 2024-08-17T02:49:04.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:04.933+0000 7f1d68a00640 1 -- 172.21.15.100:0/4163274991 wait complete. 2024-08-17T02:49:04.948 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-08-17T02:49:03.138587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2388012,"kb_used_data":4996,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586708,"statfs":{"total":773094113280,"available":770648788992,"internally_reserved":0,"allocated":5115904,"data_stored":2798065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001028"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-08-17T02:48:53.630222+0000","last_change":"2024-08-17T02:45:37.011679+0000","last_active":"2024-08-17T02:48:53.630222+0000","last_peered":"2024-08-17T02:48:53.630222+0000","last_clean":"2024-08-17T02:48:53.630222+0000","last_became_active":"2024-08-17T02:45:37.010559+0000","last_became_peered":"2024-08-17T02:45:37.010559+0000","last_unstale":"2024-08-17T02:48:53.630222+0000","last_undegraded":"2024-08-17T02:48:53.630222+0000","last_fullsized":"2024-08-17T02:48:53.630222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:35.708391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:35.708391+0000","last_clean_scrub_stamp":"2024-08-17T02:45:35.708391+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:11.380093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542187,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302576,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069264,"statfs":{"total":96636764160,"available":96326926336,"internally_reserved":0,"allocated":1085440,"data_stored":794365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.65400000000000003,"15min":0.628},"min":{"1min":0.55500000000000005,"5min":0.372,"15min":0.372},"max":{"1min":0.91400000000000003,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.68700000000000006,"15min":0.66900000000000004},"min":{"1min":0.497,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90500000000000003,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.57899999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.70099999999999996,"15min":0.68200000000000005},"min":{"1min":0.624,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95399999999999996,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.68799999999999994,"15min":0.65900000000000003},"min":{"1min":0.58399999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.89400000000000002,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.498}]},{"osd":2,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69399999999999995,"15min":0.67200000000000004},"min":{"1min":0.60699999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88100000000000001,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73399999999999999,"15min":0.71999999999999997},"min":{"1min":0.65100000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92600000000000005,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.65400000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.70799999999999996,"15min":0.68799999999999994},"min":{"1min":0.63,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92900000000000005,"5min":1.034,"15min":1.034},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.747,"15min":0.745},"min":{"1min":0.60199999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.95799999999999996,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.56599999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66500000000000004,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.746,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64000000000000001,"15min":0.64900000000000002},"min":{"1min":0.47999999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.871,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.83499999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66800000000000004,"15min":0.68999999999999995},"min":{"1min":0.49399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98199999999999998,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.69199999999999995,"15min":0.70999999999999996},"min":{"1min":0.47899999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88,"5min":1.071,"15min":1.071},"last":0.63600000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.876,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.70899999999999996,"15min":0.72799999999999998},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.78700000000000003,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.90200000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542187,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297832,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074008,"statfs":{"total":96636764160,"available":96331784192,"internally_reserved":0,"allocated":483328,"data_stored":198366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":1.0569999999999999,"15min":1.198},"min":{"1min":0.52400000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0389999999999999,"5min":12.430999999999999,"15min":12.430999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.97799999999999998,"15min":1.0940000000000001},"min":{"1min":0.57299999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95799999999999996,"5min":10.391,"15min":10.391},"last":0.64500000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":1.044,"15min":1.1839999999999999},"min":{"1min":0.59099999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96499999999999997,"5min":11.654,"15min":11.654},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":1.044,"15min":1.1779999999999999},"min":{"1min":0.59499999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97599999999999998,"5min":11.484,"15min":11.484},"last":0.57799999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71599999999999997,"15min":0.70799999999999996},"min":{"1min":0.5,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90700000000000003,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":1.0620000000000001,"15min":1.2090000000000001},"min":{"1min":0.55500000000000005,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.94299999999999995,"5min":12.025,"15min":12.025},"last":0.65900000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":1.079,"15min":1.23},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98099999999999998,"5min":12.073,"15min":12.073},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":1.083,"15min":1.2230000000000001},"min":{"1min":0.60099999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.0129999999999999,"5min":12.374000000000001,"15min":12.374000000000001},"last":0.628}]},{"osd":4,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.96899999999999997,"15min":1.131},"min":{"1min":0.42599999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.88100000000000001,"5min":11.545999999999999,"15min":11.545999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.64200000000000002,"15min":0.66900000000000004},"min":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79900000000000004,"5min":2.202,"15min":2.202},"last":0.44}]},{"osd":5,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":1.02,"15min":1.212},"min":{"1min":0.45500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.80100000000000005,"5min":12.111000000000001,"15min":12.111000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":1.042,"15min":1.2170000000000001},"min":{"1min":0.443,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0649999999999999,"5min":12.477,"15min":12.477},"last":0.53500000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.97099999999999997,"15min":1.115},"min":{"1min":0.502,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94099999999999995,"5min":10.526999999999999,"15min":10.526999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":1.1399999999999999,"15min":1.3340000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.86099999999999999,"5min":13.638,"15min":13.638},"last":0.70799999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542188,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297836,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074004,"statfs":{"total":96636764160,"available":96331780096,"internally_reserved":0,"allocated":491520,"data_stored":203977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63100000000000001,"15min":0.60899999999999999},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.79500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65100000000000002,"15min":0.63800000000000001},"min":{"1min":0.54300000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.81899999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63500000000000001,"15min":0.621},"min":{"1min":0.51100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.86699999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66000000000000003,"15min":0.63800000000000001},"min":{"1min":0.58999999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84699999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.86399999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.624},"min":{"1min":0.46600000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86599999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.51000000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.84399999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.69599999999999995,"15min":0.68999999999999995},"min":{"1min":0.56999999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.85899999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69099999999999995,"15min":0.68100000000000005},"min":{"1min":0.59499999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.89400000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":1.024}]},{"osd":4,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78700000000000003,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.623},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60099999999999998,"15min":0.60399999999999998},"min":{"1min":0.45400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.58899999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.65300000000000002,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80700000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.83399999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68600000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69499999999999995,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90300000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":1.012},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.82699999999999996,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76200000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297832,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074008,"statfs":{"total":96636764160,"available":96331784192,"internally_reserved":0,"allocated":487424,"data_stored":199258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67100000000000004,"15min":0.63900000000000001},"min":{"1min":0.50600000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88900000000000001,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63600000000000001,"15min":0.61499999999999999},"min":{"1min":0.52700000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.80000000000000004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.70699999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63900000000000001,"15min":0.61799999999999999},"min":{"1min":0.51500000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.79300000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65900000000000003,"15min":0.63500000000000001},"min":{"1min":0.51700000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84999999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65700000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68799999999999994,"15min":0.66600000000000004},"min":{"1min":0.55300000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86899999999999999,"5min":1.286,"15min":1.286},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71799999999999997,"15min":0.69799999999999995},"min":{"1min":0.56899999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.85599999999999998,"5min":1.609,"15min":1.609},"last":0.66900000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.69899999999999995,"15min":0.67900000000000005},"min":{"1min":0.59699999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85099999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67500000000000004,"15min":0.64900000000000002},"min":{"1min":0.57699999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84499999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.58199999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.66300000000000003,"15min":0.68500000000000005},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.752,"5min":1.077,"15min":1.077},"last":0.75},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92100000000000004,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.62}]},{"osd":6,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63700000000000001,"15min":0.65700000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90400000000000003,"5min":1.198,"15min":1.198},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.88700000000000001,"5min":1.145,"15min":1.145},"last":0.628}]},{"osd":7,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.48499999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88500000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.83799999999999997,"5min":1.101,"15min":1.101},"last":0.61199999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542188,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297844,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":499712,"data_stored":204533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.29699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67000000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.47299999999999998,"15min":0.45900000000000002},"min":{"1min":0.311,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74099999999999999,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.33800000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65500000000000003,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.41799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76700000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.69199999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64100000000000001,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.434},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55700000000000005,"15min":0.55100000000000005},"min":{"1min":0.46300000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.56699999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.74099999999999999,"15min":0.71799999999999997},"min":{"1min":0.65100000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.75600000000000001,"15min":0.752},"min":{"1min":0.58399999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.042,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.55400000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.75700000000000001,"15min":0.747},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2,"5min":1.212,"15min":1.212},"last":0.629},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77500000000000002,"15min":0.77100000000000002},"min":{"1min":0.628,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.90900000000000003,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78400000000000003,"15min":0.77800000000000002},"min":{"1min":0.61899999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0249999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80800000000000005,"15min":0.79000000000000004},"min":{"1min":0.64500000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.66400000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.78200000000000003,"15min":0.75800000000000001},"min":{"1min":0.628,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.63300000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.58999999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542187,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297848,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":503808,"data_stored":205481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.44800000000000001,"15min":0.44},"min":{"1min":0.35699999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67200000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44900000000000001,"15min":0.44600000000000001},"min":{"1min":0.35099999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.57099999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.40999999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.495,"15min":0.497},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.63900000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.42099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.60999999999999999,"5min":1.139,"15min":1.139},"last":0.38100000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.48399999999999999,"15min":0.46200000000000002},"min":{"1min":0.42499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.58899999999999997,"15min":0.57799999999999996},"min":{"1min":0.49099999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72499999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.48399999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.77600000000000002,"15min":0.77400000000000002},"min":{"1min":0.67200000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.997,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.75900000000000001,"15min":0.747},"min":{"1min":0.621,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.72199999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.78000000000000003,"15min":0.77800000000000002},"min":{"1min":0.64200000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.002,"5min":1.135,"15min":1.135},"last":0.79100000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.80300000000000005,"15min":0.80500000000000005},"min":{"1min":0.61599999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0569999999999999,"5min":1.103,"15min":1.103},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.80700000000000005,"15min":0.79900000000000004},"min":{"1min":0.70599999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.77300000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.82099999999999995,"15min":0.81699999999999995},"min":{"1min":0.68600000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.61799999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0209999999999999,"5min":1.038,"15min":1.038},"last":0.90000000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542187,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297836,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074004,"statfs":{"total":96636764160,"available":96331780096,"internally_reserved":0,"allocated":491520,"data_stored":203977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.40999999999999998},"min":{"1min":0.312,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66000000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.314},{"interface":"front","average":{"1min":0.496,"5min":0.44700000000000001,"15min":0.42999999999999999},"min":{"1min":0.37,"5min":0.246,"15min":0.246},"max":{"1min":0.63300000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.439}]},{"osd":2,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.39700000000000002,"15min":0.373},"min":{"1min":0.35399999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.40799999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.69799999999999995,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.54600000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59399999999999997,"15min":0.57299999999999995},"min":{"1min":0.53100000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78900000000000003,"5min":1.054,"15min":1.054},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.75700000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.69099999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.63,"15min":0.59799999999999998},"min":{"1min":0.50600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66500000000000004,"15min":0.64300000000000002},"min":{"1min":0.59599999999999997,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.091,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.59499999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.65800000000000003,"15min":0.63400000000000001},"min":{"1min":0.56100000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93799999999999994,"5min":1.002,"15min":1.002},"last":0.63},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.66300000000000003,"15min":0.64300000000000002},"min":{"1min":0.55600000000000005,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.998,"5min":1.042,"15min":1.042},"last":0.66700000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.73199999999999998,"15min":0.71799999999999997},"min":{"1min":0.65400000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.995,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.73099999999999998,"15min":0.70399999999999996},"min":{"1min":0.627,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.054,"5min":1.256,"15min":1.256},"last":0.61399999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.57999999999999996,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.749,"15min":0.73099999999999998},"min":{"1min":0.73599999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0229999999999999,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.746}]}]},{"osd":0,"up_from":14,"seq":60129542188,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298408,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073432,"statfs":{"total":96636764160,"available":96331194368,"internally_reserved":0,"allocated":1073152,"data_stored":788108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.434,"15min":0.442},"min":{"1min":0.32200000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66300000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.50600000000000001},"min":{"1min":0.42499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75700000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48099999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51600000000000001,"15min":0.53100000000000003},"min":{"1min":0.40300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.65400000000000003,"5min":0.878,"15min":0.878},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.53500000000000003,"15min":0.54700000000000004},"min":{"1min":0.375,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.63200000000000001,"5min":1.111,"15min":1.111},"last":0.36899999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.498,"15min":0.48399999999999999},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77600000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.51600000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.91000000000000003,"5min":1.115,"15min":1.115},"last":0.46300000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72699999999999998,"15min":0.71399999999999997},"min":{"1min":0.503,"5min":0.496,"15min":0.496},"max":{"1min":0.90900000000000003,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.78000000000000003,"15min":0.79000000000000004},"min":{"1min":0.62,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96699999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.67600000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73299999999999998,"15min":0.73099999999999998},"min":{"1min":0.54500000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75,"15min":0.73799999999999999},"min":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66100000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.81699999999999995,"15min":0.81299999999999994},"min":{"1min":0.623,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0760000000000001,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.79000000000000004,"15min":0.77400000000000002},"min":{"1min":0.68600000000000005,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.59799999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79800000000000004,"15min":0.78800000000000003},"min":{"1min":0.63200000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.089,"5min":1.091,"15min":1.091},"last":0.748},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79800000000000004,"15min":0.79400000000000004},"min":{"1min":0.57599999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.73899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:49:04.950 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:49:05.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.096+0000 7fc789400640 1 Processor -- start 2024-08-17T02:49:05.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.096+0000 7fc789400640 1 -- start start 2024-08-17T02:49:05.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.097+0000 7fc789400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7841401b0 0x7fc7840caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:05.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.097+0000 7fc789400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc784140580 0x7fc7840b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:05.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.097+0000 7fc789400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7840b16d0 con 0x7fc7840b1270 2024-08-17T02:49:05.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.097+0000 7fc789400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7840cb450 con 0x7fc784140580 2024-08-17T02:49:05.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.097+0000 7fc789400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7840caa80 con 0x7fc7841401b0 2024-08-17T02:49:05.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.098+0000 7fc783200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc7840b1270 0x7fc7840c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38276/0 (socket says 172.21.15.100:38276) 2024-08-17T02:49:05.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.098+0000 7fc783200640 1 -- 172.21.15.100:0/3216947861 learned_addr learned my addr 172.21.15.100:0/3216947861 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:49:05.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.098+0000 7fc779e00640 1 --2- 172.21.15.100:0/3216947861 >> v2:172.21.15.123:3300/0 conn(0x7fc784140580 0x7fc7840b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:05.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.098+0000 7fc782800640 1 --2- 172.21.15.100:0/3216947861 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7841401b0 0x7fc7840caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:05.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.098+0000 7fc781e00640 1 -- 172.21.15.100:0/3216947861 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446272646 0 0) 0x7fc77c001490 con 0x7fc7840b1270 2024-08-17T02:49:05.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.098+0000 7fc781e00640 1 -- 172.21.15.100:0/3216947861 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7680034e0 con 0x7fc7840b1270 2024-08-17T02:49:05.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.098+0000 7fc782800640 1 -- 172.21.15.100:0/3216947861 >> v2:172.21.15.123:3300/0 conn(0x7fc784140580 msgr2=0x7fc7840b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:05.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.098+0000 7fc782800640 1 --2- 172.21.15.100:0/3216947861 >> v2:172.21.15.123:3300/0 conn(0x7fc784140580 0x7fc7840b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:05.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.098+0000 7fc782800640 1 -- 172.21.15.100:0/3216947861 >> v1:172.21.15.100:6789/0 conn(0x7fc7840b1270 legacy=0x7fc7840c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:05.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.098+0000 7fc782800640 1 -- 172.21.15.100:0/3216947861 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7840c9e70 con 0x7fc7841401b0 2024-08-17T02:49:05.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.099+0000 7fc782800640 1 --2- 172.21.15.100:0/3216947861 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7841401b0 0x7fc7840caf10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc774009850 tx=0x7fc7740090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bcaf8fe461747c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:05.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.100+0000 7fc781e00640 1 -- 172.21.15.100:0/3216947861 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77402ad00 con 0x7fc7841401b0 2024-08-17T02:49:05.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.100+0000 7fc781e00640 1 -- 172.21.15.100:0/3216947861 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77402ae60 con 0x7fc7841401b0 2024-08-17T02:49:05.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.100+0000 7fc781e00640 1 -- 172.21.15.100:0/3216947861 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774032650 con 0x7fc7841401b0 2024-08-17T02:49:05.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.100+0000 7fc789400640 1 -- 172.21.15.100:0/3216947861 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7841401b0 msgr2=0x7fc7840caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:05.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.100+0000 7fc789400640 1 --2- 172.21.15.100:0/3216947861 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7841401b0 0x7fc7840caf10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc774009850 tx=0x7fc7740090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:05.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.100+0000 7fc789400640 1 -- 172.21.15.100:0/3216947861 shutdown_connections 2024-08-17T02:49:05.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.100+0000 7fc789400640 1 --2- 172.21.15.100:0/3216947861 >> v2:172.21.15.123:3300/0 conn(0x7fc784140580 0x7fc7840b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:05.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.100+0000 7fc789400640 1 --2- 172.21.15.100:0/3216947861 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7841401b0 0x7fc7840caf10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:05.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.100+0000 7fc789400640 1 -- 172.21.15.100:0/3216947861 >> 172.21.15.100:0/3216947861 conn(0x7fc7840cb9b0 msgr2=0x7fc7840cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:05.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.100+0000 7fc789400640 1 -- 172.21.15.100:0/3216947861 shutdown_connections 2024-08-17T02:49:05.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.100+0000 7fc789400640 1 -- 172.21.15.100:0/3216947861 wait complete. 2024-08-17T02:49:05.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.102+0000 7fc789400640 1 Processor -- start 2024-08-17T02:49:05.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.102+0000 7fc789400640 1 -- start start 2024-08-17T02:49:05.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.103+0000 7fc789400640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7840b1270 0x7fc784158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.103+0000 7fc789400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7841401b0 0x7fc784169010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.103+0000 7fc789400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc784140580 0x7fc7840c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.103+0000 7fc789400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7840c6ef0 con 0x7fc784140580 2024-08-17T02:49:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.103+0000 7fc789400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7840c6bf0 con 0x7fc7841401b0 2024-08-17T02:49:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.103+0000 7fc789400640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc784169910 con 0x7fc7840b1270 2024-08-17T02:49:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.103+0000 7fc783200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc784140580 0x7fc7840c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.103+0000 7fc783200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc784140580 0x7fc7840c3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38058/0 (socket says 172.21.15.100:38058) 2024-08-17T02:49:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.103+0000 7fc783200640 1 -- 172.21.15.100:0/2888828573 learned_addr learned my addr 172.21.15.100:0/2888828573 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:05.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.103+0000 7fc782800640 1 --2- 172.21.15.100:0/2888828573 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7840b1270 0x7fc784158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:05.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.103+0000 7fc779e00640 1 --2- 172.21.15.100:0/2888828573 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7841401b0 0x7fc784169010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:05.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.103+0000 7fc783200640 1 -- 172.21.15.100:0/2888828573 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7840b1270 msgr2=0x7fc784158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:05.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.103+0000 7fc783200640 1 --2- 172.21.15.100:0/2888828573 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7840b1270 0x7fc784158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:05.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.103+0000 7fc783200640 1 -- 172.21.15.100:0/2888828573 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7841401b0 msgr2=0x7fc784169010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:05.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.103+0000 7fc783200640 1 --2- 172.21.15.100:0/2888828573 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7841401b0 0x7fc784169010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:05.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.103+0000 7fc783200640 1 -- 172.21.15.100:0/2888828573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc774009390 con 0x7fc784140580 2024-08-17T02:49:05.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.103+0000 7fc779e00640 1 --2- 172.21.15.100:0/2888828573 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7841401b0 0x7fc784169010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:05.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.104+0000 7fc783200640 1 --2- 172.21.15.100:0/2888828573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc784140580 0x7fc7840c3ef0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00cc70 tx=0x7fc77c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:05.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.104+0000 7fc77aa00640 1 -- 172.21.15.100:0/2888828573 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c00ce30 con 0x7fc784140580 2024-08-17T02:49:05.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.104+0000 7fc77aa00640 1 -- 172.21.15.100:0/2888828573 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77c00a850 con 0x7fc784140580 2024-08-17T02:49:05.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.104+0000 7fc789400640 1 -- 172.21.15.100:0/2888828573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc784169bf0 con 0x7fc784140580 2024-08-17T02:49:05.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.104+0000 7fc77aa00640 1 -- 172.21.15.100:0/2888828573 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c00abd0 con 0x7fc784140580 2024-08-17T02:49:05.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.104+0000 7fc789400640 1 -- 172.21.15.100:0/2888828573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7840c4430 con 0x7fc784140580 2024-08-17T02:49:05.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.105+0000 7fc789400640 1 -- 172.21.15.100:0/2888828573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7840c7060 con 0x7fc784140580 2024-08-17T02:49:05.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.106+0000 7fc77aa00640 1 -- 172.21.15.100:0/2888828573 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc77c0070f0 con 0x7fc784140580 2024-08-17T02:49:05.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.107+0000 7fc77aa00640 1 --2- 172.21.15.100:0/2888828573 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc760065150 0x7fc760067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:05.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.107+0000 7fc77aa00640 1 -- 172.21.15.100:0/2888828573 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fc77c0820e0 con 0x7fc784140580 2024-08-17T02:49:05.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.108+0000 7fc782800640 1 --2- 172.21.15.100:0/2888828573 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc760065150 0x7fc760067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:05.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.108+0000 7fc782800640 1 --2- 172.21.15.100:0/2888828573 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc760065150 0x7fc760067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc774034000 tx=0x7fc774032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:05.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.111+0000 7fc77aa00640 1 -- 172.21.15.100:0/2888828573 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc77c050420 con 0x7fc784140580 2024-08-17T02:49:05.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.287+0000 7fc789400640 1 -- 172.21.15.100:0/2888828573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7840b16d0 con 0x7fc784140580 2024-08-17T02:49:05.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.287+0000 7fc77aa00640 1 -- 172.21.15.100:0/2888828573 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12445 (secure 0 0 0) 0x7fc7840b16d0 con 0x7fc784140580 2024-08-17T02:49:05.288 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:49:05.288 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":44,"fsid":"9fea90ef-12b1-4f23-8013-27074825f754","created":"2024-08-17T02:45:22.688903+0000","modified":"2024-08-17T02:49:00.452031+0000","last_up_change":"2024-08-17T02:45:33.704193+0000","last_in_change":"2024-08-17T02:45:25.633713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:45:35.140990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"bcae4c92-2028-4303-8687-b1a80c4cb027","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":37019},{"type":"v1","addr":"172.21.15.100:6801","nonce":37019}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":37019},{"type":"v1","addr":"172.21.15.100:6803","nonce":37019}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":37019},{"type":"v1","addr":"172.21.15.100:6807","nonce":37019}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":37019},{"type":"v1","addr":"172.21.15.100:6805","nonce":37019}]},"public_addr":"172.21.15.100:6801/37019","cluster_addr":"172.21.15.100:6803/37019","heartbeat_back_addr":"172.21.15.100:6807/37019","heartbeat_front_addr":"172.21.15.100:6805/37019","state":["exists","up"]},{"osd":1,"uuid":"06af85ca-1cfc-4cfe-b199-fca43d69a12c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":37022},{"type":"v1","addr":"172.21.15.100:6817","nonce":37022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":37022},{"type":"v1","addr":"172.21.15.100:6819","nonce":37022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37022},{"type":"v1","addr":"172.21.15.100:6823","nonce":37022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":37022},{"type":"v1","addr":"172.21.15.100:6821","nonce":37022}]},"public_addr":"172.21.15.100:6817/37022","cluster_addr":"172.21.15.100:6819/37022","heartbeat_back_addr":"172.21.15.100:6823/37022","heartbeat_front_addr":"172.21.15.100:6821/37022","state":["exists","up"]},{"osd":2,"uuid":"7d21e3ad-72fa-45c9-9bae-3ab967e4815e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37021},{"type":"v1","addr":"172.21.15.100:6809","nonce":37021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":37021},{"type":"v1","addr":"172.21.15.100:6811","nonce":37021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":37021},{"type":"v1","addr":"172.21.15.100:6815","nonce":37021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":37021},{"type":"v1","addr":"172.21.15.100:6813","nonce":37021}]},"public_addr":"172.21.15.100:6809/37021","cluster_addr":"172.21.15.100:6811/37021","heartbeat_back_addr":"172.21.15.100:6815/37021","heartbeat_front_addr":"172.21.15.100:6813/37021","state":["exists","up"]},{"osd":3,"uuid":"543c56c4-f565-4f82-8f9a-3bc9252b6423","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":37041},{"type":"v1","addr":"172.21.15.100:6825","nonce":37041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":37041},{"type":"v1","addr":"172.21.15.100:6827","nonce":37041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":37041},{"type":"v1","addr":"172.21.15.100:6831","nonce":37041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":37041},{"type":"v1","addr":"172.21.15.100:6829","nonce":37041}]},"public_addr":"172.21.15.100:6825/37041","cluster_addr":"172.21.15.100:6827/37041","heartbeat_back_addr":"172.21.15.100:6831/37041","heartbeat_front_addr":"172.21.15.100:6829/37041","state":["exists","up"]},{"osd":4,"uuid":"d761f1a3-519b-47ff-823a-7327d58832dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":37279},{"type":"v1","addr":"172.21.15.123:6820","nonce":37279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6823","nonce":37279},{"type":"v1","addr":"172.21.15.123:6825","nonce":37279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":37279},{"type":"v1","addr":"172.21.15.123:6831","nonce":37279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":37279},{"type":"v1","addr":"172.21.15.123:6829","nonce":37279}]},"public_addr":"172.21.15.123:6820/37279","cluster_addr":"172.21.15.123:6825/37279","heartbeat_back_addr":"172.21.15.123:6831/37279","heartbeat_front_addr":"172.21.15.123:6829/37279","state":["exists","up"]},{"osd":5,"uuid":"3b46ce72-4a79-499c-9e4b-015e28c6b671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":37277},{"type":"v1","addr":"172.21.15.123:6801","nonce":37277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":37277},{"type":"v1","addr":"172.21.15.123:6803","nonce":37277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":37277},{"type":"v1","addr":"172.21.15.123:6807","nonce":37277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":37277},{"type":"v1","addr":"172.21.15.123:6805","nonce":37277}]},"public_addr":"172.21.15.123:6801/37277","cluster_addr":"172.21.15.123:6803/37277","heartbeat_back_addr":"172.21.15.123:6807/37277","heartbeat_front_addr":"172.21.15.123:6805/37277","state":["exists","up"]},{"osd":6,"uuid":"61ea0cd7-b91e-4cd5-98a1-62e53429f21c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":37278},{"type":"v1","addr":"172.21.15.123:6809","nonce":37278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":37278},{"type":"v1","addr":"172.21.15.123:6811","nonce":37278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":37278},{"type":"v1","addr":"172.21.15.123:6815","nonce":37278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":37278},{"type":"v1","addr":"172.21.15.123:6813","nonce":37278}]},"public_addr":"172.21.15.123:6809/37278","cluster_addr":"172.21.15.123:6811/37278","heartbeat_back_addr":"172.21.15.123:6815/37278","heartbeat_front_addr":"172.21.15.123:6813/37278","state":["exists","up"]},{"osd":7,"uuid":"8132fd78-fb77-4543-b0ae-030456d0ba03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":37289},{"type":"v1","addr":"172.21.15.123:6818","nonce":37289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":37289},{"type":"v1","addr":"172.21.15.123:6821","nonce":37289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":37289},{"type":"v1","addr":"172.21.15.123:6827","nonce":37289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":37289},{"type":"v1","addr":"172.21.15.123:6824","nonce":37289}]},"public_addr":"172.21.15.123:6818/37289","cluster_addr":"172.21.15.123:6821/37289","heartbeat_back_addr":"172.21.15.123:6827/37289","heartbeat_front_addr":"172.21.15.123:6824/37289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.030546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.040235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.931219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029032+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.029494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:30.882145+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.249724+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:45:31.257801+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6834/1763367135":"2024-08-18T02:48:57.135611+0000","172.21.15.123:6832/1763367135":"2024-08-18T02:48:57.135611+0000","172.21.15.123:6835/1541092259":"2024-08-18T02:48:50.211886+0000","172.21.15.123:6833/1541092259":"2024-08-18T02:48:50.211886+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:49:05.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.290+0000 7fc789400640 1 -- 172.21.15.100:0/2888828573 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc760065150 msgr2=0x7fc760067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:05.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.290+0000 7fc789400640 1 --2- 172.21.15.100:0/2888828573 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc760065150 0x7fc760067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc774034000 tx=0x7fc774032000 comp rx=0 tx=0).stop 2024-08-17T02:49:05.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.290+0000 7fc789400640 1 -- 172.21.15.100:0/2888828573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc784140580 msgr2=0x7fc7840c3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:05.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.290+0000 7fc789400640 1 --2- 172.21.15.100:0/2888828573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc784140580 0x7fc7840c3ef0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00cc70 tx=0x7fc77c001a30 comp rx=0 tx=0).stop 2024-08-17T02:49:05.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.290+0000 7fc789400640 1 -- 172.21.15.100:0/2888828573 shutdown_connections 2024-08-17T02:49:05.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.290+0000 7fc789400640 1 --2- 172.21.15.100:0/2888828573 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fc760065150 0x7fc760067600 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:05.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.290+0000 7fc789400640 1 --2- 172.21.15.100:0/2888828573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc784140580 0x7fc7840c3ef0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:05.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.290+0000 7fc789400640 1 --2- 172.21.15.100:0/2888828573 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7841401b0 0x7fc784169010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:05.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.290+0000 7fc789400640 1 --2- 172.21.15.100:0/2888828573 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc7840b1270 0x7fc784158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:05.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.290+0000 7fc789400640 1 -- 172.21.15.100:0/2888828573 >> 172.21.15.100:0/2888828573 conn(0x7fc7840cb9b0 msgr2=0x7fc7840a54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:05.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.290+0000 7fc789400640 1 -- 172.21.15.100:0/2888828573 shutdown_connections 2024-08-17T02:49:05.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:05.290+0000 7fc789400640 1 -- 172.21.15.100:0/2888828573 wait complete. 2024-08-17T02:49:06.306 INFO:tasks.ceph:Scrubbing osd.0 2024-08-17T02:49:06.307 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:49:06.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.463+0000 7f7c0a000640 1 Processor -- start 2024-08-17T02:49:06.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.464+0000 7f7c0a000640 1 -- start start 2024-08-17T02:49:06.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.465+0000 7f7c0a000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7c04155880 0x7f7c040ae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:06.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.465+0000 7f7c0a000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7c040aeb70 0x7f7c040af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:06.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.465+0000 7f7c0a000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c04157840 con 0x7f7c04155c50 2024-08-17T02:49:06.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.465+0000 7f7c0a000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c04156c30 con 0x7f7c04155880 2024-08-17T02:49:06.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.465+0000 7f7c0a000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c04156f10 con 0x7f7c040aeb70 2024-08-17T02:49:06.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.465+0000 7f7c08c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7c04155880 0x7f7c040ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:06.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.465+0000 7f7c08c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7c04155880 0x7f7c040ae630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38066/0 (socket says 172.21.15.100:38066) 2024-08-17T02:49:06.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.465+0000 7f7c08c00640 1 -- 172.21.15.100:0/702401036 learned_addr learned my addr 172.21.15.100:0/702401036 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:06.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.465+0000 7f7c08c00640 1 -- 172.21.15.100:0/702401036 >> v2:172.21.15.123:3300/0 conn(0x7f7c040aeb70 msgr2=0x7f7c040af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:06.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.465+0000 7f7c08c00640 1 --2- 172.21.15.100:0/702401036 >> v2:172.21.15.123:3300/0 conn(0x7f7c040aeb70 0x7f7c040af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:06.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.465+0000 7f7c08c00640 1 -- 172.21.15.100:0/702401036 >> v1:172.21.15.123:6789/0 conn(0x7f7c04155c50 legacy=0x7f7c041596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:06.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.465+0000 7f7c08c00640 1 -- 172.21.15.100:0/702401036 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c041571f0 con 0x7f7c04155880 2024-08-17T02:49:06.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.466+0000 7f7c08c00640 1 --2- 172.21.15.100:0/702401036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c04155880 0x7f7c040ae630 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7c040682e0 tx=0x7f7bf40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312bd082a25dc2f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:06.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.467+0000 7f7c03e00640 1 -- 172.21.15.100:0/702401036 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf402add0 con 0x7f7c04155880 2024-08-17T02:49:06.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.467+0000 7f7c03e00640 1 -- 172.21.15.100:0/702401036 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf4032440 con 0x7f7c04155880 2024-08-17T02:49:06.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.467+0000 7f7c03e00640 1 -- 172.21.15.100:0/702401036 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4032820 con 0x7f7c04155880 2024-08-17T02:49:06.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.467+0000 7f7c0a000640 1 -- 172.21.15.100:0/702401036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c04155880 msgr2=0x7f7c040ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:06.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.467+0000 7f7c0a000640 1 --2- 172.21.15.100:0/702401036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c04155880 0x7f7c040ae630 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7c040682e0 tx=0x7f7bf40091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:06.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.467+0000 7f7c0a000640 1 -- 172.21.15.100:0/702401036 shutdown_connections 2024-08-17T02:49:06.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.467+0000 7f7c0a000640 1 --2- 172.21.15.100:0/702401036 >> v2:172.21.15.123:3300/0 conn(0x7f7c040aeb70 0x7f7c040af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:06.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.467+0000 7f7c0a000640 1 --2- 172.21.15.100:0/702401036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c04155880 0x7f7c040ae630 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:06.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.467+0000 7f7c0a000640 1 -- 172.21.15.100:0/702401036 >> 172.21.15.100:0/702401036 conn(0x7f7c04067750 msgr2=0x7f7c040cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:06.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.467+0000 7f7c0a000640 1 -- 172.21.15.100:0/702401036 shutdown_connections 2024-08-17T02:49:06.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.467+0000 7f7c0a000640 1 -- 172.21.15.100:0/702401036 wait complete. 2024-08-17T02:49:06.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.469+0000 7f7c0a000640 1 Processor -- start 2024-08-17T02:49:06.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.469+0000 7f7c0a000640 1 -- start start 2024-08-17T02:49:06.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.470+0000 7f7c0a000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c040aeb70 0x7f7c0415d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:06.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.470+0000 7f7c0a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c04155880 0x7f7c04160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:06.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.470+0000 7f7c0a000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7c04155c50 0x7f7c0415f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:06.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.470+0000 7f7c0a000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0415d9e0 con 0x7f7c04155880 2024-08-17T02:49:06.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.470+0000 7f7c0a000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0415b220 con 0x7f7c040aeb70 2024-08-17T02:49:06.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.470+0000 7f7c0a000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0415b500 con 0x7f7c04155c50 2024-08-17T02:49:06.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.470+0000 7f7bfbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c04155880 0x7f7c04160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:06.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.470+0000 7f7bfbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c04155880 0x7f7c04160050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38070/0 (socket says 172.21.15.100:38070) 2024-08-17T02:49:06.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.470+0000 7f7bfbe00640 1 -- 172.21.15.100:0/3400053307 learned_addr learned my addr 172.21.15.100:0/3400053307 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:06.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.470+0000 7f7c08c00640 1 --2- 172.21.15.100:0/3400053307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c040aeb70 0x7f7c0415d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:06.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.470+0000 7f7c09600640 1 --2- 172.21.15.100:0/3400053307 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7c04155c50 0x7f7c0415f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:06.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.470+0000 7f7bfbe00640 1 -- 172.21.15.100:0/3400053307 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7c04155c50 msgr2=0x7f7c0415f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:06.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.470+0000 7f7bfbe00640 1 --2- 172.21.15.100:0/3400053307 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7c04155c50 0x7f7c0415f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:06.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.470+0000 7f7bfbe00640 1 -- 172.21.15.100:0/3400053307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c040aeb70 msgr2=0x7f7c0415d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:06.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.470+0000 7f7bfbe00640 1 --2- 172.21.15.100:0/3400053307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c040aeb70 0x7f7c0415d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:06.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.470+0000 7f7bfbe00640 1 -- 172.21.15.100:0/3400053307 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf4009450 con 0x7f7c04155880 2024-08-17T02:49:06.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.470+0000 7f7c08c00640 1 --2- 172.21.15.100:0/3400053307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c040aeb70 0x7f7c0415d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:06.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.471+0000 7f7bfbe00640 1 --2- 172.21.15.100:0/3400053307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c04155880 0x7f7c04160050 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00b810 tx=0x7f7bec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:06.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.471+0000 7f7c00c00640 1 -- 172.21.15.100:0/3400053307 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec00be60 con 0x7f7c04155880 2024-08-17T02:49:06.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.471+0000 7f7c00c00640 1 -- 172.21.15.100:0/3400053307 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bec00c730 con 0x7f7c04155880 2024-08-17T02:49:06.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.471+0000 7f7c00c00640 1 -- 172.21.15.100:0/3400053307 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec00caf0 con 0x7f7c04155880 2024-08-17T02:49:06.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.471+0000 7f7c0a000640 1 -- 172.21.15.100:0/3400053307 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0415b7e0 con 0x7f7c04155880 2024-08-17T02:49:06.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.471+0000 7f7c0a000640 1 -- 172.21.15.100:0/3400053307 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c041472a0 con 0x7f7c04155880 2024-08-17T02:49:06.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.472+0000 7f7c0a000640 1 -- 172.21.15.100:0/3400053307 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7c04071050 con 0x7f7c04155880 2024-08-17T02:49:06.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.473+0000 7f7c00c00640 1 -- 172.21.15.100:0/3400053307 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7bec012070 con 0x7f7c04155880 2024-08-17T02:49:06.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.473+0000 7f7c00c00640 1 --2- 172.21.15.100:0/3400053307 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7be0065150 0x7f7be0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:06.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.474+0000 7f7c00c00640 1 -- 172.21.15.100:0/3400053307 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7bec081870 con 0x7f7c04155880 2024-08-17T02:49:06.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.474+0000 7f7c08c00640 1 --2- 172.21.15.100:0/3400053307 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7be0065150 0x7f7be0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:06.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.474+0000 7f7c00c00640 1 --2- 172.21.15.100:0/3400053307 >> [v2:172.21.15.100:6800/37019,v1:172.21.15.100:6801/37019] conn(0x7f7be006b040 0x7f7be006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:06.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.474+0000 7f7c00c00640 1 -- 172.21.15.100:0/3400053307 --> [v2:172.21.15.100:6800/37019,v1:172.21.15.100:6801/37019] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7be006db00 con 0x7f7be006b040 2024-08-17T02:49:06.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.474+0000 7f7c00c00640 1 -- 172.21.15.100:0/3400053307 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bec083dd0 con 0x7f7c04155880 2024-08-17T02:49:06.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.474+0000 7f7c09600640 1 --2- 172.21.15.100:0/3400053307 >> [v2:172.21.15.100:6800/37019,v1:172.21.15.100:6801/37019] conn(0x7f7be006b040 0x7f7be006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:06.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.474+0000 7f7c08c00640 1 --2- 172.21.15.100:0/3400053307 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7be0065150 0x7f7be0067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4034000 tx=0x7f7bf4032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:06.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.475+0000 7f7c09600640 1 --2- 172.21.15.100:0/3400053307 >> [v2:172.21.15.100:6800/37019,v1:172.21.15.100:6801/37019] conn(0x7f7be006b040 0x7f7be006d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:06.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.475+0000 7f7c00c00640 1 -- 172.21.15.100:0/3400053307 <== osd.0 v2:172.21.15.100:6800/37019 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f7be006db00 con 0x7f7be006b040 2024-08-17T02:49:06.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.488+0000 7f7c0a000640 1 -- 172.21.15.100:0/3400053307 --> [v2:172.21.15.100:6800/37019,v1:172.21.15.100:6801/37019] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7c040b01c0 con 0x7f7be006b040 2024-08-17T02:49:06.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.489+0000 7f7c00c00640 1 -- 172.21.15.100:0/3400053307 <== osd.0 v2:172.21.15.100:6800/37019 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7c040b01c0 con 0x7f7be006b040 2024-08-17T02:49:06.489 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-08-17T02:49:06.490 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:49:06.490 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-08-17T02:49:06.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.489+0000 7f7c0a000640 1 -- 172.21.15.100:0/3400053307 >> [v2:172.21.15.100:6800/37019,v1:172.21.15.100:6801/37019] conn(0x7f7be006b040 msgr2=0x7f7be006d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:06.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.489+0000 7f7c0a000640 1 --2- 172.21.15.100:0/3400053307 >> [v2:172.21.15.100:6800/37019,v1:172.21.15.100:6801/37019] conn(0x7f7be006b040 0x7f7be006d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:06.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.489+0000 7f7c0a000640 1 -- 172.21.15.100:0/3400053307 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7be0065150 msgr2=0x7f7be0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:06.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.489+0000 7f7c0a000640 1 --2- 172.21.15.100:0/3400053307 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f7be0065150 0x7f7be0067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4034000 tx=0x7f7bf4032000 comp rx=0 tx=0).stop 2024-08-17T02:49:06.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.489+0000 7f7c0a000640 1 -- 172.21.15.100:0/3400053307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c04155880 msgr2=0x7f7c04160050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:06.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.489+0000 7f7c0a000640 1 --2- 172.21.15.100:0/3400053307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c04155880 0x7f7c04160050 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00b810 tx=0x7f7bec0091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:06.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.489+0000 7f7c09600640 1 -- 172.21.15.100:0/3400053307 reap_dead start 2024-08-17T02:49:06.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.489+0000 7f7c0a000640 1 -- 172.21.15.100:0/3400053307 shutdown_connections 2024-08-17T02:49:06.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.489+0000 7f7c0a000640 1 -- 172.21.15.100:0/3400053307 >> 172.21.15.100:0/3400053307 conn(0x7f7c04067750 msgr2=0x7f7c04149810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:06.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.489+0000 7f7c0a000640 1 -- 172.21.15.100:0/3400053307 shutdown_connections 2024-08-17T02:49:06.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.489+0000 7f7c0a000640 1 -- 172.21.15.100:0/3400053307 wait complete. 2024-08-17T02:49:06.503 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-17T02:49:06.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.650+0000 7f86c7200640 1 Processor -- start 2024-08-17T02:49:06.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.651+0000 7f86c7200640 1 -- start start 2024-08-17T02:49:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.652+0000 7f86c7200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f86c80b0270 0x7f86c81563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.652+0000 7f86c7200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f86c8158b30 0x7f86c80ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.652+0000 7f86c7200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c8157690 con 0x7f86c8155900 2024-08-17T02:49:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.652+0000 7f86c7200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c8156a80 con 0x7f86c80b0270 2024-08-17T02:49:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.652+0000 7f86c7200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c8156d60 con 0x7f86c8158b30 2024-08-17T02:49:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.652+0000 7f86c5400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f86c80b0270 0x7f86c81563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:06.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.652+0000 7f86c5e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f86c8155900 0x7f86c8155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38292/0 (socket says 172.21.15.100:38292) 2024-08-17T02:49:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.652+0000 7f86c5e00640 1 -- 172.21.15.100:0/515637073 learned_addr learned my addr 172.21.15.100:0/515637073 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:49:06.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.652+0000 7f86c6800640 1 --2- 172.21.15.100:0/515637073 >> v2:172.21.15.123:3300/0 conn(0x7f86c8158b30 0x7f86c80ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:06.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.653+0000 7f86c5400640 1 -- 172.21.15.100:0/515637073 >> v2:172.21.15.123:3300/0 conn(0x7f86c8158b30 msgr2=0x7f86c80ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:06.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.653+0000 7f86c5400640 1 --2- 172.21.15.100:0/515637073 >> v2:172.21.15.123:3300/0 conn(0x7f86c8158b30 0x7f86c80ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:06.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.653+0000 7f86c5400640 1 -- 172.21.15.100:0/515637073 >> v1:172.21.15.100:6789/0 conn(0x7f86c8155900 legacy=0x7f86c8155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:06.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.653+0000 7f86c5400640 1 -- 172.21.15.100:0/515637073 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c8157040 con 0x7f86c80b0270 2024-08-17T02:49:06.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.653+0000 7f86c4a00640 1 -- 172.21.15.100:0/515637073 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053847197 0 0) 0x7f86c8157690 con 0x7f86c8155900 2024-08-17T02:49:06.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.654+0000 7f86c5400640 1 --2- 172.21.15.100:0/515637073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86c80b0270 0x7f86c81563e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f86c80b06c0 tx=0x7f86b40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ba57cae0cb92e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:06.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.654+0000 7f86c4a00640 1 -- 172.21.15.100:0/515637073 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b402adb0 con 0x7f86c80b0270 2024-08-17T02:49:06.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.654+0000 7f86c4a00640 1 -- 172.21.15.100:0/515637073 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b4032440 con 0x7f86c80b0270 2024-08-17T02:49:06.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.654+0000 7f86c4a00640 1 -- 172.21.15.100:0/515637073 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b40327e0 con 0x7f86c80b0270 2024-08-17T02:49:06.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.654+0000 7f86c7200640 1 -- 172.21.15.100:0/515637073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86c80b0270 msgr2=0x7f86c81563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:06.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.654+0000 7f86c7200640 1 --2- 172.21.15.100:0/515637073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86c80b0270 0x7f86c81563e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f86c80b06c0 tx=0x7f86b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:06.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.655+0000 7f86c7200640 1 -- 172.21.15.100:0/515637073 shutdown_connections 2024-08-17T02:49:06.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.655+0000 7f86c7200640 1 --2- 172.21.15.100:0/515637073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86c80b0270 0x7f86c81563e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:06.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.655+0000 7f86c7200640 1 --2- 172.21.15.100:0/515637073 >> v2:172.21.15.123:3300/0 conn(0x7f86c8158b30 0x7f86c80ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:06.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.655+0000 7f86c7200640 1 -- 172.21.15.100:0/515637073 >> 172.21.15.100:0/515637073 conn(0x7f86c8067750 msgr2=0x7f86c80cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:06.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.655+0000 7f86c7200640 1 -- 172.21.15.100:0/515637073 shutdown_connections 2024-08-17T02:49:06.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.655+0000 7f86c7200640 1 -- 172.21.15.100:0/515637073 wait complete. 2024-08-17T02:49:06.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.656+0000 7f86c7200640 1 Processor -- start 2024-08-17T02:49:06.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.656+0000 7f86c7200640 1 -- start start 2024-08-17T02:49:06.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.657+0000 7f86c7200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f86c80b0270 0x7f86c80ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:06.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.657+0000 7f86c7200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86c8155900 0x7f86c80c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:06.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.657+0000 7f86c7200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86c8158b30 0x7f86c814c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:06.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.657+0000 7f86c7200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80cb250 con 0x7f86c8158b30 2024-08-17T02:49:06.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.657+0000 7f86c7200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80c8d20 con 0x7f86c8155900 2024-08-17T02:49:06.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.657+0000 7f86c7200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80c83f0 con 0x7f86c80b0270 2024-08-17T02:49:06.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.657+0000 7f86c6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86c8158b30 0x7f86c814c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:06.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.657+0000 7f86c6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86c8158b30 0x7f86c814c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38094/0 (socket says 172.21.15.100:38094) 2024-08-17T02:49:06.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.657+0000 7f86c6800640 1 -- 172.21.15.100:0/2365226379 learned_addr learned my addr 172.21.15.100:0/2365226379 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:06.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.657+0000 7f86c5400640 1 --2- 172.21.15.100:0/2365226379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86c8155900 0x7f86c80c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:06.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.657+0000 7f86c5e00640 1 --2- 172.21.15.100:0/2365226379 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f86c80b0270 0x7f86c80ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:06.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.658+0000 7f86c6800640 1 -- 172.21.15.100:0/2365226379 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f86c80b0270 msgr2=0x7f86c80ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:06.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.658+0000 7f86c6800640 1 --2- 172.21.15.100:0/2365226379 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f86c80b0270 0x7f86c80ca7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:06.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.658+0000 7f86c6800640 1 -- 172.21.15.100:0/2365226379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86c8155900 msgr2=0x7f86c80c6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:06.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.658+0000 7f86c6800640 1 --2- 172.21.15.100:0/2365226379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86c8155900 0x7f86c80c6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:06.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.658+0000 7f86c6800640 1 -- 172.21.15.100:0/2365226379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b4009390 con 0x7f86c8158b30 2024-08-17T02:49:06.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.658+0000 7f86c6800640 1 --2- 172.21.15.100:0/2365226379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86c8158b30 0x7f86c814c1c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f86c000d890 tx=0x7f86c0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:06.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.658+0000 7f86bd600640 1 -- 172.21.15.100:0/2365226379 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c00096a0 con 0x7f86c8158b30 2024-08-17T02:49:06.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.658+0000 7f86bd600640 1 -- 172.21.15.100:0/2365226379 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c0009820 con 0x7f86c8158b30 2024-08-17T02:49:06.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.658+0000 7f86bd600640 1 -- 172.21.15.100:0/2365226379 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0009be0 con 0x7f86c8158b30 2024-08-17T02:49:06.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.658+0000 7f86c7200640 1 -- 172.21.15.100:0/2365226379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c80c86d0 con 0x7f86c8158b30 2024-08-17T02:49:06.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.658+0000 7f86c7200640 1 -- 172.21.15.100:0/2365226379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c80c9230 con 0x7f86c8158b30 2024-08-17T02:49:06.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.659+0000 7f86c7200640 1 -- 172.21.15.100:0/2365226379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c80c8eb0 con 0x7f86c8158b30 2024-08-17T02:49:06.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.660+0000 7f86bd600640 1 -- 172.21.15.100:0/2365226379 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f86c0014410 con 0x7f86c8158b30 2024-08-17T02:49:06.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.661+0000 7f86bd600640 1 --2- 172.21.15.100:0/2365226379 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f86a8065150 0x7f86a8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:06.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.661+0000 7f86bd600640 1 -- 172.21.15.100:0/2365226379 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f86c0082a10 con 0x7f86c8158b30 2024-08-17T02:49:06.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.661+0000 7f86c5e00640 1 --2- 172.21.15.100:0/2365226379 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f86a8065150 0x7f86a8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:06.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.662+0000 7f86c5e00640 1 --2- 172.21.15.100:0/2365226379 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f86a8065150 0x7f86a8067600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86b8001560 tx=0x7f86b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:06.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.665+0000 7f86bd600640 1 -- 172.21.15.100:0/2365226379 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f86c0050cd0 con 0x7f86c8158b30 2024-08-17T02:49:06.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.841+0000 7f86c7200640 1 -- 172.21.15.100:0/2365226379 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f86c8071050 con 0x7f86a8065150 2024-08-17T02:49:06.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.841+0000 7f86bd600640 1 -- 172.21.15.100:0/2365226379 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f86c8071050 con 0x7f86a8065150 2024-08-17T02:49:06.842 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 0 to deep-scrub 2024-08-17T02:49:06.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.843+0000 7f86c7200640 1 -- 172.21.15.100:0/2365226379 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f86a8065150 msgr2=0x7f86a8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:06.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.843+0000 7f86c7200640 1 --2- 172.21.15.100:0/2365226379 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f86a8065150 0x7f86a8067600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86b8001560 tx=0x7f86b8009040 comp rx=0 tx=0).stop 2024-08-17T02:49:06.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.843+0000 7f86c7200640 1 -- 172.21.15.100:0/2365226379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86c8158b30 msgr2=0x7f86c814c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:06.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.844+0000 7f86c7200640 1 --2- 172.21.15.100:0/2365226379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86c8158b30 0x7f86c814c1c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f86c000d890 tx=0x7f86c0008040 comp rx=0 tx=0).stop 2024-08-17T02:49:06.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.844+0000 7f86c7200640 1 -- 172.21.15.100:0/2365226379 shutdown_connections 2024-08-17T02:49:06.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.844+0000 7f86c7200640 1 --2- 172.21.15.100:0/2365226379 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f86a8065150 0x7f86a8067600 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:06.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.844+0000 7f86c7200640 1 --2- 172.21.15.100:0/2365226379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86c8158b30 0x7f86c814c1c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:06.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.844+0000 7f86c7200640 1 --2- 172.21.15.100:0/2365226379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86c8155900 0x7f86c80c6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:06.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.844+0000 7f86c7200640 1 --2- 172.21.15.100:0/2365226379 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f86c80b0270 0x7f86c80ca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:06.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.844+0000 7f86c7200640 1 -- 172.21.15.100:0/2365226379 >> 172.21.15.100:0/2365226379 conn(0x7f86c8067750 msgr2=0x7f86c80693a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:06.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.844+0000 7f86c7200640 1 -- 172.21.15.100:0/2365226379 shutdown_connections 2024-08-17T02:49:06.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:06.844+0000 7f86c7200640 1 -- 172.21.15.100:0/2365226379 wait complete. 2024-08-17T02:49:06.859 INFO:tasks.ceph:Scrubbing osd.1 2024-08-17T02:49:06.859 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:49:07.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.010+0000 7fa88dc00640 1 Processor -- start 2024-08-17T02:49:07.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.010+0000 7fa88dc00640 1 -- start start 2024-08-17T02:49:07.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.011+0000 7fa88dc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa888150130 0x7fa8880aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.011+0000 7fa88dc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8881568b0 con 0x7fa888156d40 2024-08-17T02:49:07.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.011+0000 7fa88dc00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa888150500 con 0x7fa88806e5f0 2024-08-17T02:49:07.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.011+0000 7fa88dc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa888155fc0 con 0x7fa888150130 2024-08-17T02:49:07.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.011+0000 7fa886a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa888150130 0x7fa8880aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.011+0000 7fa886a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa888150130 0x7fa8880aa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36640/0 (socket says 172.21.15.100:36640) 2024-08-17T02:49:07.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.011+0000 7fa886a00640 1 -- 172.21.15.100:0/1500767343 learned_addr learned my addr 172.21.15.100:0/1500767343 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:07.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.011+0000 7fa886000640 1 --1- 172.21.15.100:0/1500767343 >> v1:172.21.15.100:6789/0 conn(0x7fa888156d40 0x7fa88806dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38918/0 (socket says 172.21.15.100:38918) 2024-08-17T02:49:07.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.012+0000 7fa886a00640 1 -- 172.21.15.100:0/1500767343 >> v1:172.21.15.123:6789/0 conn(0x7fa88806e5f0 legacy=0x7fa8880ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.012+0000 7fa886a00640 1 -- 172.21.15.100:0/1500767343 >> v1:172.21.15.100:6789/0 conn(0x7fa888156d40 legacy=0x7fa88806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.012+0000 7fa886a00640 1 -- 172.21.15.100:0/1500767343 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8880add60 con 0x7fa888150130 2024-08-17T02:49:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.013+0000 7fa886a00640 1 --2- 172.21.15.100:0/1500767343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa888150130 0x7fa8880aa730 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa878009910 tx=0x7fa8780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58607a9eeadf2b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.013+0000 7fa885600640 1 -- 172.21.15.100:0/1500767343 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87802ae60 con 0x7fa888150130 2024-08-17T02:49:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.013+0000 7fa885600640 1 -- 172.21.15.100:0/1500767343 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa878032440 con 0x7fa888150130 2024-08-17T02:49:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.013+0000 7fa885600640 1 -- 172.21.15.100:0/1500767343 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780327e0 con 0x7fa888150130 2024-08-17T02:49:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.014+0000 7fa88dc00640 1 -- 172.21.15.100:0/1500767343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa888150130 msgr2=0x7fa8880aa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.014+0000 7fa88dc00640 1 --2- 172.21.15.100:0/1500767343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa888150130 0x7fa8880aa730 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa878009910 tx=0x7fa8780091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.014+0000 7fa88dc00640 1 -- 172.21.15.100:0/1500767343 shutdown_connections 2024-08-17T02:49:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.014+0000 7fa88dc00640 1 --2- 172.21.15.100:0/1500767343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa888150130 0x7fa8880aa730 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.014+0000 7fa88dc00640 1 -- 172.21.15.100:0/1500767343 >> 172.21.15.100:0/1500767343 conn(0x7fa888067750 msgr2=0x7fa88806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.014+0000 7fa88dc00640 1 -- 172.21.15.100:0/1500767343 shutdown_connections 2024-08-17T02:49:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.014+0000 7fa88dc00640 1 -- 172.21.15.100:0/1500767343 wait complete. 2024-08-17T02:49:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.015+0000 7fa88dc00640 1 Processor -- start 2024-08-17T02:49:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.015+0000 7fa88dc00640 1 -- start start 2024-08-17T02:49:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.016+0000 7fa88dc00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa88806e5f0 0x7fa88813ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.016+0000 7fa88dc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa888150130 0x7fa888147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.016+0000 7fa88dc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa888156d40 0x7fa8880ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.016+0000 7fa88dc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88813e730 con 0x7fa888150130 2024-08-17T02:49:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.016+0000 7fa88dc00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa888140100 con 0x7fa888156d40 2024-08-17T02:49:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.016+0000 7fa88dc00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8881403e0 con 0x7fa88806e5f0 2024-08-17T02:49:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.016+0000 7fa886000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa888150130 0x7fa888147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.016+0000 7fa886000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa888150130 0x7fa888147280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36652/0 (socket says 172.21.15.100:36652) 2024-08-17T02:49:07.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.016+0000 7fa886000640 1 -- 172.21.15.100:0/3083014288 learned_addr learned my addr 172.21.15.100:0/3083014288 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:07.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.016+0000 7fa886a00640 1 --2- 172.21.15.100:0/3083014288 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa88806e5f0 0x7fa88813ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.016+0000 7fa887400640 1 --2- 172.21.15.100:0/3083014288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa888156d40 0x7fa8880ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.017+0000 7fa886000640 1 -- 172.21.15.100:0/3083014288 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa88806e5f0 msgr2=0x7fa88813ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.017+0000 7fa886000640 1 --2- 172.21.15.100:0/3083014288 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa88806e5f0 0x7fa88813ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.017+0000 7fa886000640 1 -- 172.21.15.100:0/3083014288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa888156d40 msgr2=0x7fa8880ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.017+0000 7fa886000640 1 --2- 172.21.15.100:0/3083014288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa888156d40 0x7fa8880ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.017+0000 7fa886000640 1 -- 172.21.15.100:0/3083014288 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa878009450 con 0x7fa888150130 2024-08-17T02:49:07.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.017+0000 7fa886000640 1 --2- 172.21.15.100:0/3083014288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa888150130 0x7fa888147280 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa87400c590 tx=0x7fa874007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:07.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.017+0000 7fa87e000640 1 -- 172.21.15.100:0/3083014288 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa874007300 con 0x7fa888150130 2024-08-17T02:49:07.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.017+0000 7fa87e000640 1 -- 172.21.15.100:0/3083014288 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8740074a0 con 0x7fa888150130 2024-08-17T02:49:07.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.017+0000 7fa87e000640 1 -- 172.21.15.100:0/3083014288 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8740047a0 con 0x7fa888150130 2024-08-17T02:49:07.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.017+0000 7fa88dc00640 1 -- 172.21.15.100:0/3083014288 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8881406c0 con 0x7fa888150130 2024-08-17T02:49:07.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.018+0000 7fa88dc00640 1 -- 172.21.15.100:0/3083014288 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88813e300 con 0x7fa888150130 2024-08-17T02:49:07.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.019+0000 7fa88dc00640 1 -- 172.21.15.100:0/3083014288 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa888140270 con 0x7fa888150130 2024-08-17T02:49:07.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.020+0000 7fa87e000640 1 -- 172.21.15.100:0/3083014288 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa874004bf0 con 0x7fa888150130 2024-08-17T02:49:07.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.020+0000 7fa87e000640 1 --2- 172.21.15.100:0/3083014288 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa868065150 0x7fa868067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.020+0000 7fa87e000640 1 -- 172.21.15.100:0/3083014288 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa8740814a0 con 0x7fa888150130 2024-08-17T02:49:07.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.021+0000 7fa87e000640 1 --2- 172.21.15.100:0/3083014288 >> [v2:172.21.15.100:6816/37022,v1:172.21.15.100:6817/37022] conn(0x7fa86806b040 0x7fa86806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.021+0000 7fa886a00640 1 --2- 172.21.15.100:0/3083014288 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa868065150 0x7fa868067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.021+0000 7fa87e000640 1 -- 172.21.15.100:0/3083014288 --> [v2:172.21.15.100:6816/37022,v1:172.21.15.100:6817/37022] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa86806db00 con 0x7fa86806b040 2024-08-17T02:49:07.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.021+0000 7fa87e000640 1 -- 172.21.15.100:0/3083014288 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa874083a80 con 0x7fa888150130 2024-08-17T02:49:07.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.021+0000 7fa887400640 1 --2- 172.21.15.100:0/3083014288 >> [v2:172.21.15.100:6816/37022,v1:172.21.15.100:6817/37022] conn(0x7fa86806b040 0x7fa86806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.021+0000 7fa886a00640 1 --2- 172.21.15.100:0/3083014288 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa868065150 0x7fa868067600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa878034000 tx=0x7fa878032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:07.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.021+0000 7fa887400640 1 --2- 172.21.15.100:0/3083014288 >> [v2:172.21.15.100:6816/37022,v1:172.21.15.100:6817/37022] conn(0x7fa86806b040 0x7fa86806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:07.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.022+0000 7fa87e000640 1 -- 172.21.15.100:0/3083014288 <== osd.1 v2:172.21.15.100:6816/37022 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fa86806db00 con 0x7fa86806b040 2024-08-17T02:49:07.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.035+0000 7fa88dc00640 1 -- 172.21.15.100:0/3083014288 --> [v2:172.21.15.100:6816/37022,v1:172.21.15.100:6817/37022] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa8880aa9f0 con 0x7fa86806b040 2024-08-17T02:49:07.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.035+0000 7fa87e000640 1 -- 172.21.15.100:0/3083014288 <== osd.1 v2:172.21.15.100:6816/37022 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa8880aa9f0 con 0x7fa86806b040 2024-08-17T02:49:07.036 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-08-17T02:49:07.037 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:49:07.037 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-08-17T02:49:07.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.035+0000 7fa88dc00640 1 -- 172.21.15.100:0/3083014288 >> [v2:172.21.15.100:6816/37022,v1:172.21.15.100:6817/37022] conn(0x7fa86806b040 msgr2=0x7fa86806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.035+0000 7fa88dc00640 1 --2- 172.21.15.100:0/3083014288 >> [v2:172.21.15.100:6816/37022,v1:172.21.15.100:6817/37022] conn(0x7fa86806b040 0x7fa86806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.035+0000 7fa88dc00640 1 -- 172.21.15.100:0/3083014288 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa868065150 msgr2=0x7fa868067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.035+0000 7fa88dc00640 1 --2- 172.21.15.100:0/3083014288 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa868065150 0x7fa868067600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa878034000 tx=0x7fa878032000 comp rx=0 tx=0).stop 2024-08-17T02:49:07.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.035+0000 7fa88dc00640 1 -- 172.21.15.100:0/3083014288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa888150130 msgr2=0x7fa888147280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.035+0000 7fa88dc00640 1 --2- 172.21.15.100:0/3083014288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa888150130 0x7fa888147280 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa87400c590 tx=0x7fa874007eb0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.036+0000 7fa887400640 1 -- 172.21.15.100:0/3083014288 reap_dead start 2024-08-17T02:49:07.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.036+0000 7fa88dc00640 1 -- 172.21.15.100:0/3083014288 shutdown_connections 2024-08-17T02:49:07.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.036+0000 7fa88dc00640 1 -- 172.21.15.100:0/3083014288 >> 172.21.15.100:0/3083014288 conn(0x7fa888067750 msgr2=0x7fa8880aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:07.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.036+0000 7fa88dc00640 1 -- 172.21.15.100:0/3083014288 shutdown_connections 2024-08-17T02:49:07.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.036+0000 7fa88dc00640 1 -- 172.21.15.100:0/3083014288 wait complete. 2024-08-17T02:49:07.050 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-17T02:49:07.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.198+0000 7f21c6200640 1 Processor -- start 2024-08-17T02:49:07.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.198+0000 7f21c6200640 1 -- start start 2024-08-17T02:49:07.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.200+0000 7f21c6200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f21c0155df0 0x7f21c00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.200+0000 7f21c6200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c0156670 con 0x7f21c0155a20 2024-08-17T02:49:07.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.200+0000 7f21c6200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c006e5e0 con 0x7f21c006df00 2024-08-17T02:49:07.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.200+0000 7f21c6200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c00b0350 con 0x7f21c0155df0 2024-08-17T02:49:07.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.200+0000 7f21bfe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f21c0155df0 0x7f21c00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.200+0000 7f21bf400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f21c0155a20 0x7f21c006d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38922/0 (socket says 172.21.15.100:38922) 2024-08-17T02:49:07.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.200+0000 7f21bf400640 1 -- 172.21.15.100:0/390431329 learned_addr learned my addr 172.21.15.100:0/390431329 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:49:07.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.200+0000 7f21bfe00640 1 -- 172.21.15.100:0/390431329 >> v1:172.21.15.123:6789/0 conn(0x7f21c006df00 legacy=0x7f21c0156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.200+0000 7f21bfe00640 1 -- 172.21.15.100:0/390431329 >> v1:172.21.15.100:6789/0 conn(0x7f21c0155a20 legacy=0x7f21c006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.200+0000 7f21bfe00640 1 -- 172.21.15.100:0/390431329 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c006e8c0 con 0x7f21c0155df0 2024-08-17T02:49:07.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.200+0000 7f21bea00640 1 -- 172.21.15.100:0/390431329 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997185042 0 0) 0x7f21c0156670 con 0x7f21c0155a20 2024-08-17T02:49:07.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.201+0000 7f21bfe00640 1 --2- 172.21.15.100:0/390431329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c0155df0 0x7f21c00adf10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f21b8009e60 tx=0x7f21b8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1093509c2cd573bf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:07.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.202+0000 7f21bea00640 1 -- 172.21.15.100:0/390431329 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8007550 con 0x7f21c0155df0 2024-08-17T02:49:07.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.202+0000 7f21bea00640 1 -- 172.21.15.100:0/390431329 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b802d050 con 0x7f21c0155df0 2024-08-17T02:49:07.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.202+0000 7f21bea00640 1 -- 172.21.15.100:0/390431329 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b80078e0 con 0x7f21c0155df0 2024-08-17T02:49:07.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.202+0000 7f21c6200640 1 -- 172.21.15.100:0/390431329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c0155df0 msgr2=0x7f21c00adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.202+0000 7f21c6200640 1 --2- 172.21.15.100:0/390431329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c0155df0 0x7f21c00adf10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f21b8009e60 tx=0x7f21b8009780 comp rx=0 tx=0).stop 2024-08-17T02:49:07.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.202+0000 7f21c6200640 1 -- 172.21.15.100:0/390431329 shutdown_connections 2024-08-17T02:49:07.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.202+0000 7f21c6200640 1 --2- 172.21.15.100:0/390431329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c0155df0 0x7f21c00adf10 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.202+0000 7f21c6200640 1 -- 172.21.15.100:0/390431329 >> 172.21.15.100:0/390431329 conn(0x7f21c00cb9b0 msgr2=0x7f21c00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:07.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.202+0000 7f21c6200640 1 -- 172.21.15.100:0/390431329 shutdown_connections 2024-08-17T02:49:07.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.202+0000 7f21c6200640 1 -- 172.21.15.100:0/390431329 wait complete. 2024-08-17T02:49:07.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.204+0000 7f21c6200640 1 Processor -- start 2024-08-17T02:49:07.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.204+0000 7f21c6200640 1 -- start start 2024-08-17T02:49:07.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.205+0000 7f21c6200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21c006df00 0x7f21c0150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.205+0000 7f21c6200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c0155a20 0x7f21c0069b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.205+0000 7f21c6200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21c0155df0 0x7f21c006a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.205+0000 7f21c6200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0168ee0 con 0x7f21c0155a20 2024-08-17T02:49:07.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.205+0000 7f21c6200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0151dc0 con 0x7f21c0155df0 2024-08-17T02:49:07.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.205+0000 7f21c6200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0150a70 con 0x7f21c006df00 2024-08-17T02:49:07.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.205+0000 7f21b6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c0155a20 0x7f21c0069b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.205+0000 7f21b6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c0155a20 0x7f21c0069b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36668/0 (socket says 172.21.15.100:36668) 2024-08-17T02:49:07.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.205+0000 7f21b6a00640 1 -- 172.21.15.100:0/2981726711 learned_addr learned my addr 172.21.15.100:0/2981726711 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:07.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.205+0000 7f21bfe00640 1 --2- 172.21.15.100:0/2981726711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21c0155df0 0x7f21c006a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.205+0000 7f21bf400640 1 --2- 172.21.15.100:0/2981726711 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21c006df00 0x7f21c0150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.205+0000 7f21b6a00640 1 -- 172.21.15.100:0/2981726711 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21c006df00 msgr2=0x7f21c0150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.205+0000 7f21b6a00640 1 --2- 172.21.15.100:0/2981726711 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21c006df00 0x7f21c0150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.205+0000 7f21b6a00640 1 -- 172.21.15.100:0/2981726711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21c0155df0 msgr2=0x7f21c006a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.205+0000 7f21b6a00640 1 --2- 172.21.15.100:0/2981726711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21c0155df0 0x7f21c006a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.205+0000 7f21b6a00640 1 -- 172.21.15.100:0/2981726711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b8009a20 con 0x7f21c0155a20 2024-08-17T02:49:07.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.206+0000 7f21b6a00640 1 --2- 172.21.15.100:0/2981726711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c0155a20 0x7f21c0069b40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f21a800c590 tx=0x7f21a8007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:07.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.206+0000 7f21b7400640 1 -- 172.21.15.100:0/2981726711 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8011590 con 0x7f21c0155a20 2024-08-17T02:49:07.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.206+0000 7f21b7400640 1 -- 172.21.15.100:0/2981726711 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a8011710 con 0x7f21c0155a20 2024-08-17T02:49:07.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.206+0000 7f21b7400640 1 -- 172.21.15.100:0/2981726711 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8011ad0 con 0x7f21c0155a20 2024-08-17T02:49:07.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.206+0000 7f21c6200640 1 -- 172.21.15.100:0/2981726711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c0159e00 con 0x7f21c0155a20 2024-08-17T02:49:07.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.206+0000 7f21c6200640 1 -- 172.21.15.100:0/2981726711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c015a3c0 con 0x7f21c0155a20 2024-08-17T02:49:07.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.207+0000 7f21c6200640 1 -- 172.21.15.100:0/2981726711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c0064db0 con 0x7f21c0155a20 2024-08-17T02:49:07.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.208+0000 7f21b7400640 1 -- 172.21.15.100:0/2981726711 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f21a801b3b0 con 0x7f21c0155a20 2024-08-17T02:49:07.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.208+0000 7f21b7400640 1 --2- 172.21.15.100:0/2981726711 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f219c065220 0x7f219c0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.209+0000 7f21b7400640 1 -- 172.21.15.100:0/2981726711 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f21a80816d0 con 0x7f21c0155a20 2024-08-17T02:49:07.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.209+0000 7f21bf400640 1 --2- 172.21.15.100:0/2981726711 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f219c065220 0x7f219c0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.209+0000 7f21bf400640 1 --2- 172.21.15.100:0/2981726711 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f219c065220 0x7f219c0676d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f21b00011e0 tx=0x7f21b0007c80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:07.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.212+0000 7f21b7400640 1 -- 172.21.15.100:0/2981726711 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f21a804fac0 con 0x7f21c0155a20 2024-08-17T02:49:07.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.385+0000 7f21c6200640 1 -- 172.21.15.100:0/2981726711 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f21c0169020 con 0x7f219c065220 2024-08-17T02:49:07.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.386+0000 7f21b7400640 1 -- 172.21.15.100:0/2981726711 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f21c0169020 con 0x7f219c065220 2024-08-17T02:49:07.387 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 1 to deep-scrub 2024-08-17T02:49:07.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.388+0000 7f21c6200640 1 -- 172.21.15.100:0/2981726711 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f219c065220 msgr2=0x7f219c0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.388+0000 7f21c6200640 1 --2- 172.21.15.100:0/2981726711 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f219c065220 0x7f219c0676d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f21b00011e0 tx=0x7f21b0007c80 comp rx=0 tx=0).stop 2024-08-17T02:49:07.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.388+0000 7f21c6200640 1 -- 172.21.15.100:0/2981726711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c0155a20 msgr2=0x7f21c0069b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.388+0000 7f21c6200640 1 --2- 172.21.15.100:0/2981726711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c0155a20 0x7f21c0069b40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f21a800c590 tx=0x7f21a8007ec0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.388+0000 7f21c6200640 1 -- 172.21.15.100:0/2981726711 shutdown_connections 2024-08-17T02:49:07.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.388+0000 7f21c6200640 1 --2- 172.21.15.100:0/2981726711 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f219c065220 0x7f219c0676d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.388+0000 7f21c6200640 1 --2- 172.21.15.100:0/2981726711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21c0155df0 0x7f21c006a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.388+0000 7f21c6200640 1 --2- 172.21.15.100:0/2981726711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c0155a20 0x7f21c0069b40 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.388+0000 7f21c6200640 1 --2- 172.21.15.100:0/2981726711 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21c006df00 0x7f21c0150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.388+0000 7f21c6200640 1 -- 172.21.15.100:0/2981726711 >> 172.21.15.100:0/2981726711 conn(0x7f21c00cb9b0 msgr2=0x7f21c0152360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:07.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.388+0000 7f21c6200640 1 -- 172.21.15.100:0/2981726711 shutdown_connections 2024-08-17T02:49:07.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.388+0000 7f21c6200640 1 -- 172.21.15.100:0/2981726711 wait complete. 2024-08-17T02:49:07.403 INFO:tasks.ceph:Scrubbing osd.2 2024-08-17T02:49:07.404 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:49:07.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.554+0000 7f3a2cc00640 1 Processor -- start 2024-08-17T02:49:07.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.554+0000 7f3a2cc00640 1 -- start start 2024-08-17T02:49:07.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.555+0000 7f3a2cc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3a28158de0 0x7f3a280b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.555+0000 7f3a2cc00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3a280aa2a0 0x7f3a2806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.555+0000 7f3a2cc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a280ac670 con 0x7f3a2806e420 2024-08-17T02:49:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.555+0000 7f3a2cc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a281591b0 con 0x7f3a28158de0 2024-08-17T02:49:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.555+0000 7f3a2cc00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280ac4e0 con 0x7f3a280aa2a0 2024-08-17T02:49:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.555+0000 7f3a25e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3a28158de0 0x7f3a280b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.555+0000 7f3a26800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3a2806e420 0x7f3a280ae9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38936/0 (socket says 172.21.15.100:38936) 2024-08-17T02:49:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.555+0000 7f3a26800640 1 -- 172.21.15.100:0/344712845 learned_addr learned my addr 172.21.15.100:0/344712845 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:49:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.556+0000 7f3a25400640 1 --2- 172.21.15.100:0/344712845 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3a280aa2a0 0x7f3a2806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.556+0000 7f3a25e00640 1 -- 172.21.15.100:0/344712845 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3a280aa2a0 msgr2=0x7f3a2806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:07.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.556+0000 7f3a25e00640 1 --2- 172.21.15.100:0/344712845 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3a280aa2a0 0x7f3a2806dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.556+0000 7f3a25e00640 1 -- 172.21.15.100:0/344712845 >> v1:172.21.15.100:6789/0 conn(0x7f3a2806e420 legacy=0x7f3a280ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.556+0000 7f3a25e00640 1 -- 172.21.15.100:0/344712845 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a280aa860 con 0x7f3a28158de0 2024-08-17T02:49:07.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.556+0000 7f3a24a00640 1 -- 172.21.15.100:0/344712845 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639755709 0 0) 0x7f3a280ac670 con 0x7f3a2806e420 2024-08-17T02:49:07.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.556+0000 7f3a25400640 1 --2- 172.21.15.100:0/344712845 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3a280aa2a0 0x7f3a2806dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:07.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.557+0000 7f3a25e00640 1 --2- 172.21.15.100:0/344712845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a28158de0 0x7f3a280b0450 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009850 tx=0x7f3a180090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79cd85e5611b059 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:07.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.557+0000 7f3a24a00640 1 -- 172.21.15.100:0/344712845 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1802ad90 con 0x7f3a28158de0 2024-08-17T02:49:07.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.557+0000 7f3a24a00640 1 -- 172.21.15.100:0/344712845 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a18032440 con 0x7f3a28158de0 2024-08-17T02:49:07.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.557+0000 7f3a24a00640 1 -- 172.21.15.100:0/344712845 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a180327e0 con 0x7f3a28158de0 2024-08-17T02:49:07.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.558+0000 7f3a2cc00640 1 -- 172.21.15.100:0/344712845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a28158de0 msgr2=0x7f3a280b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.558+0000 7f3a2cc00640 1 --2- 172.21.15.100:0/344712845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a28158de0 0x7f3a280b0450 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009850 tx=0x7f3a180090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.558+0000 7f3a2cc00640 1 -- 172.21.15.100:0/344712845 shutdown_connections 2024-08-17T02:49:07.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.558+0000 7f3a2cc00640 1 --2- 172.21.15.100:0/344712845 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3a280aa2a0 0x7f3a2806dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.558+0000 7f3a2cc00640 1 --2- 172.21.15.100:0/344712845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a28158de0 0x7f3a280b0450 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.558+0000 7f3a2cc00640 1 -- 172.21.15.100:0/344712845 >> 172.21.15.100:0/344712845 conn(0x7f3a28067750 msgr2=0x7f3a2806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:07.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.558+0000 7f3a2cc00640 1 -- 172.21.15.100:0/344712845 shutdown_connections 2024-08-17T02:49:07.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.558+0000 7f3a2cc00640 1 -- 172.21.15.100:0/344712845 wait complete. 2024-08-17T02:49:07.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.559+0000 7f3a2cc00640 1 Processor -- start 2024-08-17T02:49:07.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.559+0000 7f3a2cc00640 1 -- start start 2024-08-17T02:49:07.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.560+0000 7f3a2cc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a2806e420 0x7f3a2815ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.560+0000 7f3a2cc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a280aa2a0 0x7f3a2806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.560+0000 7f3a2cc00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3a28158de0 0x7f3a28148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.560+0000 7f3a2cc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2806a450 con 0x7f3a2806e420 2024-08-17T02:49:07.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.560+0000 7f3a2cc00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280693d0 con 0x7f3a280aa2a0 2024-08-17T02:49:07.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.560+0000 7f3a2cc00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280696b0 con 0x7f3a28158de0 2024-08-17T02:49:07.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.560+0000 7f3a25e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a2806e420 0x7f3a2815ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.560+0000 7f3a25e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a2806e420 0x7f3a2815ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36688/0 (socket says 172.21.15.100:36688) 2024-08-17T02:49:07.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.561+0000 7f3a25e00640 1 -- 172.21.15.100:0/4241101497 learned_addr learned my addr 172.21.15.100:0/4241101497 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:07.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.561+0000 7f3a26800640 1 --2- 172.21.15.100:0/4241101497 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3a28158de0 0x7f3a28148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.561+0000 7f3a25400640 1 --2- 172.21.15.100:0/4241101497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a280aa2a0 0x7f3a2806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.561+0000 7f3a25e00640 1 -- 172.21.15.100:0/4241101497 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3a28158de0 msgr2=0x7f3a28148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.561+0000 7f3a25e00640 1 --2- 172.21.15.100:0/4241101497 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3a28158de0 0x7f3a28148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.561+0000 7f3a25e00640 1 -- 172.21.15.100:0/4241101497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a280aa2a0 msgr2=0x7f3a2806c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.561+0000 7f3a25e00640 1 --2- 172.21.15.100:0/4241101497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a280aa2a0 0x7f3a2806c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.561+0000 7f3a25e00640 1 -- 172.21.15.100:0/4241101497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a18009390 con 0x7f3a2806e420 2024-08-17T02:49:07.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.561+0000 7f3a25400640 1 --2- 172.21.15.100:0/4241101497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a280aa2a0 0x7f3a2806c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:07.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.561+0000 7f3a26800640 1 --2- 172.21.15.100:0/4241101497 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3a28158de0 0x7f3a28148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:07.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.561+0000 7f3a25e00640 1 --2- 172.21.15.100:0/4241101497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a2806e420 0x7f3a2815ce20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009850 tx=0x7f3a18032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:07.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.561+0000 7f3a1d600640 1 -- 172.21.15.100:0/4241101497 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18000d10 con 0x7f3a2806e420 2024-08-17T02:49:07.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.561+0000 7f3a1d600640 1 -- 172.21.15.100:0/4241101497 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a18031a60 con 0x7f3a2806e420 2024-08-17T02:49:07.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.561+0000 7f3a1d600640 1 -- 172.21.15.100:0/4241101497 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18031e60 con 0x7f3a2806e420 2024-08-17T02:49:07.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.562+0000 7f3a2cc00640 1 -- 172.21.15.100:0/4241101497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a28069990 con 0x7f3a2806e420 2024-08-17T02:49:07.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.562+0000 7f3a2cc00640 1 -- 172.21.15.100:0/4241101497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a28069060 con 0x7f3a2806e420 2024-08-17T02:49:07.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.563+0000 7f3a2cc00640 1 -- 172.21.15.100:0/4241101497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3a281592f0 con 0x7f3a2806e420 2024-08-17T02:49:07.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.563+0000 7f3a1d600640 1 -- 172.21.15.100:0/4241101497 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3a1803c400 con 0x7f3a2806e420 2024-08-17T02:49:07.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.564+0000 7f3a1d600640 1 --2- 172.21.15.100:0/4241101497 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3a08065150 0x7f3a08067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.564+0000 7f3a1d600640 1 -- 172.21.15.100:0/4241101497 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f3a180a23c0 con 0x7f3a2806e420 2024-08-17T02:49:07.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.565+0000 7f3a25400640 1 --2- 172.21.15.100:0/4241101497 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3a08065150 0x7f3a08067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.565+0000 7f3a1d600640 1 --2- 172.21.15.100:0/4241101497 >> [v2:172.21.15.100:6808/37021,v1:172.21.15.100:6809/37021] conn(0x7f3a0806aed0 0x7f3a0806d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.565+0000 7f3a1d600640 1 -- 172.21.15.100:0/4241101497 --> [v2:172.21.15.100:6808/37021,v1:172.21.15.100:6809/37021] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a0806d990 con 0x7f3a0806aed0 2024-08-17T02:49:07.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.565+0000 7f3a1d600640 1 -- 172.21.15.100:0/4241101497 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a180a4a00 con 0x7f3a2806e420 2024-08-17T02:49:07.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.565+0000 7f3a26800640 1 --2- 172.21.15.100:0/4241101497 >> [v2:172.21.15.100:6808/37021,v1:172.21.15.100:6809/37021] conn(0x7f3a0806aed0 0x7f3a0806d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.565+0000 7f3a25400640 1 --2- 172.21.15.100:0/4241101497 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3a08065150 0x7f3a08067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3a14006e70 tx=0x7f3a14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:07.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.566+0000 7f3a26800640 1 --2- 172.21.15.100:0/4241101497 >> [v2:172.21.15.100:6808/37021,v1:172.21.15.100:6809/37021] conn(0x7f3a0806aed0 0x7f3a0806d2e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:07.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.566+0000 7f3a1d600640 1 -- 172.21.15.100:0/4241101497 <== osd.2 v2:172.21.15.100:6808/37021 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f3a0806d990 con 0x7f3a0806aed0 2024-08-17T02:49:07.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.579+0000 7f3a2cc00640 1 -- 172.21.15.100:0/4241101497 --> [v2:172.21.15.100:6808/37021,v1:172.21.15.100:6809/37021] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3a280710c0 con 0x7f3a0806aed0 2024-08-17T02:49:07.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.579+0000 7f3a1d600640 1 -- 172.21.15.100:0/4241101497 <== osd.2 v2:172.21.15.100:6808/37021 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3a280710c0 con 0x7f3a0806aed0 2024-08-17T02:49:07.580 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-08-17T02:49:07.580 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:49:07.580 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-08-17T02:49:07.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.579+0000 7f3a2cc00640 1 -- 172.21.15.100:0/4241101497 >> [v2:172.21.15.100:6808/37021,v1:172.21.15.100:6809/37021] conn(0x7f3a0806aed0 msgr2=0x7f3a0806d2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.579+0000 7f3a2cc00640 1 --2- 172.21.15.100:0/4241101497 >> [v2:172.21.15.100:6808/37021,v1:172.21.15.100:6809/37021] conn(0x7f3a0806aed0 0x7f3a0806d2e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.580+0000 7f3a2cc00640 1 -- 172.21.15.100:0/4241101497 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3a08065150 msgr2=0x7f3a08067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.580+0000 7f3a2cc00640 1 --2- 172.21.15.100:0/4241101497 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f3a08065150 0x7f3a08067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3a14006e70 tx=0x7f3a14008040 comp rx=0 tx=0).stop 2024-08-17T02:49:07.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.580+0000 7f3a2cc00640 1 -- 172.21.15.100:0/4241101497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a2806e420 msgr2=0x7f3a2815ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.580+0000 7f3a2cc00640 1 --2- 172.21.15.100:0/4241101497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a2806e420 0x7f3a2815ce20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009850 tx=0x7f3a18032000 comp rx=0 tx=0).stop 2024-08-17T02:49:07.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.580+0000 7f3a26800640 1 -- 172.21.15.100:0/4241101497 reap_dead start 2024-08-17T02:49:07.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.580+0000 7f3a2cc00640 1 -- 172.21.15.100:0/4241101497 shutdown_connections 2024-08-17T02:49:07.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.580+0000 7f3a2cc00640 1 -- 172.21.15.100:0/4241101497 >> 172.21.15.100:0/4241101497 conn(0x7f3a28067750 msgr2=0x7f3a2815f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:07.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.580+0000 7f3a2cc00640 1 -- 172.21.15.100:0/4241101497 shutdown_connections 2024-08-17T02:49:07.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.580+0000 7f3a2cc00640 1 -- 172.21.15.100:0/4241101497 wait complete. 2024-08-17T02:49:07.594 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-17T02:49:07.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.741+0000 7fa4b8c00640 1 Processor -- start 2024-08-17T02:49:07.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.741+0000 7fa4b8c00640 1 -- start start 2024-08-17T02:49:07.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.742+0000 7fa4b8c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa4b4158f80 0x7fa4b40ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.742+0000 7fa4b8c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b40cb560 con 0x7fa4b4159350 2024-08-17T02:49:07.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.742+0000 7fa4b8c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b40ce6e0 con 0x7fa4b40cf280 2024-08-17T02:49:07.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.742+0000 7fa4b8c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b40cf7e0 con 0x7fa4b4158f80 2024-08-17T02:49:07.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.742+0000 7fa4a9400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa4b4159350 0x7fa4b40cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38948/0 (socket says 172.21.15.100:38948) 2024-08-17T02:49:07.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.742+0000 7fa4a9400640 1 -- 172.21.15.100:0/1137862169 learned_addr learned my addr 172.21.15.100:0/1137862169 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:49:07.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.743+0000 7fa4b1e00640 1 --2- 172.21.15.100:0/1137862169 >> v2:172.21.15.123:3300/0 conn(0x7fa4b4158f80 0x7fa4b40ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.743+0000 7fa4b1400640 1 -- 172.21.15.100:0/1137862169 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311138716 0 0) 0x7fa4b40cb560 con 0x7fa4b4159350 2024-08-17T02:49:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.743+0000 7fa4b1400640 1 -- 172.21.15.100:0/1137862169 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4980034e0 con 0x7fa4b4159350 2024-08-17T02:49:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.743+0000 7fa4b1400640 1 -- 172.21.15.100:0/1137862169 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723970210 0 0) 0x7fa4b40ce6e0 con 0x7fa4b40cf280 2024-08-17T02:49:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.743+0000 7fa4b1400640 1 -- 172.21.15.100:0/1137862169 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4b40cb560 con 0x7fa4b40cf280 2024-08-17T02:49:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.743+0000 7fa4b1e00640 1 -- 172.21.15.100:0/1137862169 >> v1:172.21.15.123:6789/0 conn(0x7fa4b40cf280 legacy=0x7fa4b40cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.743+0000 7fa4b1e00640 1 -- 172.21.15.100:0/1137862169 >> v1:172.21.15.100:6789/0 conn(0x7fa4b4159350 legacy=0x7fa4b40cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.743+0000 7fa4b1e00640 1 -- 172.21.15.100:0/1137862169 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b40cfac0 con 0x7fa4b4158f80 2024-08-17T02:49:07.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.744+0000 7fa4b1e00640 1 --2- 172.21.15.100:0/1137862169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b4158f80 0x7fa4b40ca330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009850 tx=0x7fa4a40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d27188ccede957f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:07.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.744+0000 7fa4b1400640 1 -- 172.21.15.100:0/1137862169 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a402ae20 con 0x7fa4b4158f80 2024-08-17T02:49:07.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.744+0000 7fa4b1400640 1 -- 172.21.15.100:0/1137862169 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a4032440 con 0x7fa4b4158f80 2024-08-17T02:49:07.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.744+0000 7fa4b1400640 1 -- 172.21.15.100:0/1137862169 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a40327c0 con 0x7fa4b4158f80 2024-08-17T02:49:07.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.745+0000 7fa4b8c00640 1 -- 172.21.15.100:0/1137862169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b4158f80 msgr2=0x7fa4b40ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.745+0000 7fa4b8c00640 1 --2- 172.21.15.100:0/1137862169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b4158f80 0x7fa4b40ca330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009850 tx=0x7fa4a40090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.745+0000 7fa4b8c00640 1 -- 172.21.15.100:0/1137862169 shutdown_connections 2024-08-17T02:49:07.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.745+0000 7fa4b8c00640 1 --2- 172.21.15.100:0/1137862169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b4158f80 0x7fa4b40ca330 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.745+0000 7fa4b8c00640 1 -- 172.21.15.100:0/1137862169 >> 172.21.15.100:0/1137862169 conn(0x7fa4b40cfd90 msgr2=0x7fa4b40d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.745+0000 7fa4b8c00640 1 -- 172.21.15.100:0/1137862169 shutdown_connections 2024-08-17T02:49:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.745+0000 7fa4b8c00640 1 -- 172.21.15.100:0/1137862169 wait complete. 2024-08-17T02:49:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.747+0000 7fa4b8c00640 1 Processor -- start 2024-08-17T02:49:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.747+0000 7fa4b8c00640 1 -- start start 2024-08-17T02:49:07.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.747+0000 7fa4b8c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4b40cf280 0x7fa4b4168e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.747+0000 7fa4b8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4b4158f80 0x7fa4b4169370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.747+0000 7fa4b8c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b4159350 0x7fa4b416c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.747+0000 7fa4b8c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b41698b0 con 0x7fa4b4158f80 2024-08-17T02:49:07.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.747+0000 7fa4b8c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b416a010 con 0x7fa4b4159350 2024-08-17T02:49:07.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.748+0000 7fa4b8c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b40b5200 con 0x7fa4b40cf280 2024-08-17T02:49:07.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.748+0000 7fa4a9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4b4158f80 0x7fa4b4169370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.748+0000 7fa4a9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4b4158f80 0x7fa4b4169370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36696/0 (socket says 172.21.15.100:36696) 2024-08-17T02:49:07.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.748+0000 7fa4a9400640 1 -- 172.21.15.100:0/520356428 learned_addr learned my addr 172.21.15.100:0/520356428 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:07.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.748+0000 7fa4b1e00640 1 --2- 172.21.15.100:0/520356428 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4b40cf280 0x7fa4b4168e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.748+0000 7fa4b2800640 1 --2- 172.21.15.100:0/520356428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b4159350 0x7fa4b416c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.748+0000 7fa4a9400640 1 -- 172.21.15.100:0/520356428 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4b40cf280 msgr2=0x7fa4b4168e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.748+0000 7fa4a9400640 1 --2- 172.21.15.100:0/520356428 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4b40cf280 0x7fa4b4168e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.748+0000 7fa4a9400640 1 -- 172.21.15.100:0/520356428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b4159350 msgr2=0x7fa4b416c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.748+0000 7fa4a9400640 1 --2- 172.21.15.100:0/520356428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b4159350 0x7fa4b416c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.748+0000 7fa4a9400640 1 -- 172.21.15.100:0/520356428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a4009390 con 0x7fa4b4158f80 2024-08-17T02:49:07.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.748+0000 7fa4b2800640 1 --2- 172.21.15.100:0/520356428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b4159350 0x7fa4b416c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:07.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.749+0000 7fa4a9400640 1 --2- 172.21.15.100:0/520356428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4b4158f80 0x7fa4b4169370 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa49c005840 tx=0x7fa49c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:07.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.749+0000 7fa4aa000640 1 -- 172.21.15.100:0/520356428 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c005aa0 con 0x7fa4b4158f80 2024-08-17T02:49:07.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.749+0000 7fa4aa000640 1 -- 172.21.15.100:0/520356428 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c005c00 con 0x7fa4b4158f80 2024-08-17T02:49:07.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.749+0000 7fa4b8c00640 1 -- 172.21.15.100:0/520356428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b416a2b0 con 0x7fa4b4158f80 2024-08-17T02:49:07.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.749+0000 7fa4aa000640 1 -- 172.21.15.100:0/520356428 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c0070f0 con 0x7fa4b4158f80 2024-08-17T02:49:07.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.749+0000 7fa4b8c00640 1 -- 172.21.15.100:0/520356428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b40b54e0 con 0x7fa4b4158f80 2024-08-17T02:49:07.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.750+0000 7fa4b8c00640 1 -- 172.21.15.100:0/520356428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b416a7b0 con 0x7fa4b4158f80 2024-08-17T02:49:07.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.750+0000 7fa4aa000640 1 -- 172.21.15.100:0/520356428 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa49c007520 con 0x7fa4b4158f80 2024-08-17T02:49:07.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.752+0000 7fa4aa000640 1 --2- 172.21.15.100:0/520356428 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa490065150 0x7fa490067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:07.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.752+0000 7fa4aa000640 1 -- 172.21.15.100:0/520356428 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa49c081cc0 con 0x7fa4b4158f80 2024-08-17T02:49:07.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.752+0000 7fa4b1e00640 1 --2- 172.21.15.100:0/520356428 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa490065150 0x7fa490067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:07.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.753+0000 7fa4b1e00640 1 --2- 172.21.15.100:0/520356428 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa490065150 0x7fa490067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4034000 tx=0x7fa4a4032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:07.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.756+0000 7fa4aa000640 1 -- 172.21.15.100:0/520356428 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa49c088080 con 0x7fa4b4158f80 2024-08-17T02:49:07.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.928+0000 7fa4b8c00640 1 -- 172.21.15.100:0/520356428 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4b4064db0 con 0x7fa490065150 2024-08-17T02:49:07.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.929+0000 7fa4aa000640 1 -- 172.21.15.100:0/520356428 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa4b4064db0 con 0x7fa490065150 2024-08-17T02:49:07.929 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 2 to deep-scrub 2024-08-17T02:49:07.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.931+0000 7fa4b8c00640 1 -- 172.21.15.100:0/520356428 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa490065150 msgr2=0x7fa490067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.931+0000 7fa4b8c00640 1 --2- 172.21.15.100:0/520356428 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa490065150 0x7fa490067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4034000 tx=0x7fa4a4032000 comp rx=0 tx=0).stop 2024-08-17T02:49:07.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.931+0000 7fa4b8c00640 1 -- 172.21.15.100:0/520356428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4b4158f80 msgr2=0x7fa4b4169370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:07.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.931+0000 7fa4b8c00640 1 --2- 172.21.15.100:0/520356428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4b4158f80 0x7fa4b4169370 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa49c005840 tx=0x7fa49c007e10 comp rx=0 tx=0).stop 2024-08-17T02:49:07.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.931+0000 7fa4b8c00640 1 -- 172.21.15.100:0/520356428 shutdown_connections 2024-08-17T02:49:07.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.931+0000 7fa4b8c00640 1 --2- 172.21.15.100:0/520356428 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa490065150 0x7fa490067600 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.931+0000 7fa4b8c00640 1 --2- 172.21.15.100:0/520356428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b4159350 0x7fa4b416c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.931+0000 7fa4b8c00640 1 --2- 172.21.15.100:0/520356428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4b4158f80 0x7fa4b4169370 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.931+0000 7fa4b8c00640 1 --2- 172.21.15.100:0/520356428 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4b40cf280 0x7fa4b4168e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:07.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.931+0000 7fa4b8c00640 1 -- 172.21.15.100:0/520356428 >> 172.21.15.100:0/520356428 conn(0x7fa4b40cfd90 msgr2=0x7fa4b40d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:07.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.931+0000 7fa4b8c00640 1 -- 172.21.15.100:0/520356428 shutdown_connections 2024-08-17T02:49:07.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:07.931+0000 7fa4b8c00640 1 -- 172.21.15.100:0/520356428 wait complete. 2024-08-17T02:49:07.946 INFO:tasks.ceph:Scrubbing osd.3 2024-08-17T02:49:07.947 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:49:08.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.096+0000 7fd587c00640 1 Processor -- start 2024-08-17T02:49:08.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.096+0000 7fd587c00640 1 -- start start 2024-08-17T02:49:08.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.098+0000 7fd587c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd580156890 0x7fd58006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.098+0000 7fd587c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5800c8840 0x7fd58006e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.098+0000 7fd587c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5800ae9b0 con 0x7fd580156c60 2024-08-17T02:49:08.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.098+0000 7fd587c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5800aa730 con 0x7fd580156890 2024-08-17T02:49:08.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.098+0000 7fd587c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5800aa9f0 con 0x7fd5800c8840 2024-08-17T02:49:08.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.098+0000 7fd585200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd580156890 0x7fd58006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.098+0000 7fd577e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd580156c60 0x7fd5800c8130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38956/0 (socket says 172.21.15.100:38956) 2024-08-17T02:49:08.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.098+0000 7fd577e00640 1 -- 172.21.15.100:0/3805896774 learned_addr learned my addr 172.21.15.100:0/3805896774 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:49:08.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.098+0000 7fd585c00640 1 --2- 172.21.15.100:0/3805896774 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5800c8840 0x7fd58006e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.098+0000 7fd585200640 1 -- 172.21.15.100:0/3805896774 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5800c8840 msgr2=0x7fd58006e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.098+0000 7fd585200640 1 --2- 172.21.15.100:0/3805896774 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5800c8840 0x7fd58006e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.098+0000 7fd585200640 1 -- 172.21.15.100:0/3805896774 >> v1:172.21.15.100:6789/0 conn(0x7fd580156c60 legacy=0x7fd5800c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.098+0000 7fd585200640 1 -- 172.21.15.100:0/3805896774 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5800ab320 con 0x7fd580156890 2024-08-17T02:49:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.098+0000 7fd585c00640 1 --2- 172.21.15.100:0/3805896774 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5800c8840 0x7fd58006e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.098+0000 7fd57fe00640 1 -- 172.21.15.100:0/3805896774 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035338202 0 0) 0x7fd5800ae9b0 con 0x7fd580156c60 2024-08-17T02:49:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.099+0000 7fd585200640 1 --2- 172.21.15.100:0/3805896774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd580156890 0x7fd58006dee0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd570009850 tx=0x7fd5700090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2cbf0c88b55ffd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.099+0000 7fd57fe00640 1 -- 172.21.15.100:0/3805896774 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57002ad00 con 0x7fd580156890 2024-08-17T02:49:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.100+0000 7fd57fe00640 1 -- 172.21.15.100:0/3805896774 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57002ae60 con 0x7fd580156890 2024-08-17T02:49:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.100+0000 7fd57fe00640 1 -- 172.21.15.100:0/3805896774 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570032670 con 0x7fd580156890 2024-08-17T02:49:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.100+0000 7fd587c00640 1 -- 172.21.15.100:0/3805896774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd580156890 msgr2=0x7fd58006dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.100+0000 7fd587c00640 1 --2- 172.21.15.100:0/3805896774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd580156890 0x7fd58006dee0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd570009850 tx=0x7fd5700090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.100+0000 7fd587c00640 1 -- 172.21.15.100:0/3805896774 shutdown_connections 2024-08-17T02:49:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.100+0000 7fd587c00640 1 --2- 172.21.15.100:0/3805896774 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5800c8840 0x7fd58006e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.100+0000 7fd587c00640 1 --2- 172.21.15.100:0/3805896774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd580156890 0x7fd58006dee0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.100+0000 7fd587c00640 1 -- 172.21.15.100:0/3805896774 >> 172.21.15.100:0/3805896774 conn(0x7fd580067750 msgr2=0x7fd58006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:08.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.100+0000 7fd587c00640 1 -- 172.21.15.100:0/3805896774 shutdown_connections 2024-08-17T02:49:08.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.100+0000 7fd587c00640 1 -- 172.21.15.100:0/3805896774 wait complete. 2024-08-17T02:49:08.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.102+0000 7fd587c00640 1 Processor -- start 2024-08-17T02:49:08.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.102+0000 7fd587c00640 1 -- start start 2024-08-17T02:49:08.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.103+0000 7fd587c00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5800c8840 0x7fd58016d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.103+0000 7fd587c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd580156890 0x7fd58014daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.103+0000 7fd587c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd580156c60 0x7fd58014e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.103+0000 7fd587c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58016db80 con 0x7fd580156c60 2024-08-17T02:49:08.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.103+0000 7fd587c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58015e5e0 con 0x7fd580156890 2024-08-17T02:49:08.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.103+0000 7fd587c00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58015d270 con 0x7fd5800c8840 2024-08-17T02:49:08.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.103+0000 7fd585c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd580156c60 0x7fd58014e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.103+0000 7fd585c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd580156c60 0x7fd58014e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36706/0 (socket says 172.21.15.100:36706) 2024-08-17T02:49:08.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.103+0000 7fd585c00640 1 -- 172.21.15.100:0/2393295332 learned_addr learned my addr 172.21.15.100:0/2393295332 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:08.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.103+0000 7fd577e00640 1 --2- 172.21.15.100:0/2393295332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd580156890 0x7fd58014daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.103+0000 7fd585200640 1 --2- 172.21.15.100:0/2393295332 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5800c8840 0x7fd58016d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.103+0000 7fd585c00640 1 -- 172.21.15.100:0/2393295332 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5800c8840 msgr2=0x7fd58016d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.103+0000 7fd585c00640 1 --2- 172.21.15.100:0/2393295332 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5800c8840 0x7fd58016d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.103+0000 7fd585c00640 1 -- 172.21.15.100:0/2393295332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd580156890 msgr2=0x7fd58014daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.103+0000 7fd585c00640 1 --2- 172.21.15.100:0/2393295332 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd580156890 0x7fd58014daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.103+0000 7fd585c00640 1 -- 172.21.15.100:0/2393295332 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd570009390 con 0x7fd580156c60 2024-08-17T02:49:08.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.104+0000 7fd585c00640 1 --2- 172.21.15.100:0/2393295332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd580156c60 0x7fd58014e3d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd57800cf20 tx=0x7fd578007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:08.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.104+0000 7fd57cc00640 1 -- 172.21.15.100:0/2393295332 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578016420 con 0x7fd580156c60 2024-08-17T02:49:08.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.104+0000 7fd57cc00640 1 -- 172.21.15.100:0/2393295332 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5780165a0 con 0x7fd580156c60 2024-08-17T02:49:08.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.104+0000 7fd57cc00640 1 -- 172.21.15.100:0/2393295332 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578016960 con 0x7fd580156c60 2024-08-17T02:49:08.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.104+0000 7fd587c00640 1 -- 172.21.15.100:0/2393295332 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58015c660 con 0x7fd580156c60 2024-08-17T02:49:08.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.104+0000 7fd587c00640 1 -- 172.21.15.100:0/2393295332 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58015cc20 con 0x7fd580156c60 2024-08-17T02:49:08.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.105+0000 7fd587c00640 1 -- 172.21.15.100:0/2393295332 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd5800710c0 con 0x7fd580156c60 2024-08-17T02:49:08.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.106+0000 7fd57cc00640 1 -- 172.21.15.100:0/2393295332 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd578016d50 con 0x7fd580156c60 2024-08-17T02:49:08.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.107+0000 7fd57cc00640 1 --2- 172.21.15.100:0/2393295332 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd55c065150 0x7fd55c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.107+0000 7fd57cc00640 1 -- 172.21.15.100:0/2393295332 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fd578012070 con 0x7fd580156c60 2024-08-17T02:49:08.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.107+0000 7fd585200640 1 --2- 172.21.15.100:0/2393295332 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd55c065150 0x7fd55c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.107+0000 7fd57cc00640 1 --2- 172.21.15.100:0/2393295332 >> [v2:172.21.15.100:6824/37041,v1:172.21.15.100:6825/37041] conn(0x7fd55c06b040 0x7fd55c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.107+0000 7fd57cc00640 1 -- 172.21.15.100:0/2393295332 --> [v2:172.21.15.100:6824/37041,v1:172.21.15.100:6825/37041] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd55c06db00 con 0x7fd55c06b040 2024-08-17T02:49:08.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.107+0000 7fd57cc00640 1 -- 172.21.15.100:0/2393295332 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd578087240 con 0x7fd580156c60 2024-08-17T02:49:08.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.107+0000 7fd577e00640 1 --2- 172.21.15.100:0/2393295332 >> [v2:172.21.15.100:6824/37041,v1:172.21.15.100:6825/37041] conn(0x7fd55c06b040 0x7fd55c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.108+0000 7fd585200640 1 --2- 172.21.15.100:0/2393295332 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd55c065150 0x7fd55c067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd570034000 tx=0x7fd570032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:08.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.108+0000 7fd577e00640 1 --2- 172.21.15.100:0/2393295332 >> [v2:172.21.15.100:6824/37041,v1:172.21.15.100:6825/37041] conn(0x7fd55c06b040 0x7fd55c06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:08.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.108+0000 7fd57cc00640 1 -- 172.21.15.100:0/2393295332 <== osd.3 v2:172.21.15.100:6824/37041 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd55c06db00 con 0x7fd55c06b040 2024-08-17T02:49:08.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.121+0000 7fd587c00640 1 -- 172.21.15.100:0/2393295332 --> [v2:172.21.15.100:6824/37041,v1:172.21.15.100:6825/37041] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd580070740 con 0x7fd55c06b040 2024-08-17T02:49:08.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.121+0000 7fd57cc00640 1 -- 172.21.15.100:0/2393295332 <== osd.3 v2:172.21.15.100:6824/37041 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd580070740 con 0x7fd55c06b040 2024-08-17T02:49:08.122 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-08-17T02:49:08.122 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:49:08.122 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-08-17T02:49:08.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.122+0000 7fd587c00640 1 -- 172.21.15.100:0/2393295332 >> [v2:172.21.15.100:6824/37041,v1:172.21.15.100:6825/37041] conn(0x7fd55c06b040 msgr2=0x7fd55c06d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.122+0000 7fd587c00640 1 --2- 172.21.15.100:0/2393295332 >> [v2:172.21.15.100:6824/37041,v1:172.21.15.100:6825/37041] conn(0x7fd55c06b040 0x7fd55c06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.122+0000 7fd587c00640 1 -- 172.21.15.100:0/2393295332 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd55c065150 msgr2=0x7fd55c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.122+0000 7fd587c00640 1 --2- 172.21.15.100:0/2393295332 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fd55c065150 0x7fd55c067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd570034000 tx=0x7fd570032000 comp rx=0 tx=0).stop 2024-08-17T02:49:08.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.122+0000 7fd587c00640 1 -- 172.21.15.100:0/2393295332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd580156c60 msgr2=0x7fd58014e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.122+0000 7fd587c00640 1 --2- 172.21.15.100:0/2393295332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd580156c60 0x7fd58014e3d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd57800cf20 tx=0x7fd578007860 comp rx=0 tx=0).stop 2024-08-17T02:49:08.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.122+0000 7fd585c00640 1 -- 172.21.15.100:0/2393295332 reap_dead start 2024-08-17T02:49:08.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.122+0000 7fd587c00640 1 -- 172.21.15.100:0/2393295332 shutdown_connections 2024-08-17T02:49:08.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.122+0000 7fd587c00640 1 -- 172.21.15.100:0/2393295332 >> 172.21.15.100:0/2393295332 conn(0x7fd580067750 msgr2=0x7fd5801546f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:08.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.122+0000 7fd587c00640 1 -- 172.21.15.100:0/2393295332 shutdown_connections 2024-08-17T02:49:08.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.122+0000 7fd587c00640 1 -- 172.21.15.100:0/2393295332 wait complete. 2024-08-17T02:49:08.136 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-17T02:49:08.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.282+0000 7ff7cf200640 1 Processor -- start 2024-08-17T02:49:08.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.283+0000 7ff7cf200640 1 -- start start 2024-08-17T02:49:08.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.284+0000 7ff7cf200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff7c8156ad0 0x7ff7c80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.284+0000 7ff7cf200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff7c806dc80 0x7ff7c81577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.284+0000 7ff7cf200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c80caaf0 con 0x7ff7c8156ea0 2024-08-17T02:49:08.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.284+0000 7ff7cf200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c80ca900 con 0x7ff7c8156ad0 2024-08-17T02:49:08.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.284+0000 7ff7cf200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80cc560 con 0x7ff7c806dc80 2024-08-17T02:49:08.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.284+0000 7ff7cde00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff7c8156ad0 0x7ff7c80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.284+0000 7ff7cde00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff7c8156ad0 0x7ff7c80cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:35184/0 (socket says 172.21.15.100:35184) 2024-08-17T02:49:08.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.284+0000 7ff7cde00640 1 -- 172.21.15.100:0/1865360661 learned_addr learned my addr 172.21.15.100:0/1865360661 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:08.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.284+0000 7ff7ce800640 1 --2- 172.21.15.100:0/1865360661 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff7c806dc80 0x7ff7c81577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.285+0000 7ff7cde00640 1 -- 172.21.15.100:0/1865360661 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff7c806dc80 msgr2=0x7ff7c81577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:08.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.285+0000 7ff7cde00640 1 --2- 172.21.15.100:0/1865360661 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff7c806dc80 0x7ff7c81577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.285+0000 7ff7cde00640 1 -- 172.21.15.100:0/1865360661 >> v1:172.21.15.123:6789/0 conn(0x7ff7c8156ea0 legacy=0x7ff7c806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.285+0000 7ff7cde00640 1 -- 172.21.15.100:0/1865360661 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c8157300 con 0x7ff7c8156ad0 2024-08-17T02:49:08.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.286+0000 7ff7cde00640 1 --2- 172.21.15.100:0/1865360661 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7c8156ad0 0x7ff7c80cbea0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009940 tx=0x7ff7bc0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e8eed1018a069ae server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:08.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.286+0000 7ff7cca00640 1 -- 172.21.15.100:0/1865360661 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc02ae40 con 0x7ff7c8156ad0 2024-08-17T02:49:08.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.286+0000 7ff7cca00640 1 -- 172.21.15.100:0/1865360661 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc032440 con 0x7ff7c8156ad0 2024-08-17T02:49:08.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.286+0000 7ff7cca00640 1 -- 172.21.15.100:0/1865360661 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc032820 con 0x7ff7c8156ad0 2024-08-17T02:49:08.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.286+0000 7ff7cf200640 1 -- 172.21.15.100:0/1865360661 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7c8156ad0 msgr2=0x7ff7c80cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.286+0000 7ff7cf200640 1 --2- 172.21.15.100:0/1865360661 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7c8156ad0 0x7ff7c80cbea0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009940 tx=0x7ff7bc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.286+0000 7ff7cf200640 1 -- 172.21.15.100:0/1865360661 shutdown_connections 2024-08-17T02:49:08.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.287+0000 7ff7cf200640 1 --2- 172.21.15.100:0/1865360661 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff7c806dc80 0x7ff7c81577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.287+0000 7ff7cf200640 1 --2- 172.21.15.100:0/1865360661 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7c8156ad0 0x7ff7c80cbea0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.287+0000 7ff7cf200640 1 -- 172.21.15.100:0/1865360661 >> 172.21.15.100:0/1865360661 conn(0x7ff7c8067750 msgr2=0x7ff7c80cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:08.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.287+0000 7ff7cf200640 1 -- 172.21.15.100:0/1865360661 shutdown_connections 2024-08-17T02:49:08.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.287+0000 7ff7cf200640 1 -- 172.21.15.100:0/1865360661 wait complete. 2024-08-17T02:49:08.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.288+0000 7ff7cf200640 1 Processor -- start 2024-08-17T02:49:08.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.288+0000 7ff7cf200640 1 -- start start 2024-08-17T02:49:08.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.289+0000 7ff7cf200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7c806dc80 0x7ff7c81521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.289+0000 7ff7cf200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c8156ad0 0x7ff7c816c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.289+0000 7ff7cf200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff7c8156ea0 0x7ff7c816cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.289+0000 7ff7cf200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8157bf0 con 0x7ff7c8156ad0 2024-08-17T02:49:08.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.289+0000 7ff7cf200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c816d330 con 0x7ff7c806dc80 2024-08-17T02:49:08.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.289+0000 7ff7cf200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c816d610 con 0x7ff7c8156ea0 2024-08-17T02:49:08.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.289+0000 7ff7cde00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7c806dc80 0x7ff7c81521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.289+0000 7ff7cd400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c8156ad0 0x7ff7c816c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.289+0000 7ff7cde00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7c806dc80 0x7ff7c81521e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.100:35200/0 (socket says 172.21.15.100:35200) 2024-08-17T02:49:08.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.289+0000 7ff7cde00640 1 -- 172.21.15.100:0/3765901442 learned_addr learned my addr 172.21.15.100:0/3765901442 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:08.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.289+0000 7ff7ce800640 1 --2- 172.21.15.100:0/3765901442 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff7c8156ea0 0x7ff7c816cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.290+0000 7ff7cde00640 1 -- 172.21.15.100:0/3765901442 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff7c8156ea0 msgr2=0x7ff7c816cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.290+0000 7ff7cde00640 1 --2- 172.21.15.100:0/3765901442 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff7c8156ea0 0x7ff7c816cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.290+0000 7ff7cde00640 1 -- 172.21.15.100:0/3765901442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c8156ad0 msgr2=0x7ff7c816c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.290+0000 7ff7cde00640 1 --2- 172.21.15.100:0/3765901442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c8156ad0 0x7ff7c816c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.290+0000 7ff7cde00640 1 -- 172.21.15.100:0/3765901442 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc009450 con 0x7ff7c806dc80 2024-08-17T02:49:08.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.290+0000 7ff7cde00640 1 --2- 172.21.15.100:0/3765901442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7c806dc80 0x7ff7c81521e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009940 tx=0x7ff7bc032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:08.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.290+0000 7ff7c1600640 1 -- 172.21.15.100:0/3765901442 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc031bb0 con 0x7ff7c806dc80 2024-08-17T02:49:08.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.290+0000 7ff7c1600640 1 -- 172.21.15.100:0/3765901442 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc031d30 con 0x7ff7c806dc80 2024-08-17T02:49:08.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.290+0000 7ff7c1600640 1 -- 172.21.15.100:0/3765901442 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc031ea0 con 0x7ff7c806dc80 2024-08-17T02:49:08.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.290+0000 7ff7cf200640 1 -- 172.21.15.100:0/3765901442 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c815c700 con 0x7ff7c806dc80 2024-08-17T02:49:08.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.290+0000 7ff7cf200640 1 -- 172.21.15.100:0/3765901442 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c815c320 con 0x7ff7c806dc80 2024-08-17T02:49:08.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.291+0000 7ff7cf200640 1 -- 172.21.15.100:0/3765901442 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c815c510 con 0x7ff7c806dc80 2024-08-17T02:49:08.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.292+0000 7ff7c1600640 1 -- 172.21.15.100:0/3765901442 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff7bc039040 con 0x7ff7c806dc80 2024-08-17T02:49:08.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.293+0000 7ff7c1600640 1 --2- 172.21.15.100:0/3765901442 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff7ac065150 0x7ff7ac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.294+0000 7ff7c1600640 1 -- 172.21.15.100:0/3765901442 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff7bc02ae40 con 0x7ff7c806dc80 2024-08-17T02:49:08.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.294+0000 7ff7cd400640 1 --2- 172.21.15.100:0/3765901442 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff7ac065150 0x7ff7ac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.294+0000 7ff7cd400640 1 --2- 172.21.15.100:0/3765901442 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff7ac065150 0x7ff7ac067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8158140 tx=0x7ff7b8007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:08.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.298+0000 7ff7c1600640 1 -- 172.21.15.100:0/3765901442 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff7bc070140 con 0x7ff7c806dc80 2024-08-17T02:49:08.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.469+0000 7ff7cf200640 1 -- 172.21.15.100:0/3765901442 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7c816d750 con 0x7ff7ac065150 2024-08-17T02:49:08.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.469+0000 7ff7c1600640 1 -- 172.21.15.100:0/3765901442 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff7c816d750 con 0x7ff7ac065150 2024-08-17T02:49:08.470 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 3 to deep-scrub 2024-08-17T02:49:08.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.471+0000 7ff7cf200640 1 -- 172.21.15.100:0/3765901442 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff7ac065150 msgr2=0x7ff7ac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.471+0000 7ff7cf200640 1 --2- 172.21.15.100:0/3765901442 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff7ac065150 0x7ff7ac067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8158140 tx=0x7ff7b8007e30 comp rx=0 tx=0).stop 2024-08-17T02:49:08.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.471+0000 7ff7cf200640 1 -- 172.21.15.100:0/3765901442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7c806dc80 msgr2=0x7ff7c81521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.471+0000 7ff7cf200640 1 --2- 172.21.15.100:0/3765901442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7c806dc80 0x7ff7c81521e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009940 tx=0x7ff7bc032000 comp rx=0 tx=0).stop 2024-08-17T02:49:08.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.471+0000 7ff7cf200640 1 -- 172.21.15.100:0/3765901442 shutdown_connections 2024-08-17T02:49:08.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.471+0000 7ff7cf200640 1 --2- 172.21.15.100:0/3765901442 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff7ac065150 0x7ff7ac067600 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.471+0000 7ff7cf200640 1 --2- 172.21.15.100:0/3765901442 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff7c8156ea0 0x7ff7c816cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.471+0000 7ff7cf200640 1 --2- 172.21.15.100:0/3765901442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c8156ad0 0x7ff7c816c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.471+0000 7ff7cf200640 1 --2- 172.21.15.100:0/3765901442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7c806dc80 0x7ff7c81521e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.472+0000 7ff7cf200640 1 -- 172.21.15.100:0/3765901442 >> 172.21.15.100:0/3765901442 conn(0x7ff7c8067750 msgr2=0x7ff7c806d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:08.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.472+0000 7ff7cf200640 1 -- 172.21.15.100:0/3765901442 shutdown_connections 2024-08-17T02:49:08.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.472+0000 7ff7cf200640 1 -- 172.21.15.100:0/3765901442 wait complete. 2024-08-17T02:49:08.488 INFO:tasks.ceph:Scrubbing osd.4 2024-08-17T02:49:08.488 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:49:08.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.639+0000 7fb0d4e00640 1 Processor -- start 2024-08-17T02:49:08.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.639+0000 7fb0d4e00640 1 -- start start 2024-08-17T02:49:08.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.640+0000 7fb0d4e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb0d0156890 0x7fb0d006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.640+0000 7fb0d4e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d00ae9b0 con 0x7fb0d00c8840 2024-08-17T02:49:08.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.641+0000 7fb0d4e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d00ab320 con 0x7fb0d0156c60 2024-08-17T02:49:08.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.641+0000 7fb0d4e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d00aa730 con 0x7fb0d0156890 2024-08-17T02:49:08.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.641+0000 7fb0ce800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb0d00c8840 0x7fb0d00ca3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38972/0 (socket says 172.21.15.100:38972) 2024-08-17T02:49:08.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.641+0000 7fb0ce800640 1 -- 172.21.15.100:0/765086310 learned_addr learned my addr 172.21.15.100:0/765086310 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:49:08.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.641+0000 7fb0cde00640 1 --2- 172.21.15.100:0/765086310 >> v2:172.21.15.123:3300/0 conn(0x7fb0d0156890 0x7fb0d006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.641+0000 7fb0cd400640 1 -- 172.21.15.100:0/765086310 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3995928969 0 0) 0x7fb0d00ae9b0 con 0x7fb0d00c8840 2024-08-17T02:49:08.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.641+0000 7fb0cd400640 1 -- 172.21.15.100:0/765086310 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0b40034e0 con 0x7fb0d00c8840 2024-08-17T02:49:08.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.641+0000 7fb0cde00640 1 -- 172.21.15.100:0/765086310 >> v1:172.21.15.123:6789/0 conn(0x7fb0d0156c60 legacy=0x7fb0d00c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.641+0000 7fb0cde00640 1 -- 172.21.15.100:0/765086310 >> v1:172.21.15.100:6789/0 conn(0x7fb0d00c8840 legacy=0x7fb0d00ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.641+0000 7fb0cde00640 1 -- 172.21.15.100:0/765086310 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d00aa9f0 con 0x7fb0d0156890 2024-08-17T02:49:08.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.642+0000 7fb0cde00640 1 --2- 172.21.15.100:0/765086310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0d0156890 0x7fb0d006dee0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0009850 tx=0x7fb0c00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=201a38083240ee8a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:08.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.643+0000 7fb0cd400640 1 -- 172.21.15.100:0/765086310 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c002ad90 con 0x7fb0d0156890 2024-08-17T02:49:08.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.643+0000 7fb0cd400640 1 -- 172.21.15.100:0/765086310 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c0032440 con 0x7fb0d0156890 2024-08-17T02:49:08.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.643+0000 7fb0cd400640 1 -- 172.21.15.100:0/765086310 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c00327e0 con 0x7fb0d0156890 2024-08-17T02:49:08.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.643+0000 7fb0d4e00640 1 -- 172.21.15.100:0/765086310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0d0156890 msgr2=0x7fb0d006dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.643+0000 7fb0d4e00640 1 --2- 172.21.15.100:0/765086310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0d0156890 0x7fb0d006dee0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0009850 tx=0x7fb0c00090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.644+0000 7fb0d4e00640 1 -- 172.21.15.100:0/765086310 shutdown_connections 2024-08-17T02:49:08.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.644+0000 7fb0d4e00640 1 --2- 172.21.15.100:0/765086310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0d0156890 0x7fb0d006dee0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.644+0000 7fb0d4e00640 1 -- 172.21.15.100:0/765086310 >> 172.21.15.100:0/765086310 conn(0x7fb0d0067750 msgr2=0x7fb0d006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:08.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.644+0000 7fb0d4e00640 1 -- 172.21.15.100:0/765086310 shutdown_connections 2024-08-17T02:49:08.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.644+0000 7fb0d4e00640 1 -- 172.21.15.100:0/765086310 wait complete. 2024-08-17T02:49:08.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.645+0000 7fb0d4e00640 1 Processor -- start 2024-08-17T02:49:08.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.645+0000 7fb0d4e00640 1 -- start start 2024-08-17T02:49:08.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.646+0000 7fb0d4e00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb0d00c8840 0x7fb0d00c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.646+0000 7fb0d4e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0d0156890 0x7fb0d0166eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.646+0000 7fb0d4e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d0156c60 0x7fb0d00aa020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.646+0000 7fb0d4e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d01673f0 con 0x7fb0d0156c60 2024-08-17T02:49:08.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.646+0000 7fb0d4e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d0167e80 con 0x7fb0d0156890 2024-08-17T02:49:08.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.646+0000 7fb0d4e00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d00aa560 con 0x7fb0d00c8840 2024-08-17T02:49:08.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.646+0000 7fb0ce800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d0156c60 0x7fb0d00aa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.646+0000 7fb0ce800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d0156c60 0x7fb0d00aa020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36732/0 (socket says 172.21.15.100:36732) 2024-08-17T02:49:08.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.646+0000 7fb0ce800640 1 -- 172.21.15.100:0/207735356 learned_addr learned my addr 172.21.15.100:0/207735356 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:08.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.646+0000 7fb0cde00640 1 --2- 172.21.15.100:0/207735356 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb0d00c8840 0x7fb0d00c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.646+0000 7fb0c5400640 1 --2- 172.21.15.100:0/207735356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0d0156890 0x7fb0d0166eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.647+0000 7fb0ce800640 1 -- 172.21.15.100:0/207735356 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb0d00c8840 msgr2=0x7fb0d00c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.647+0000 7fb0ce800640 1 --2- 172.21.15.100:0/207735356 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb0d00c8840 0x7fb0d00c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.647+0000 7fb0ce800640 1 -- 172.21.15.100:0/207735356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0d0156890 msgr2=0x7fb0d0166eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.647+0000 7fb0ce800640 1 --2- 172.21.15.100:0/207735356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0d0156890 0x7fb0d0166eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.647+0000 7fb0ce800640 1 -- 172.21.15.100:0/207735356 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c0009390 con 0x7fb0d0156c60 2024-08-17T02:49:08.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.647+0000 7fb0c5400640 1 --2- 172.21.15.100:0/207735356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0d0156890 0x7fb0d0166eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:08.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.647+0000 7fb0ce800640 1 --2- 172.21.15.100:0/207735356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d0156c60 0x7fb0d00aa020 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb0c800cca0 tx=0x7fb0c8001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:08.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.647+0000 7fb0c6000640 1 -- 172.21.15.100:0/207735356 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c800a850 con 0x7fb0d0156c60 2024-08-17T02:49:08.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.647+0000 7fb0c6000640 1 -- 172.21.15.100:0/207735356 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c800a9b0 con 0x7fb0d0156c60 2024-08-17T02:49:08.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.647+0000 7fb0c6000640 1 -- 172.21.15.100:0/207735356 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c800ad70 con 0x7fb0d0156c60 2024-08-17T02:49:08.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.647+0000 7fb0d4e00640 1 -- 172.21.15.100:0/207735356 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d01675e0 con 0x7fb0d0156c60 2024-08-17T02:49:08.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.647+0000 7fb0d4e00640 1 -- 172.21.15.100:0/207735356 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d0167ba0 con 0x7fb0d0156c60 2024-08-17T02:49:08.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.648+0000 7fb0d4e00640 1 -- 172.21.15.100:0/207735356 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb0d0069250 con 0x7fb0d0156c60 2024-08-17T02:49:08.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.649+0000 7fb0c6000640 1 -- 172.21.15.100:0/207735356 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb0c8007300 con 0x7fb0d0156c60 2024-08-17T02:49:08.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.650+0000 7fb0c6000640 1 --2- 172.21.15.100:0/207735356 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb0ac065180 0x7fb0ac067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.650+0000 7fb0c6000640 1 -- 172.21.15.100:0/207735356 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb0c8082250 con 0x7fb0d0156c60 2024-08-17T02:49:08.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.650+0000 7fb0c6000640 1 --2- 172.21.15.100:0/207735356 >> [v2:172.21.15.123:6817/37279,v1:172.21.15.123:6820/37279] conn(0x7fb0ac06b070 0x7fb0ac06d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.650+0000 7fb0c6000640 1 -- 172.21.15.100:0/207735356 --> [v2:172.21.15.123:6817/37279,v1:172.21.15.123:6820/37279] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0ac06db30 con 0x7fb0ac06b070 2024-08-17T02:49:08.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.650+0000 7fb0c6000640 1 -- 172.21.15.100:0/207735356 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0c8084830 con 0x7fb0d0156c60 2024-08-17T02:49:08.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.650+0000 7fb0cde00640 1 --2- 172.21.15.100:0/207735356 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb0ac065180 0x7fb0ac067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.651+0000 7fb0c5400640 1 --2- 172.21.15.100:0/207735356 >> [v2:172.21.15.123:6817/37279,v1:172.21.15.123:6820/37279] conn(0x7fb0ac06b070 0x7fb0ac06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.651+0000 7fb0cde00640 1 --2- 172.21.15.100:0/207735356 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb0ac065180 0x7fb0ac067630 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0034000 tx=0x7fb0c0032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:08.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.651+0000 7fb0c5400640 1 --2- 172.21.15.100:0/207735356 >> [v2:172.21.15.123:6817/37279,v1:172.21.15.123:6820/37279] conn(0x7fb0ac06b070 0x7fb0ac06d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:08.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.652+0000 7fb0c6000640 1 -- 172.21.15.100:0/207735356 <== osd.4 v2:172.21.15.123:6817/37279 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb0ac06db30 con 0x7fb0ac06b070 2024-08-17T02:49:08.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.664+0000 7fb0d4e00640 1 -- 172.21.15.100:0/207735356 --> [v2:172.21.15.123:6817/37279,v1:172.21.15.123:6820/37279] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb0d00710c0 con 0x7fb0ac06b070 2024-08-17T02:49:08.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.665+0000 7fb0c6000640 1 -- 172.21.15.100:0/207735356 <== osd.4 v2:172.21.15.123:6817/37279 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb0d00710c0 con 0x7fb0ac06b070 2024-08-17T02:49:08.666 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-08-17T02:49:08.666 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:49:08.666 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-08-17T02:49:08.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.665+0000 7fb0d4e00640 1 -- 172.21.15.100:0/207735356 >> [v2:172.21.15.123:6817/37279,v1:172.21.15.123:6820/37279] conn(0x7fb0ac06b070 msgr2=0x7fb0ac06d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.665+0000 7fb0d4e00640 1 --2- 172.21.15.100:0/207735356 >> [v2:172.21.15.123:6817/37279,v1:172.21.15.123:6820/37279] conn(0x7fb0ac06b070 0x7fb0ac06d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.665+0000 7fb0d4e00640 1 -- 172.21.15.100:0/207735356 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb0ac065180 msgr2=0x7fb0ac067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.665+0000 7fb0d4e00640 1 --2- 172.21.15.100:0/207735356 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb0ac065180 0x7fb0ac067630 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0034000 tx=0x7fb0c0032000 comp rx=0 tx=0).stop 2024-08-17T02:49:08.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.665+0000 7fb0d4e00640 1 -- 172.21.15.100:0/207735356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d0156c60 msgr2=0x7fb0d00aa020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.665+0000 7fb0d4e00640 1 --2- 172.21.15.100:0/207735356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d0156c60 0x7fb0d00aa020 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb0c800cca0 tx=0x7fb0c8001ae0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.665+0000 7fb0ce800640 1 -- 172.21.15.100:0/207735356 reap_dead start 2024-08-17T02:49:08.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.665+0000 7fb0d4e00640 1 -- 172.21.15.100:0/207735356 shutdown_connections 2024-08-17T02:49:08.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.665+0000 7fb0d4e00640 1 -- 172.21.15.100:0/207735356 >> 172.21.15.100:0/207735356 conn(0x7fb0d0067750 msgr2=0x7fb0d0069410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:08.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.666+0000 7fb0d4e00640 1 -- 172.21.15.100:0/207735356 shutdown_connections 2024-08-17T02:49:08.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.666+0000 7fb0d4e00640 1 -- 172.21.15.100:0/207735356 wait complete. 2024-08-17T02:49:08.680 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-17T02:49:08.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.829+0000 7fbc20200640 1 Processor -- start 2024-08-17T02:49:08.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.829+0000 7fbc20200640 1 -- start start 2024-08-17T02:49:08.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.830+0000 7fbc20200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc1806da20 0x7fbc1806ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.830+0000 7fbc20200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbc180aa7d0 0x7fbc18158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.830+0000 7fbc20200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc180a9a10 con 0x7fbc18158dd0 2024-08-17T02:49:08.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.830+0000 7fbc20200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc180ac400 con 0x7fbc180aa7d0 2024-08-17T02:49:08.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.830+0000 7fbc20200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc180a9cf0 con 0x7fbc1806da20 2024-08-17T02:49:08.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.831+0000 7fbc1ce00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbc180aa7d0 0x7fbc18158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.831+0000 7fbc1d800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc1806da20 0x7fbc1806ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.831+0000 7fbc1e200640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbc18158dd0 0x7fbc180ab6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.100:56676/0 (socket says 172.21.15.100:56676) 2024-08-17T02:49:08.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.831+0000 7fbc1e200640 1 -- 172.21.15.100:0/2568584891 learned_addr learned my addr 172.21.15.100:0/2568584891 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:49:08.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.831+0000 7fbc1ce00640 1 -- 172.21.15.100:0/2568584891 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc1806da20 msgr2=0x7fbc1806ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:08.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.831+0000 7fbc1ce00640 1 --2- 172.21.15.100:0/2568584891 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc1806da20 0x7fbc1806ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.831+0000 7fbc1ce00640 1 -- 172.21.15.100:0/2568584891 >> v1:172.21.15.123:6789/0 conn(0x7fbc18158dd0 legacy=0x7fbc180ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.831+0000 7fbc1ce00640 1 -- 172.21.15.100:0/2568584891 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc180a9fd0 con 0x7fbc180aa7d0 2024-08-17T02:49:08.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.832+0000 7fbc1ce00640 1 --2- 172.21.15.100:0/2568584891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc180aa7d0 0x7fbc18158890 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009850 tx=0x7fbc040090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0769ae8f39168ac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:08.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.833+0000 7fbc17e00640 1 -- 172.21.15.100:0/2568584891 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0402ad00 con 0x7fbc180aa7d0 2024-08-17T02:49:08.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.833+0000 7fbc17e00640 1 -- 172.21.15.100:0/2568584891 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0402ae60 con 0x7fbc180aa7d0 2024-08-17T02:49:08.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.833+0000 7fbc17e00640 1 -- 172.21.15.100:0/2568584891 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc04032670 con 0x7fbc180aa7d0 2024-08-17T02:49:08.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.833+0000 7fbc20200640 1 -- 172.21.15.100:0/2568584891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc180aa7d0 msgr2=0x7fbc18158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.833+0000 7fbc20200640 1 --2- 172.21.15.100:0/2568584891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc180aa7d0 0x7fbc18158890 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009850 tx=0x7fbc040090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.834+0000 7fbc20200640 1 -- 172.21.15.100:0/2568584891 shutdown_connections 2024-08-17T02:49:08.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.834+0000 7fbc20200640 1 --2- 172.21.15.100:0/2568584891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc180aa7d0 0x7fbc18158890 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.834+0000 7fbc20200640 1 --2- 172.21.15.100:0/2568584891 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc1806da20 0x7fbc1806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.834+0000 7fbc20200640 1 -- 172.21.15.100:0/2568584891 >> 172.21.15.100:0/2568584891 conn(0x7fbc180cb9b0 msgr2=0x7fbc180cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:08.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.834+0000 7fbc20200640 1 -- 172.21.15.100:0/2568584891 shutdown_connections 2024-08-17T02:49:08.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.834+0000 7fbc20200640 1 -- 172.21.15.100:0/2568584891 wait complete. 2024-08-17T02:49:08.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.835+0000 7fbc20200640 1 Processor -- start 2024-08-17T02:49:08.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.835+0000 7fbc20200640 1 -- start start 2024-08-17T02:49:08.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.836+0000 7fbc20200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc1806da20 0x7fbc18152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.836+0000 7fbc20200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc180aa7d0 0x7fbc18152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.836+0000 7fbc20200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc18158dd0 0x7fbc18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.836+0000 7fbc20200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc181594a0 con 0x7fbc18158dd0 2024-08-17T02:49:08.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.836+0000 7fbc20200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1815a020 con 0x7fbc1806da20 2024-08-17T02:49:08.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.836+0000 7fbc20200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc181596f0 con 0x7fbc180aa7d0 2024-08-17T02:49:08.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.836+0000 7fbc1e200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc18158dd0 0x7fbc18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.836+0000 7fbc1e200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc18158dd0 0x7fbc18068730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36746/0 (socket says 172.21.15.100:36746) 2024-08-17T02:49:08.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.836+0000 7fbc1e200640 1 -- 172.21.15.100:0/1322242992 learned_addr learned my addr 172.21.15.100:0/1322242992 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:08.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.837+0000 7fbc1d800640 1 --2- 172.21.15.100:0/1322242992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc1806da20 0x7fbc18152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.837+0000 7fbc1ce00640 1 --2- 172.21.15.100:0/1322242992 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc180aa7d0 0x7fbc18152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.837+0000 7fbc1e200640 1 -- 172.21.15.100:0/1322242992 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc180aa7d0 msgr2=0x7fbc18152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.837+0000 7fbc1e200640 1 --2- 172.21.15.100:0/1322242992 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc180aa7d0 0x7fbc18152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.837+0000 7fbc1e200640 1 -- 172.21.15.100:0/1322242992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc1806da20 msgr2=0x7fbc18152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:08.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.837+0000 7fbc1e200640 1 --2- 172.21.15.100:0/1322242992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc1806da20 0x7fbc18152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:08.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.837+0000 7fbc1e200640 1 -- 172.21.15.100:0/1322242992 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc04009390 con 0x7fbc18158dd0 2024-08-17T02:49:08.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.837+0000 7fbc1e200640 1 --2- 172.21.15.100:0/1322242992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc18158dd0 0x7fbc18068730 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000cbf0 tx=0x7fbc100019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:08.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.837+0000 7fbc14c00640 1 -- 172.21.15.100:0/1322242992 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1000ce10 con 0x7fbc18158dd0 2024-08-17T02:49:08.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.837+0000 7fbc14c00640 1 -- 172.21.15.100:0/1322242992 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1000a850 con 0x7fbc18158dd0 2024-08-17T02:49:08.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.837+0000 7fbc14c00640 1 -- 172.21.15.100:0/1322242992 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1000abd0 con 0x7fbc18158dd0 2024-08-17T02:49:08.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.837+0000 7fbc20200640 1 -- 172.21.15.100:0/1322242992 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc181599d0 con 0x7fbc18158dd0 2024-08-17T02:49:08.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.838+0000 7fbc20200640 1 -- 172.21.15.100:0/1322242992 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc18068c70 con 0x7fbc18158dd0 2024-08-17T02:49:08.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.838+0000 7fbc20200640 1 -- 172.21.15.100:0/1322242992 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc1815a1b0 con 0x7fbc18158dd0 2024-08-17T02:49:08.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.839+0000 7fbc14c00640 1 -- 172.21.15.100:0/1322242992 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbc100070f0 con 0x7fbc18158dd0 2024-08-17T02:49:08.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.840+0000 7fbc14c00640 1 --2- 172.21.15.100:0/1322242992 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbbf8065150 0x7fbbf8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:08.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.840+0000 7fbc14c00640 1 -- 172.21.15.100:0/1322242992 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fbc10082230 con 0x7fbc18158dd0 2024-08-17T02:49:08.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.840+0000 7fbc1d800640 1 --2- 172.21.15.100:0/1322242992 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbbf8065150 0x7fbbf8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:08.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.841+0000 7fbc1d800640 1 --2- 172.21.15.100:0/1322242992 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbbf8065150 0x7fbbf8067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbc181533b0 tx=0x7fbc0c0090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:08.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:08.844+0000 7fbc14c00640 1 -- 172.21.15.100:0/1322242992 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbc100506e0 con 0x7fbc18158dd0 2024-08-17T02:49:09.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.018+0000 7fbc20200640 1 -- 172.21.15.100:0/1322242992 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc18064db0 con 0x7fbbf8065150 2024-08-17T02:49:09.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.018+0000 7fbc14c00640 1 -- 172.21.15.100:0/1322242992 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbc18064db0 con 0x7fbbf8065150 2024-08-17T02:49:09.019 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 4 to deep-scrub 2024-08-17T02:49:09.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.020+0000 7fbc20200640 1 -- 172.21.15.100:0/1322242992 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbbf8065150 msgr2=0x7fbbf8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.020+0000 7fbc20200640 1 --2- 172.21.15.100:0/1322242992 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbbf8065150 0x7fbbf8067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbc181533b0 tx=0x7fbc0c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.020+0000 7fbc20200640 1 -- 172.21.15.100:0/1322242992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc18158dd0 msgr2=0x7fbc18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.020+0000 7fbc20200640 1 --2- 172.21.15.100:0/1322242992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc18158dd0 0x7fbc18068730 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000cbf0 tx=0x7fbc100019c0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.020+0000 7fbc20200640 1 -- 172.21.15.100:0/1322242992 shutdown_connections 2024-08-17T02:49:09.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.020+0000 7fbc20200640 1 --2- 172.21.15.100:0/1322242992 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fbbf8065150 0x7fbbf8067600 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.020+0000 7fbc20200640 1 --2- 172.21.15.100:0/1322242992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc18158dd0 0x7fbc18068730 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.020+0000 7fbc20200640 1 --2- 172.21.15.100:0/1322242992 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbc180aa7d0 0x7fbc18152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.020+0000 7fbc20200640 1 --2- 172.21.15.100:0/1322242992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc1806da20 0x7fbc18152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.020+0000 7fbc20200640 1 -- 172.21.15.100:0/1322242992 >> 172.21.15.100:0/1322242992 conn(0x7fbc180cb9b0 msgr2=0x7fbc180abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:09.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.020+0000 7fbc20200640 1 -- 172.21.15.100:0/1322242992 shutdown_connections 2024-08-17T02:49:09.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.020+0000 7fbc20200640 1 -- 172.21.15.100:0/1322242992 wait complete. 2024-08-17T02:49:09.036 INFO:tasks.ceph:Scrubbing osd.5 2024-08-17T02:49:09.037 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:49:09.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.188+0000 7f2508800640 1 Processor -- start 2024-08-17T02:49:09.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.189+0000 7f2508800640 1 -- start start 2024-08-17T02:49:09.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.190+0000 7f2508800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2500156890 0x7f250006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.190+0000 7f2508800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25000c8840 0x7f250006e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.190+0000 7f2508800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25000ae9b0 con 0x7f2500156c60 2024-08-17T02:49:09.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.190+0000 7f2508800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25000aa730 con 0x7f2500156890 2024-08-17T02:49:09.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.190+0000 7f2508800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25000aa9f0 con 0x7f25000c8840 2024-08-17T02:49:09.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.190+0000 7f2505400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2500156c60 0x7f25000c8130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38988/0 (socket says 172.21.15.100:38988) 2024-08-17T02:49:09.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.190+0000 7f2505400640 1 -- 172.21.15.100:0/1897930556 learned_addr learned my addr 172.21.15.100:0/1897930556 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:49:09.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.190+0000 7f2505e00640 1 --2- 172.21.15.100:0/1897930556 >> v2:172.21.15.123:3300/0 conn(0x7f2500156890 0x7f250006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.190+0000 7f2506800640 1 --2- 172.21.15.100:0/1897930556 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25000c8840 0x7f250006e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.191+0000 7f2504a00640 1 -- 172.21.15.100:0/1897930556 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3911217505 0 0) 0x7f25000ae9b0 con 0x7f2500156c60 2024-08-17T02:49:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.191+0000 7f2504a00640 1 -- 172.21.15.100:0/1897930556 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24e80034e0 con 0x7f2500156c60 2024-08-17T02:49:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.191+0000 7f2504a00640 1 -- 172.21.15.100:0/1897930556 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3880545720 0 0) 0x7f24e80034e0 con 0x7f2500156c60 2024-08-17T02:49:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.191+0000 7f2505e00640 1 -- 172.21.15.100:0/1897930556 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25000c8840 msgr2=0x7f250006e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.191+0000 7f2505e00640 1 --2- 172.21.15.100:0/1897930556 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25000c8840 0x7f250006e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.191+0000 7f2505e00640 1 -- 172.21.15.100:0/1897930556 >> v1:172.21.15.100:6789/0 conn(0x7f2500156c60 legacy=0x7f25000c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.191+0000 7f2505e00640 1 -- 172.21.15.100:0/1897930556 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25000ab320 con 0x7f2500156890 2024-08-17T02:49:09.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.191+0000 7f2506800640 1 --2- 172.21.15.100:0/1897930556 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25000c8840 0x7f250006e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:49:09.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.192+0000 7f2505e00640 1 --2- 172.21.15.100:0/1897930556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2500156890 0x7f250006dee0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009850 tx=0x7f24f40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13b1323b5ded4d8d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:09.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.192+0000 7f2504a00640 1 -- 172.21.15.100:0/1897930556 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0001470 con 0x7f2500156890 2024-08-17T02:49:09.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.192+0000 7f2504a00640 1 -- 172.21.15.100:0/1897930556 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f402a9b0 con 0x7f2500156890 2024-08-17T02:49:09.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.193+0000 7f2504a00640 1 -- 172.21.15.100:0/1897930556 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f402ad50 con 0x7f2500156890 2024-08-17T02:49:09.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.193+0000 7f2508800640 1 -- 172.21.15.100:0/1897930556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2500156890 msgr2=0x7f250006dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.193+0000 7f2508800640 1 --2- 172.21.15.100:0/1897930556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2500156890 0x7f250006dee0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009850 tx=0x7f24f40090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.193+0000 7f2508800640 1 -- 172.21.15.100:0/1897930556 shutdown_connections 2024-08-17T02:49:09.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.193+0000 7f2508800640 1 --2- 172.21.15.100:0/1897930556 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25000c8840 0x7f250006e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.193+0000 7f2508800640 1 --2- 172.21.15.100:0/1897930556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2500156890 0x7f250006dee0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.193+0000 7f2508800640 1 -- 172.21.15.100:0/1897930556 >> 172.21.15.100:0/1897930556 conn(0x7f2500067750 msgr2=0x7f250006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:09.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.193+0000 7f2508800640 1 -- 172.21.15.100:0/1897930556 shutdown_connections 2024-08-17T02:49:09.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.193+0000 7f2508800640 1 -- 172.21.15.100:0/1897930556 wait complete. 2024-08-17T02:49:09.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.194+0000 7f2508800640 1 Processor -- start 2024-08-17T02:49:09.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.195+0000 7f2508800640 1 -- start start 2024-08-17T02:49:09.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.195+0000 7f2508800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25000c8840 0x7f250006d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.195+0000 7f2508800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2500156890 0x7f25001481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.195+0000 7f2508800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2500156c60 0x7f25001486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.195+0000 7f2508800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25000ab610 con 0x7f25000c8840 2024-08-17T02:49:09.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.195+0000 7f2508800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250016a140 con 0x7f2500156c60 2024-08-17T02:49:09.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.195+0000 7f2508800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25000ab860 con 0x7f2500156890 2024-08-17T02:49:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.196+0000 7f2505e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25000c8840 0x7f250006d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.196+0000 7f2505e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25000c8840 0x7f250006d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36754/0 (socket says 172.21.15.100:36754) 2024-08-17T02:49:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.196+0000 7f2505e00640 1 -- 172.21.15.100:0/2010256709 learned_addr learned my addr 172.21.15.100:0/2010256709 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.196+0000 7f2505400640 1 --2- 172.21.15.100:0/2010256709 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2500156890 0x7f25001481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.196+0000 7f2506800640 1 --2- 172.21.15.100:0/2010256709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2500156c60 0x7f25001486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.196+0000 7f2505e00640 1 -- 172.21.15.100:0/2010256709 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2500156890 msgr2=0x7f25001481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.196+0000 7f2505e00640 1 --2- 172.21.15.100:0/2010256709 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2500156890 0x7f25001481b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.196+0000 7f2505e00640 1 -- 172.21.15.100:0/2010256709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2500156c60 msgr2=0x7f25001486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.196+0000 7f2505e00640 1 --2- 172.21.15.100:0/2010256709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2500156c60 0x7f25001486f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.196+0000 7f2505e00640 1 -- 172.21.15.100:0/2010256709 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc009a20 con 0x7f25000c8840 2024-08-17T02:49:09.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.196+0000 7f2505e00640 1 --2- 172.21.15.100:0/2010256709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25000c8840 0x7f250006d830 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009850 tx=0x7f24f4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:09.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.197+0000 7f24f9600640 1 -- 172.21.15.100:0/2010256709 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f4032e60 con 0x7f25000c8840 2024-08-17T02:49:09.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.197+0000 7f24f9600640 1 -- 172.21.15.100:0/2010256709 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f403d420 con 0x7f25000c8840 2024-08-17T02:49:09.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.197+0000 7f24f9600640 1 -- 172.21.15.100:0/2010256709 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f403d800 con 0x7f25000c8840 2024-08-17T02:49:09.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.197+0000 7f2508800640 1 -- 172.21.15.100:0/2010256709 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f4009390 con 0x7f25000c8840 2024-08-17T02:49:09.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.197+0000 7f2508800640 1 -- 172.21.15.100:0/2010256709 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25000abe20 con 0x7f25000c8840 2024-08-17T02:49:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.198+0000 7f2508800640 1 -- 172.21.15.100:0/2010256709 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f25000710c0 con 0x7f25000c8840 2024-08-17T02:49:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.199+0000 7f24f9600640 1 -- 172.21.15.100:0/2010256709 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f24f4039040 con 0x7f25000c8840 2024-08-17T02:49:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.200+0000 7f24f9600640 1 --2- 172.21.15.100:0/2010256709 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f24e4065150 0x7f24e4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.200+0000 7f24f9600640 1 -- 172.21.15.100:0/2010256709 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f24f40a2120 con 0x7f25000c8840 2024-08-17T02:49:09.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.200+0000 7f2505400640 1 --2- 172.21.15.100:0/2010256709 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f24e4065150 0x7f24e4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.200+0000 7f24f9600640 1 --2- 172.21.15.100:0/2010256709 >> [v2:172.21.15.123:6800/37277,v1:172.21.15.123:6801/37277] conn(0x7f24e406b040 0x7f24e406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.200+0000 7f24f9600640 1 -- 172.21.15.100:0/2010256709 --> [v2:172.21.15.123:6800/37277,v1:172.21.15.123:6801/37277] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24e406db00 con 0x7f24e406b040 2024-08-17T02:49:09.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.200+0000 7f24f9600640 1 -- 172.21.15.100:0/2010256709 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24f40a24f0 con 0x7f25000c8840 2024-08-17T02:49:09.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.200+0000 7f2506800640 1 --2- 172.21.15.100:0/2010256709 >> [v2:172.21.15.123:6800/37277,v1:172.21.15.123:6801/37277] conn(0x7f24e406b040 0x7f24e406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.200+0000 7f2505400640 1 --2- 172.21.15.100:0/2010256709 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f24e4065150 0x7f24e4067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f250014c2a0 tx=0x7f24f0001560 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:09.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.201+0000 7f2506800640 1 --2- 172.21.15.100:0/2010256709 >> [v2:172.21.15.123:6800/37277,v1:172.21.15.123:6801/37277] conn(0x7f24e406b040 0x7f24e406d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:09.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.202+0000 7f24f9600640 1 -- 172.21.15.100:0/2010256709 <== osd.5 v2:172.21.15.123:6800/37277 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f24e406db00 con 0x7f24e406b040 2024-08-17T02:49:09.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.215+0000 7f2508800640 1 -- 172.21.15.100:0/2010256709 --> [v2:172.21.15.123:6800/37277,v1:172.21.15.123:6801/37277] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2500070740 con 0x7f24e406b040 2024-08-17T02:49:09.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.216+0000 7f24f9600640 1 -- 172.21.15.100:0/2010256709 <== osd.5 v2:172.21.15.123:6800/37277 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2500070740 con 0x7f24e406b040 2024-08-17T02:49:09.216 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-08-17T02:49:09.216 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:49:09.217 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-08-17T02:49:09.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.216+0000 7f2508800640 1 -- 172.21.15.100:0/2010256709 >> [v2:172.21.15.123:6800/37277,v1:172.21.15.123:6801/37277] conn(0x7f24e406b040 msgr2=0x7f24e406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.216+0000 7f2508800640 1 --2- 172.21.15.100:0/2010256709 >> [v2:172.21.15.123:6800/37277,v1:172.21.15.123:6801/37277] conn(0x7f24e406b040 0x7f24e406d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.216+0000 7f2508800640 1 -- 172.21.15.100:0/2010256709 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f24e4065150 msgr2=0x7f24e4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.216+0000 7f2508800640 1 --2- 172.21.15.100:0/2010256709 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f24e4065150 0x7f24e4067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f250014c2a0 tx=0x7f24f0001560 comp rx=0 tx=0).stop 2024-08-17T02:49:09.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.216+0000 7f2508800640 1 -- 172.21.15.100:0/2010256709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25000c8840 msgr2=0x7f250006d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.216+0000 7f2508800640 1 --2- 172.21.15.100:0/2010256709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25000c8840 0x7f250006d830 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009850 tx=0x7f24f4032000 comp rx=0 tx=0).stop 2024-08-17T02:49:09.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.216+0000 7f2506800640 1 -- 172.21.15.100:0/2010256709 reap_dead start 2024-08-17T02:49:09.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.216+0000 7f2508800640 1 -- 172.21.15.100:0/2010256709 shutdown_connections 2024-08-17T02:49:09.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.216+0000 7f2508800640 1 -- 172.21.15.100:0/2010256709 >> 172.21.15.100:0/2010256709 conn(0x7f2500067750 msgr2=0x7f2500152640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:09.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.216+0000 7f2508800640 1 -- 172.21.15.100:0/2010256709 shutdown_connections 2024-08-17T02:49:09.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.216+0000 7f2508800640 1 -- 172.21.15.100:0/2010256709 wait complete. 2024-08-17T02:49:09.231 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-17T02:49:09.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.380+0000 7f983ca00640 1 Processor -- start 2024-08-17T02:49:09.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.381+0000 7f983ca00640 1 -- start start 2024-08-17T02:49:09.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.382+0000 7f983ca00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9838158970 0x7f9838158d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.382+0000 7f983ca00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98380af590 con 0x7f98380aa290 2024-08-17T02:49:09.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.382+0000 7f983ca00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983806afc0 con 0x7f983806ab70 2024-08-17T02:49:09.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.382+0000 7f983ca00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98380aed30 con 0x7f9838158970 2024-08-17T02:49:09.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.382+0000 7f9837400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9838158970 0x7f9838158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.382+0000 7f9837e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f98380aa290 0x7f98380b0380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39000/0 (socket says 172.21.15.100:39000) 2024-08-17T02:49:09.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.382+0000 7f9837400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9838158970 0x7f9838158d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36760/0 (socket says 172.21.15.100:36760) 2024-08-17T02:49:09.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.382+0000 7f9837e00640 1 -- 172.21.15.100:0/678207826 learned_addr learned my addr 172.21.15.100:0/678207826 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:49:09.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.383+0000 7f9837400640 1 -- 172.21.15.100:0/678207826 >> v1:172.21.15.123:6789/0 conn(0x7f983806ab70 legacy=0x7f98380afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.383+0000 7f9837400640 1 -- 172.21.15.100:0/678207826 >> v1:172.21.15.100:6789/0 conn(0x7f98380aa290 legacy=0x7f98380b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.383+0000 7f9837400640 1 -- 172.21.15.100:0/678207826 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98380b0130 con 0x7f9838158970 2024-08-17T02:49:09.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.383+0000 7f9836a00640 1 -- 172.21.15.100:0/678207826 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2708548065 0 0) 0x7f98380af590 con 0x7f98380aa290 2024-08-17T02:49:09.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.384+0000 7f9837400640 1 --2- 172.21.15.100:0/678207826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9838158970 0x7f9838158d40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f98380aee70 tx=0x7f98280090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd9b4df5e7e5f01 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:09.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.384+0000 7f9836a00640 1 -- 172.21.15.100:0/678207826 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982802ae10 con 0x7f9838158970 2024-08-17T02:49:09.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.384+0000 7f9836a00640 1 -- 172.21.15.100:0/678207826 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9828032440 con 0x7f9838158970 2024-08-17T02:49:09.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.384+0000 7f9836a00640 1 -- 172.21.15.100:0/678207826 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98280327e0 con 0x7f9838158970 2024-08-17T02:49:09.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.384+0000 7f983ca00640 1 -- 172.21.15.100:0/678207826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9838158970 msgr2=0x7f9838158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.384+0000 7f983ca00640 1 --2- 172.21.15.100:0/678207826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9838158970 0x7f9838158d40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f98380aee70 tx=0x7f98280090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.385+0000 7f983ca00640 1 -- 172.21.15.100:0/678207826 shutdown_connections 2024-08-17T02:49:09.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.385+0000 7f983ca00640 1 --2- 172.21.15.100:0/678207826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9838158970 0x7f9838158d40 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.385+0000 7f983ca00640 1 -- 172.21.15.100:0/678207826 >> 172.21.15.100:0/678207826 conn(0x7f9838067750 msgr2=0x7f9838068c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:09.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.385+0000 7f983ca00640 1 -- 172.21.15.100:0/678207826 shutdown_connections 2024-08-17T02:49:09.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.385+0000 7f983ca00640 1 -- 172.21.15.100:0/678207826 wait complete. 2024-08-17T02:49:09.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.386+0000 7f983ca00640 1 Processor -- start 2024-08-17T02:49:09.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.386+0000 7f983ca00640 1 -- start start 2024-08-17T02:49:09.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.387+0000 7f983ca00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f983806ab70 0x7f9838142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.387+0000 7f983ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98380aa290 0x7f98380c3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.387+0000 7f983ca00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9838158970 0x7f98380c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.387+0000 7f983ca00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98380c1780 con 0x7f98380aa290 2024-08-17T02:49:09.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.387+0000 7f983ca00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98380c0e50 con 0x7f9838158970 2024-08-17T02:49:09.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.387+0000 7f983ca00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98380c1130 con 0x7f983806ab70 2024-08-17T02:49:09.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.387+0000 7f982fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98380aa290 0x7f98380c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.387+0000 7f982fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98380aa290 0x7f98380c3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36772/0 (socket says 172.21.15.100:36772) 2024-08-17T02:49:09.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.387+0000 7f982fe00640 1 -- 172.21.15.100:0/218820913 learned_addr learned my addr 172.21.15.100:0/218820913 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:09.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.388+0000 7f9837e00640 1 --2- 172.21.15.100:0/218820913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9838158970 0x7f98380c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.388+0000 7f9837400640 1 --2- 172.21.15.100:0/218820913 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f983806ab70 0x7f9838142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.388+0000 7f982fe00640 1 -- 172.21.15.100:0/218820913 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f983806ab70 msgr2=0x7f9838142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.388+0000 7f982fe00640 1 --2- 172.21.15.100:0/218820913 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f983806ab70 0x7f9838142f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.388+0000 7f982fe00640 1 -- 172.21.15.100:0/218820913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9838158970 msgr2=0x7f98380c3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.388+0000 7f982fe00640 1 --2- 172.21.15.100:0/218820913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9838158970 0x7f98380c3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.388+0000 7f982fe00640 1 -- 172.21.15.100:0/218820913 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9828009390 con 0x7f98380aa290 2024-08-17T02:49:09.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.388+0000 7f982fe00640 1 --2- 172.21.15.100:0/218820913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98380aa290 0x7f98380c3620 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f982000c4c0 tx=0x7f9820007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:09.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.388+0000 7f982ea00640 1 -- 172.21.15.100:0/218820913 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820011590 con 0x7f98380aa290 2024-08-17T02:49:09.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.388+0000 7f982ea00640 1 -- 172.21.15.100:0/218820913 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9820011710 con 0x7f98380aa290 2024-08-17T02:49:09.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.388+0000 7f982ea00640 1 -- 172.21.15.100:0/218820913 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820011ad0 con 0x7f98380aa290 2024-08-17T02:49:09.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.388+0000 7f983ca00640 1 -- 172.21.15.100:0/218820913 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98380c1410 con 0x7f98380aa290 2024-08-17T02:49:09.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.388+0000 7f983ca00640 1 -- 172.21.15.100:0/218820913 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983816c830 con 0x7f98380aa290 2024-08-17T02:49:09.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.389+0000 7f983ca00640 1 -- 172.21.15.100:0/218820913 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9838071050 con 0x7f98380aa290 2024-08-17T02:49:09.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.390+0000 7f982ea00640 1 -- 172.21.15.100:0/218820913 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f982001b3b0 con 0x7f98380aa290 2024-08-17T02:49:09.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.391+0000 7f982ea00640 1 --2- 172.21.15.100:0/218820913 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9814065180 0x7f9814067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.391+0000 7f982ea00640 1 -- 172.21.15.100:0/218820913 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9820081690 con 0x7f98380aa290 2024-08-17T02:49:09.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.391+0000 7f9837400640 1 --2- 172.21.15.100:0/218820913 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9814065180 0x7f9814067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.392+0000 7f9837400640 1 --2- 172.21.15.100:0/218820913 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9814065180 0x7f9814067630 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9828034000 tx=0x7f9828032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:09.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.395+0000 7f982ea00640 1 -- 172.21.15.100:0/218820913 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f982004f950 con 0x7f98380aa290 2024-08-17T02:49:09.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.567+0000 7f983ca00640 1 -- 172.21.15.100:0/218820913 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f983806e9f0 con 0x7f9814065180 2024-08-17T02:49:09.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.568+0000 7f982ea00640 1 -- 172.21.15.100:0/218820913 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f983806e9f0 con 0x7f9814065180 2024-08-17T02:49:09.569 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 5 to deep-scrub 2024-08-17T02:49:09.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.569+0000 7f983ca00640 1 -- 172.21.15.100:0/218820913 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9814065180 msgr2=0x7f9814067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.569+0000 7f983ca00640 1 --2- 172.21.15.100:0/218820913 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9814065180 0x7f9814067630 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9828034000 tx=0x7f9828032000 comp rx=0 tx=0).stop 2024-08-17T02:49:09.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.569+0000 7f983ca00640 1 -- 172.21.15.100:0/218820913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98380aa290 msgr2=0x7f98380c3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.569+0000 7f983ca00640 1 --2- 172.21.15.100:0/218820913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98380aa290 0x7f98380c3620 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f982000c4c0 tx=0x7f9820007ef0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.569+0000 7f983ca00640 1 -- 172.21.15.100:0/218820913 shutdown_connections 2024-08-17T02:49:09.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.569+0000 7f983ca00640 1 --2- 172.21.15.100:0/218820913 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f9814065180 0x7f9814067630 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.570+0000 7f983ca00640 1 --2- 172.21.15.100:0/218820913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9838158970 0x7f98380c3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.570+0000 7f983ca00640 1 --2- 172.21.15.100:0/218820913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98380aa290 0x7f98380c3620 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.570+0000 7f983ca00640 1 --2- 172.21.15.100:0/218820913 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f983806ab70 0x7f9838142f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.570+0000 7f983ca00640 1 -- 172.21.15.100:0/218820913 >> 172.21.15.100:0/218820913 conn(0x7f9838067750 msgr2=0x7f98380ac9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:09.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.570+0000 7f983ca00640 1 -- 172.21.15.100:0/218820913 shutdown_connections 2024-08-17T02:49:09.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.570+0000 7f983ca00640 1 -- 172.21.15.100:0/218820913 wait complete. 2024-08-17T02:49:09.585 INFO:tasks.ceph:Scrubbing osd.6 2024-08-17T02:49:09.585 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:49:09.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.735+0000 7f6bc1800640 1 Processor -- start 2024-08-17T02:49:09.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.736+0000 7f6bc1800640 1 -- start start 2024-08-17T02:49:09.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.737+0000 7f6bc1800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6bbc153510 0x7f6bbc159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.737+0000 7f6bc1800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6bbc0af760 0x7f6bbc066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.737+0000 7f6bc1800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6bbc0afbd0 0x7f6bbc067210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.737+0000 7f6bc1800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bbc0b0700 con 0x7f6bbc153510 2024-08-17T02:49:09.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.737+0000 7f6bc1800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bbc1538e0 con 0x7f6bbc0af760 2024-08-17T02:49:09.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.737+0000 7f6bc1800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc159940 con 0x7f6bbc0afbd0 2024-08-17T02:49:09.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.737+0000 7f6bbbe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6bbc153510 0x7f6bbc159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.737+0000 7f6bbbe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6bbc153510 0x7f6bbc159dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36782/0 (socket says 172.21.15.100:36782) 2024-08-17T02:49:09.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.737+0000 7f6bbbe00640 1 -- 172.21.15.100:0/3705481300 learned_addr learned my addr 172.21.15.100:0/3705481300 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:09.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.737+0000 7f6bbb400640 1 --2- 172.21.15.100:0/3705481300 >> v2:172.21.15.123:3300/0 conn(0x7f6bbc0af760 0x7f6bbc066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.737+0000 7f6bc0e00640 1 --2- 172.21.15.100:0/3705481300 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6bbc0afbd0 0x7f6bbc067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.737+0000 7f6bbbe00640 1 -- 172.21.15.100:0/3705481300 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6bbc0afbd0 msgr2=0x7f6bbc067210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:09.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.737+0000 7f6bbbe00640 1 --2- 172.21.15.100:0/3705481300 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6bbc0afbd0 0x7f6bbc067210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.737+0000 7f6bbbe00640 1 -- 172.21.15.100:0/3705481300 >> v2:172.21.15.123:3300/0 conn(0x7f6bbc0af760 msgr2=0x7f6bbc066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:09.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.737+0000 7f6bbbe00640 1 --2- 172.21.15.100:0/3705481300 >> v2:172.21.15.123:3300/0 conn(0x7f6bbc0af760 0x7f6bbc066cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.737+0000 7f6bbbe00640 1 -- 172.21.15.100:0/3705481300 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc159370 con 0x7f6bbc153510 2024-08-17T02:49:09.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.738+0000 7f6bbbe00640 1 --2- 172.21.15.100:0/3705481300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc153510 0x7f6bbc159dd0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0cc710 tx=0x7f6bac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af4792bc4aea326 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:09.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.739+0000 7f6bbaa00640 1 -- 172.21.15.100:0/3705481300 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac031400 con 0x7f6bbc153510 2024-08-17T02:49:09.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.739+0000 7f6bbaa00640 1 -- 172.21.15.100:0/3705481300 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac02d050 con 0x7f6bbc153510 2024-08-17T02:49:09.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.739+0000 7f6bbaa00640 1 -- 172.21.15.100:0/3705481300 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac0317d0 con 0x7f6bbc153510 2024-08-17T02:49:09.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.739+0000 7f6bc1800640 1 -- 172.21.15.100:0/3705481300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc153510 msgr2=0x7f6bbc159dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.739+0000 7f6bc1800640 1 --2- 172.21.15.100:0/3705481300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc153510 0x7f6bbc159dd0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0cc710 tx=0x7f6bac009840 comp rx=0 tx=0).stop 2024-08-17T02:49:09.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.739+0000 7f6bc1800640 1 -- 172.21.15.100:0/3705481300 shutdown_connections 2024-08-17T02:49:09.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.739+0000 7f6bc1800640 1 --2- 172.21.15.100:0/3705481300 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6bbc0afbd0 0x7f6bbc067210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.739+0000 7f6bc1800640 1 --2- 172.21.15.100:0/3705481300 >> v2:172.21.15.123:3300/0 conn(0x7f6bbc0af760 0x7f6bbc066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.739+0000 7f6bc1800640 1 --2- 172.21.15.100:0/3705481300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc153510 0x7f6bbc159dd0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.739+0000 7f6bc1800640 1 -- 172.21.15.100:0/3705481300 >> 172.21.15.100:0/3705481300 conn(0x7f6bbc067de0 msgr2=0x7f6bbc0681b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:09.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.739+0000 7f6bc1800640 1 -- 172.21.15.100:0/3705481300 shutdown_connections 2024-08-17T02:49:09.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.739+0000 7f6bc1800640 1 -- 172.21.15.100:0/3705481300 wait complete. 2024-08-17T02:49:09.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.741+0000 7f6bc1800640 1 Processor -- start 2024-08-17T02:49:09.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.741+0000 7f6bc1800640 1 -- start start 2024-08-17T02:49:09.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.742+0000 7f6bc1800640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6bbc0af760 0x7f6bbc0ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.742+0000 7f6bc1800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0afbd0 0x7f6bbc14d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.742+0000 7f6bc1800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bbc153510 0x7f6bbc15dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.742+0000 7f6bc1800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0adf50 con 0x7f6bbc0afbd0 2024-08-17T02:49:09.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.742+0000 7f6bc1800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc14d9c0 con 0x7f6bbc153510 2024-08-17T02:49:09.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.742+0000 7f6bc1800640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc16ce00 con 0x7f6bbc0af760 2024-08-17T02:49:09.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.742+0000 7f6bbb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0afbd0 0x7f6bbc14d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.742+0000 7f6bbb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0afbd0 0x7f6bbc14d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36790/0 (socket says 172.21.15.100:36790) 2024-08-17T02:49:09.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.742+0000 7f6bbb400640 1 -- 172.21.15.100:0/2663074602 learned_addr learned my addr 172.21.15.100:0/2663074602 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:09.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.742+0000 7f6bc0e00640 1 --2- 172.21.15.100:0/2663074602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bbc153510 0x7f6bbc15dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.742+0000 7f6bbbe00640 1 --2- 172.21.15.100:0/2663074602 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6bbc0af760 0x7f6bbc0ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.742+0000 7f6bbb400640 1 -- 172.21.15.100:0/2663074602 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6bbc0af760 msgr2=0x7f6bbc0ad1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.742+0000 7f6bbb400640 1 --2- 172.21.15.100:0/2663074602 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6bbc0af760 0x7f6bbc0ad1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.742+0000 7f6bbb400640 1 -- 172.21.15.100:0/2663074602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bbc153510 msgr2=0x7f6bbc15dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.742+0000 7f6bbb400640 1 --2- 172.21.15.100:0/2663074602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bbc153510 0x7f6bbc15dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.742+0000 7f6bbb400640 1 -- 172.21.15.100:0/2663074602 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac009ae0 con 0x7f6bbc0afbd0 2024-08-17T02:49:09.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.742+0000 7f6bbbe00640 1 --2- 172.21.15.100:0/2663074602 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6bbc0af760 0x7f6bbc0ad1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:09.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.743+0000 7f6bbb400640 1 --2- 172.21.15.100:0/2663074602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0afbd0 0x7f6bbc14d480 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800d8c0 tx=0x7f6ba8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:09.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.743+0000 7f6bb3400640 1 -- 172.21.15.100:0/2663074602 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba800de50 con 0x7f6bbc0afbd0 2024-08-17T02:49:09.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.743+0000 7f6bb3400640 1 -- 172.21.15.100:0/2663074602 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba800b8d0 con 0x7f6bbc0afbd0 2024-08-17T02:49:09.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.743+0000 7f6bc1800640 1 -- 172.21.15.100:0/2663074602 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bbc16d0e0 con 0x7f6bbc0afbd0 2024-08-17T02:49:09.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.743+0000 7f6bb3400640 1 -- 172.21.15.100:0/2663074602 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba800bc70 con 0x7f6bbc0afbd0 2024-08-17T02:49:09.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.743+0000 7f6bc1800640 1 -- 172.21.15.100:0/2663074602 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bbc16d6a0 con 0x7f6bbc0afbd0 2024-08-17T02:49:09.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.744+0000 7f6bc1800640 1 -- 172.21.15.100:0/2663074602 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6bbc071050 con 0x7f6bbc0afbd0 2024-08-17T02:49:09.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.745+0000 7f6bb3400640 1 -- 172.21.15.100:0/2663074602 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6ba8014640 con 0x7f6bbc0afbd0 2024-08-17T02:49:09.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.746+0000 7f6bb3400640 1 --2- 172.21.15.100:0/2663074602 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6b9c065150 0x7f6b9c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.746+0000 7f6bb3400640 1 -- 172.21.15.100:0/2663074602 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6ba80827d0 con 0x7f6bbc0afbd0 2024-08-17T02:49:09.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.746+0000 7f6bbbe00640 1 --2- 172.21.15.100:0/2663074602 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6b9c065150 0x7f6b9c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.746+0000 7f6bb3400640 1 --2- 172.21.15.100:0/2663074602 >> [v2:172.21.15.123:6808/37278,v1:172.21.15.123:6809/37278] conn(0x7f6b9c06b040 0x7f6b9c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.746+0000 7f6bb3400640 1 -- 172.21.15.100:0/2663074602 --> [v2:172.21.15.123:6808/37278,v1:172.21.15.123:6809/37278] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b9c06db00 con 0x7f6b9c06b040 2024-08-17T02:49:09.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.746+0000 7f6bb3400640 1 -- 172.21.15.100:0/2663074602 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ba8084d30 con 0x7f6bbc0afbd0 2024-08-17T02:49:09.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.746+0000 7f6bc0e00640 1 --2- 172.21.15.100:0/2663074602 >> [v2:172.21.15.123:6808/37278,v1:172.21.15.123:6809/37278] conn(0x7f6b9c06b040 0x7f6b9c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.747+0000 7f6bbbe00640 1 --2- 172.21.15.100:0/2663074602 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6b9c065150 0x7f6b9c067600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6bac033000 tx=0x7f6bac036000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:09.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.747+0000 7f6bc0e00640 1 --2- 172.21.15.100:0/2663074602 >> [v2:172.21.15.123:6808/37278,v1:172.21.15.123:6809/37278] conn(0x7f6b9c06b040 0x7f6b9c06d450 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:09.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.748+0000 7f6bb3400640 1 -- 172.21.15.100:0/2663074602 <== osd.6 v2:172.21.15.123:6808/37278 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f6b9c06db00 con 0x7f6b9c06b040 2024-08-17T02:49:09.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.760+0000 7f6bc1800640 1 -- 172.21.15.100:0/2663074602 --> [v2:172.21.15.123:6808/37278,v1:172.21.15.123:6809/37278] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6bbc064720 con 0x7f6b9c06b040 2024-08-17T02:49:09.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.761+0000 7f6bb3400640 1 -- 172.21.15.100:0/2663074602 <== osd.6 v2:172.21.15.123:6808/37278 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6bbc064720 con 0x7f6b9c06b040 2024-08-17T02:49:09.762 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-08-17T02:49:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:49:09.762 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-08-17T02:49:09.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.762+0000 7f6bc1800640 1 -- 172.21.15.100:0/2663074602 >> [v2:172.21.15.123:6808/37278,v1:172.21.15.123:6809/37278] conn(0x7f6b9c06b040 msgr2=0x7f6b9c06d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.762+0000 7f6bc1800640 1 --2- 172.21.15.100:0/2663074602 >> [v2:172.21.15.123:6808/37278,v1:172.21.15.123:6809/37278] conn(0x7f6b9c06b040 0x7f6b9c06d450 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.762+0000 7f6bc1800640 1 -- 172.21.15.100:0/2663074602 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6b9c065150 msgr2=0x7f6b9c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.762+0000 7f6bc1800640 1 --2- 172.21.15.100:0/2663074602 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6b9c065150 0x7f6b9c067600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6bac033000 tx=0x7f6bac036000 comp rx=0 tx=0).stop 2024-08-17T02:49:09.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.762+0000 7f6bc1800640 1 -- 172.21.15.100:0/2663074602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0afbd0 msgr2=0x7f6bbc14d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.762+0000 7f6bc1800640 1 --2- 172.21.15.100:0/2663074602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0afbd0 0x7f6bbc14d480 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800d8c0 tx=0x7f6ba8008040 comp rx=0 tx=0).stop 2024-08-17T02:49:09.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.762+0000 7f6bc0e00640 1 -- 172.21.15.100:0/2663074602 reap_dead start 2024-08-17T02:49:09.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.762+0000 7f6bc1800640 1 -- 172.21.15.100:0/2663074602 shutdown_connections 2024-08-17T02:49:09.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.762+0000 7f6bc1800640 1 -- 172.21.15.100:0/2663074602 >> 172.21.15.100:0/2663074602 conn(0x7f6bbc067de0 msgr2=0x7f6bbc0696d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:09.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.762+0000 7f6bc1800640 1 -- 172.21.15.100:0/2663074602 shutdown_connections 2024-08-17T02:49:09.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.762+0000 7f6bc1800640 1 -- 172.21.15.100:0/2663074602 wait complete. 2024-08-17T02:49:09.776 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-17T02:49:09.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.925+0000 7fa65b000640 1 Processor -- start 2024-08-17T02:49:09.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.925+0000 7fa65b000640 1 -- start start 2024-08-17T02:49:09.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.926+0000 7fa65b000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa6540b1120 0x7fa6540aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.926+0000 7fa65b000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6540d0ab0 con 0x7fa6540ada10 2024-08-17T02:49:09.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.926+0000 7fa65b000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6540b00c0 con 0x7fa6540b3370 2024-08-17T02:49:09.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.926+0000 7fa65b000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6540af330 con 0x7fa6540b1120 2024-08-17T02:49:09.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.927+0000 7fa653e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa6540ada10 0x7fa6540b2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39012/0 (socket says 172.21.15.100:39012) 2024-08-17T02:49:09.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.927+0000 7fa653e00640 1 -- 172.21.15.100:0/1824330703 learned_addr learned my addr 172.21.15.100:0/1824330703 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:49:09.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.927+0000 7fa653400640 1 --2- 172.21.15.100:0/1824330703 >> v2:172.21.15.123:3300/0 conn(0x7fa6540b1120 0x7fa6540aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.927+0000 7fa652a00640 1 -- 172.21.15.100:0/1824330703 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2939733434 0 0) 0x7fa6540d0ab0 con 0x7fa6540ada10 2024-08-17T02:49:09.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.927+0000 7fa652a00640 1 -- 172.21.15.100:0/1824330703 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6380034e0 con 0x7fa6540ada10 2024-08-17T02:49:09.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.927+0000 7fa653400640 1 -- 172.21.15.100:0/1824330703 >> v1:172.21.15.123:6789/0 conn(0x7fa6540b3370 legacy=0x7fa6541629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.927+0000 7fa653400640 1 -- 172.21.15.100:0/1824330703 >> v1:172.21.15.100:6789/0 conn(0x7fa6540ada10 legacy=0x7fa6540b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.927+0000 7fa652a00640 1 -- 172.21.15.100:0/1824330703 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 586431978 0 0) 0x7fa6380034e0 con 0x7fa6540ada10 2024-08-17T02:49:09.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.927+0000 7fa653400640 1 -- 172.21.15.100:0/1824330703 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6540b0360 con 0x7fa6540b1120 2024-08-17T02:49:09.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.928+0000 7fa653400640 1 --2- 172.21.15.100:0/1824330703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6540b1120 0x7fa6540aedf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa640009850 tx=0x7fa6400090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1353893dd560bb66 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:09.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.929+0000 7fa652a00640 1 -- 172.21.15.100:0/1824330703 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64002ae20 con 0x7fa6540b1120 2024-08-17T02:49:09.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.929+0000 7fa652a00640 1 -- 172.21.15.100:0/1824330703 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa640032440 con 0x7fa6540b1120 2024-08-17T02:49:09.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.929+0000 7fa652a00640 1 -- 172.21.15.100:0/1824330703 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6400327e0 con 0x7fa6540b1120 2024-08-17T02:49:09.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.929+0000 7fa65b000640 1 -- 172.21.15.100:0/1824330703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6540b1120 msgr2=0x7fa6540aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.929+0000 7fa65b000640 1 --2- 172.21.15.100:0/1824330703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6540b1120 0x7fa6540aedf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa640009850 tx=0x7fa6400090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.929+0000 7fa65b000640 1 -- 172.21.15.100:0/1824330703 shutdown_connections 2024-08-17T02:49:09.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.929+0000 7fa65b000640 1 --2- 172.21.15.100:0/1824330703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6540b1120 0x7fa6540aedf0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.929+0000 7fa65b000640 1 -- 172.21.15.100:0/1824330703 >> 172.21.15.100:0/1824330703 conn(0x7fa6540cfdf0 msgr2=0x7fa6540d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:09.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.929+0000 7fa65b000640 1 -- 172.21.15.100:0/1824330703 shutdown_connections 2024-08-17T02:49:09.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.929+0000 7fa65b000640 1 -- 172.21.15.100:0/1824330703 wait complete. 2024-08-17T02:49:09.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.931+0000 7fa65b000640 1 Processor -- start 2024-08-17T02:49:09.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.931+0000 7fa65b000640 1 -- start start 2024-08-17T02:49:09.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.932+0000 7fa65b000640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa6540ada10 0x7fa654151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.932+0000 7fa65b000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6540b1120 0x7fa654154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.932+0000 7fa65b000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6540b3370 0x7fa654154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.932+0000 7fa65b000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa654168f90 con 0x7fa6540b1120 2024-08-17T02:49:09.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.932+0000 7fa65b000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa654169190 con 0x7fa6540b3370 2024-08-17T02:49:09.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.932+0000 7fa65b000640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa654151ed0 con 0x7fa6540ada10 2024-08-17T02:49:09.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.932+0000 7fa653400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6540b1120 0x7fa654154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.932+0000 7fa653400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6540b1120 0x7fa654154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36794/0 (socket says 172.21.15.100:36794) 2024-08-17T02:49:09.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.932+0000 7fa653400640 1 -- 172.21.15.100:0/1734602617 learned_addr learned my addr 172.21.15.100:0/1734602617 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:09.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.932+0000 7fa653e00640 1 --2- 172.21.15.100:0/1734602617 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa6540ada10 0x7fa654151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.932+0000 7fa653400640 1 -- 172.21.15.100:0/1734602617 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa6540ada10 msgr2=0x7fa654151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.932+0000 7fa659000640 1 --2- 172.21.15.100:0/1734602617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6540b3370 0x7fa654154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.932+0000 7fa653400640 1 --2- 172.21.15.100:0/1734602617 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa6540ada10 0x7fa654151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.932+0000 7fa653400640 1 -- 172.21.15.100:0/1734602617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6540b3370 msgr2=0x7fa654154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:09.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.932+0000 7fa653400640 1 --2- 172.21.15.100:0/1734602617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6540b3370 0x7fa654154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:09.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.932+0000 7fa653400640 1 -- 172.21.15.100:0/1734602617 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa640009390 con 0x7fa6540b1120 2024-08-17T02:49:09.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.932+0000 7fa653e00640 1 --2- 172.21.15.100:0/1734602617 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa6540ada10 0x7fa654151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:09.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.932+0000 7fa659000640 1 --2- 172.21.15.100:0/1734602617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6540b3370 0x7fa654154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:09.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.933+0000 7fa653400640 1 --2- 172.21.15.100:0/1734602617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6540b1120 0x7fa654154a20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa640009850 tx=0x7fa640032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:09.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.933+0000 7fa64b400640 1 -- 172.21.15.100:0/1734602617 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640031a60 con 0x7fa6540b1120 2024-08-17T02:49:09.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.933+0000 7fa64b400640 1 -- 172.21.15.100:0/1734602617 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa640031bc0 con 0x7fa6540b1120 2024-08-17T02:49:09.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.933+0000 7fa65b000640 1 -- 172.21.15.100:0/1734602617 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa654169430 con 0x7fa6540b1120 2024-08-17T02:49:09.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.933+0000 7fa64b400640 1 -- 172.21.15.100:0/1734602617 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64003b400 con 0x7fa6540b1120 2024-08-17T02:49:09.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.933+0000 7fa65b000640 1 -- 172.21.15.100:0/1734602617 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6541699f0 con 0x7fa6540b1120 2024-08-17T02:49:09.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.934+0000 7fa65b000640 1 -- 172.21.15.100:0/1734602617 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa654064db0 con 0x7fa6540b1120 2024-08-17T02:49:09.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.935+0000 7fa64b400640 1 -- 172.21.15.100:0/1734602617 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa640043030 con 0x7fa6540b1120 2024-08-17T02:49:09.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.935+0000 7fa64b400640 1 --2- 172.21.15.100:0/1734602617 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa634065150 0x7fa634067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:09.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.936+0000 7fa64b400640 1 -- 172.21.15.100:0/1734602617 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa640041070 con 0x7fa6540b1120 2024-08-17T02:49:09.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.936+0000 7fa653e00640 1 --2- 172.21.15.100:0/1734602617 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa634065150 0x7fa634067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:09.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.936+0000 7fa653e00640 1 --2- 172.21.15.100:0/1734602617 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa634065150 0x7fa634067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa644000c00 tx=0x7fa644009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:09.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:09.939+0000 7fa64b400640 1 -- 172.21.15.100:0/1734602617 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa640070df0 con 0x7fa6540b1120 2024-08-17T02:49:10.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.112+0000 7fa65b000640 1 -- 172.21.15.100:0/1734602617 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fa654158ad0 con 0x7fa634065150 2024-08-17T02:49:10.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.112+0000 7fa64b400640 1 -- 172.21.15.100:0/1734602617 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa654158ad0 con 0x7fa634065150 2024-08-17T02:49:10.113 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 6 to deep-scrub 2024-08-17T02:49:10.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.114+0000 7fa65b000640 1 -- 172.21.15.100:0/1734602617 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa634065150 msgr2=0x7fa634067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:10.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.114+0000 7fa65b000640 1 --2- 172.21.15.100:0/1734602617 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa634065150 0x7fa634067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa644000c00 tx=0x7fa644009040 comp rx=0 tx=0).stop 2024-08-17T02:49:10.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.114+0000 7fa65b000640 1 -- 172.21.15.100:0/1734602617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6540b1120 msgr2=0x7fa654154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:10.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.114+0000 7fa65b000640 1 --2- 172.21.15.100:0/1734602617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6540b1120 0x7fa654154a20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa640009850 tx=0x7fa640032000 comp rx=0 tx=0).stop 2024-08-17T02:49:10.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.114+0000 7fa65b000640 1 -- 172.21.15.100:0/1734602617 shutdown_connections 2024-08-17T02:49:10.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.114+0000 7fa65b000640 1 --2- 172.21.15.100:0/1734602617 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa634065150 0x7fa634067600 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.114+0000 7fa65b000640 1 --2- 172.21.15.100:0/1734602617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6540b3370 0x7fa654154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.114+0000 7fa65b000640 1 --2- 172.21.15.100:0/1734602617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6540b1120 0x7fa654154a20 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.114+0000 7fa65b000640 1 --2- 172.21.15.100:0/1734602617 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa6540ada10 0x7fa654151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.114+0000 7fa65b000640 1 -- 172.21.15.100:0/1734602617 >> 172.21.15.100:0/1734602617 conn(0x7fa6540cfdf0 msgr2=0x7fa6540ae9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:10.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.115+0000 7fa65b000640 1 -- 172.21.15.100:0/1734602617 shutdown_connections 2024-08-17T02:49:10.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.115+0000 7fa65b000640 1 -- 172.21.15.100:0/1734602617 wait complete. 2024-08-17T02:49:10.130 INFO:tasks.ceph:Scrubbing osd.7 2024-08-17T02:49:10.131 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:49:10.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.281+0000 7f69c2200640 1 Processor -- start 2024-08-17T02:49:10.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.281+0000 7f69c2200640 1 -- start start 2024-08-17T02:49:10.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.282+0000 7f69c2200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f69bc0cf0a0 0x7f69bc0cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.282+0000 7f69c2200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f69bc1589b0 0x7f69bc158e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.282+0000 7f69c2200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69bc0cacd0 con 0x7f69bc0ca0f0 2024-08-17T02:49:10.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.282+0000 7f69c2200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69bc0cf9e0 con 0x7f69bc1589b0 2024-08-17T02:49:10.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.282+0000 7f69c2200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69bc0caf70 con 0x7f69bc0cf0a0 2024-08-17T02:49:10.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.282+0000 7f69c0e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f69bc0ca0f0 0x7f69bc0ca4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39026/0 (socket says 172.21.15.100:39026) 2024-08-17T02:49:10.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.282+0000 7f69c0e00640 1 -- 172.21.15.100:0/2982581233 learned_addr learned my addr 172.21.15.100:0/2982581233 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:49:10.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.282+0000 7f69c1800640 1 --2- 172.21.15.100:0/2982581233 >> v2:172.21.15.100:3300/0 conn(0x7f69bc1589b0 0x7f69bc158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.282+0000 7f69b3e00640 1 --2- 172.21.15.100:0/2982581233 >> v2:172.21.15.123:3300/0 conn(0x7f69bc0cf0a0 0x7f69bc0cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.282+0000 7f69bbe00640 1 -- 172.21.15.100:0/2982581233 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232625918 0 0) 0x7f69bc0cacd0 con 0x7f69bc0ca0f0 2024-08-17T02:49:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.283+0000 7f69bbe00640 1 -- 172.21.15.100:0/2982581233 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69a00034e0 con 0x7f69bc0ca0f0 2024-08-17T02:49:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.283+0000 7f69c1800640 1 -- 172.21.15.100:0/2982581233 >> v2:172.21.15.123:3300/0 conn(0x7f69bc0cf0a0 msgr2=0x7f69bc0cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.283+0000 7f69c1800640 1 --2- 172.21.15.100:0/2982581233 >> v2:172.21.15.123:3300/0 conn(0x7f69bc0cf0a0 0x7f69bc0cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.283+0000 7f69c1800640 1 -- 172.21.15.100:0/2982581233 >> v1:172.21.15.100:6789/0 conn(0x7f69bc0ca0f0 legacy=0x7f69bc0ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.283+0000 7f69c1800640 1 -- 172.21.15.100:0/2982581233 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc0cb250 con 0x7f69bc1589b0 2024-08-17T02:49:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.284+0000 7f69c1800640 1 --2- 172.21.15.100:0/2982581233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69bc1589b0 0x7f69bc158e30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0acc30 tx=0x7f69b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbadf9998728bcb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.284+0000 7f69bbe00640 1 -- 172.21.15.100:0/2982581233 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b4007550 con 0x7f69bc1589b0 2024-08-17T02:49:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.284+0000 7f69bbe00640 1 -- 172.21.15.100:0/2982581233 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b402d050 con 0x7f69bc1589b0 2024-08-17T02:49:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.284+0000 7f69bbe00640 1 -- 172.21.15.100:0/2982581233 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b4007920 con 0x7f69bc1589b0 2024-08-17T02:49:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.284+0000 7f69c2200640 1 -- 172.21.15.100:0/2982581233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69bc1589b0 msgr2=0x7f69bc158e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.284+0000 7f69c2200640 1 --2- 172.21.15.100:0/2982581233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69bc1589b0 0x7f69bc158e30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0acc30 tx=0x7f69b4009780 comp rx=0 tx=0).stop 2024-08-17T02:49:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.284+0000 7f69c2200640 1 -- 172.21.15.100:0/2982581233 shutdown_connections 2024-08-17T02:49:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.284+0000 7f69c2200640 1 --2- 172.21.15.100:0/2982581233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69bc1589b0 0x7f69bc158e30 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.284+0000 7f69c2200640 1 --2- 172.21.15.100:0/2982581233 >> v2:172.21.15.123:3300/0 conn(0x7f69bc0cf0a0 0x7f69bc0cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.284+0000 7f69c2200640 1 -- 172.21.15.100:0/2982581233 >> 172.21.15.100:0/2982581233 conn(0x7f69bc0cfb50 msgr2=0x7f69bc0cff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:10.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.285+0000 7f69c2200640 1 -- 172.21.15.100:0/2982581233 shutdown_connections 2024-08-17T02:49:10.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.285+0000 7f69c2200640 1 -- 172.21.15.100:0/2982581233 wait complete. 2024-08-17T02:49:10.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.286+0000 7f69c2200640 1 Processor -- start 2024-08-17T02:49:10.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.286+0000 7f69c2200640 1 -- start start 2024-08-17T02:49:10.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.287+0000 7f69c2200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f69bc0ca0f0 0x7f69bc16b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.287+0000 7f69c2200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69bc0cf0a0 0x7f69bc15c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.287+0000 7f69c2200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69bc1589b0 0x7f69bc15c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.287+0000 7f69c2200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc0c7280 con 0x7f69bc1589b0 2024-08-17T02:49:10.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.287+0000 7f69c2200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc0c7560 con 0x7f69bc0cf0a0 2024-08-17T02:49:10.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.287+0000 7f69c2200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc0c7840 con 0x7f69bc0ca0f0 2024-08-17T02:49:10.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.287+0000 7f69c1800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69bc1589b0 0x7f69bc15c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.287+0000 7f69c1800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69bc1589b0 0x7f69bc15c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36810/0 (socket says 172.21.15.100:36810) 2024-08-17T02:49:10.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.287+0000 7f69c1800640 1 -- 172.21.15.100:0/48562820 learned_addr learned my addr 172.21.15.100:0/48562820 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:10.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.287+0000 7f69b3e00640 1 --2- 172.21.15.100:0/48562820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69bc0cf0a0 0x7f69bc15c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.287+0000 7f69c0e00640 1 --2- 172.21.15.100:0/48562820 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f69bc0ca0f0 0x7f69bc16b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.288+0000 7f69c1800640 1 -- 172.21.15.100:0/48562820 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f69bc0ca0f0 msgr2=0x7f69bc16b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:10.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.288+0000 7f69c1800640 1 --2- 172.21.15.100:0/48562820 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f69bc0ca0f0 0x7f69bc16b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.288+0000 7f69c1800640 1 -- 172.21.15.100:0/48562820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69bc0cf0a0 msgr2=0x7f69bc15c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:10.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.288+0000 7f69c1800640 1 --2- 172.21.15.100:0/48562820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69bc0cf0a0 0x7f69bc15c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.288+0000 7f69c1800640 1 -- 172.21.15.100:0/48562820 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b4009a20 con 0x7f69bc1589b0 2024-08-17T02:49:10.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.288+0000 7f69b3e00640 1 --2- 172.21.15.100:0/48562820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69bc0cf0a0 0x7f69bc15c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:10.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.288+0000 7f69c1800640 1 --2- 172.21.15.100:0/48562820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69bc1589b0 0x7f69bc15c7e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009e90 tx=0x7f69b4037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:10.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.288+0000 7f69b8c00640 1 -- 172.21.15.100:0/48562820 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b4031960 con 0x7f69bc1589b0 2024-08-17T02:49:10.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.288+0000 7f69b8c00640 1 -- 172.21.15.100:0/48562820 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b4040070 con 0x7f69bc1589b0 2024-08-17T02:49:10.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.288+0000 7f69c2200640 1 -- 172.21.15.100:0/48562820 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69bc0c7b20 con 0x7f69bc1589b0 2024-08-17T02:49:10.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.288+0000 7f69b8c00640 1 -- 172.21.15.100:0/48562820 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b4031d10 con 0x7f69bc1589b0 2024-08-17T02:49:10.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.288+0000 7f69c2200640 1 -- 172.21.15.100:0/48562820 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69bc16bec0 con 0x7f69bc1589b0 2024-08-17T02:49:10.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.289+0000 7f69c2200640 1 -- 172.21.15.100:0/48562820 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f69bc0b4f30 con 0x7f69bc1589b0 2024-08-17T02:49:10.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.290+0000 7f69b8c00640 1 -- 172.21.15.100:0/48562820 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f69b4042030 con 0x7f69bc1589b0 2024-08-17T02:49:10.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.291+0000 7f69b8c00640 1 --2- 172.21.15.100:0/48562820 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6998065180 0x7f6998067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.291+0000 7f69b8c00640 1 -- 172.21.15.100:0/48562820 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f69b40a3ad0 con 0x7f69bc1589b0 2024-08-17T02:49:10.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.291+0000 7f69c0e00640 1 --2- 172.21.15.100:0/48562820 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6998065180 0x7f6998067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.291+0000 7f69b8c00640 1 --2- 172.21.15.100:0/48562820 >> [v2:172.21.15.123:6816/37289,v1:172.21.15.123:6818/37289] conn(0x7f699806b070 0x7f699806d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.291+0000 7f69b8c00640 1 -- 172.21.15.100:0/48562820 --> [v2:172.21.15.123:6816/37289,v1:172.21.15.123:6818/37289] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f699806db30 con 0x7f699806b070 2024-08-17T02:49:10.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.291+0000 7f69b8c00640 1 -- 172.21.15.100:0/48562820 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69b40a8240 con 0x7f69bc1589b0 2024-08-17T02:49:10.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.291+0000 7f69b3e00640 1 --2- 172.21.15.100:0/48562820 >> [v2:172.21.15.123:6816/37289,v1:172.21.15.123:6818/37289] conn(0x7f699806b070 0x7f699806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.292+0000 7f69c0e00640 1 --2- 172.21.15.100:0/48562820 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6998065180 0x7f6998067630 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f69ac005840 tx=0x7f69ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.292+0000 7f69b3e00640 1 --2- 172.21.15.100:0/48562820 >> [v2:172.21.15.123:6816/37289,v1:172.21.15.123:6818/37289] conn(0x7f699806b070 0x7f699806d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.293+0000 7f69b8c00640 1 -- 172.21.15.100:0/48562820 <== osd.7 v2:172.21.15.123:6816/37289 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f699806db30 con 0x7f699806b070 2024-08-17T02:49:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.306+0000 7f69c2200640 1 -- 172.21.15.100:0/48562820 --> [v2:172.21.15.123:6816/37289,v1:172.21.15.123:6818/37289] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f69bc071050 con 0x7f699806b070 2024-08-17T02:49:10.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.307+0000 7f69b8c00640 1 -- 172.21.15.100:0/48562820 <== osd.7 v2:172.21.15.123:6816/37289 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f69bc071050 con 0x7f699806b070 2024-08-17T02:49:10.308 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-08-17T02:49:10.308 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:49:10.309 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-08-17T02:49:10.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.307+0000 7f69c2200640 1 -- 172.21.15.100:0/48562820 >> [v2:172.21.15.123:6816/37289,v1:172.21.15.123:6818/37289] conn(0x7f699806b070 msgr2=0x7f699806d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:10.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.307+0000 7f69c2200640 1 --2- 172.21.15.100:0/48562820 >> [v2:172.21.15.123:6816/37289,v1:172.21.15.123:6818/37289] conn(0x7f699806b070 0x7f699806d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.307+0000 7f69c2200640 1 -- 172.21.15.100:0/48562820 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6998065180 msgr2=0x7f6998067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:10.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.307+0000 7f69c2200640 1 --2- 172.21.15.100:0/48562820 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f6998065180 0x7f6998067630 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f69ac005840 tx=0x7f69ac009040 comp rx=0 tx=0).stop 2024-08-17T02:49:10.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.307+0000 7f69c2200640 1 -- 172.21.15.100:0/48562820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69bc1589b0 msgr2=0x7f69bc15c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:10.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.307+0000 7f69c2200640 1 --2- 172.21.15.100:0/48562820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69bc1589b0 0x7f69bc15c7e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009e90 tx=0x7f69b4037000 comp rx=0 tx=0).stop 2024-08-17T02:49:10.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.307+0000 7f69c1800640 1 -- 172.21.15.100:0/48562820 reap_dead start 2024-08-17T02:49:10.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.307+0000 7f69c2200640 1 -- 172.21.15.100:0/48562820 shutdown_connections 2024-08-17T02:49:10.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.307+0000 7f69c2200640 1 -- 172.21.15.100:0/48562820 >> 172.21.15.100:0/48562820 conn(0x7f69bc0cfb50 msgr2=0x7f69bc0ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:10.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.307+0000 7f69c2200640 1 -- 172.21.15.100:0/48562820 shutdown_connections 2024-08-17T02:49:10.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.307+0000 7f69c2200640 1 -- 172.21.15.100:0/48562820 wait complete. 2024-08-17T02:49:10.323 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-17T02:49:10.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.471+0000 7fa9f0200640 1 Processor -- start 2024-08-17T02:49:10.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.471+0000 7fa9f0200640 1 -- start start 2024-08-17T02:49:10.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.472+0000 7fa9f0200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa9e8158ce0 0x7fa9e80c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.472+0000 7fa9f0200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa9e80d08d0 0x7fa9e81590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.472+0000 7fa9f0200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa9e80cac30 0x7fa9e80cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.472+0000 7fa9f0200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e80cf0c0 con 0x7fa9e80cac30 2024-08-17T02:49:10.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.472+0000 7fa9f0200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e8089000 con 0x7fa9e8158ce0 2024-08-17T02:49:10.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.472+0000 7fa9f0200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80ceb20 con 0x7fa9e80d08d0 2024-08-17T02:49:10.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.473+0000 7fa9ee200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa9e80cac30 0x7fa9e80cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.473+0000 7fa9ee200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa9e80cac30 0x7fa9e80cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36820/0 (socket says 172.21.15.100:36820) 2024-08-17T02:49:10.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.473+0000 7fa9ee200640 1 -- 172.21.15.100:0/2659622673 learned_addr learned my addr 172.21.15.100:0/2659622673 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:10.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.473+0000 7fa9ed800640 1 --2- 172.21.15.100:0/2659622673 >> v2:172.21.15.123:3300/0 conn(0x7fa9e8158ce0 0x7fa9e80c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.473+0000 7fa9ece00640 1 --2- 172.21.15.100:0/2659622673 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa9e80d08d0 0x7fa9e81590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.473+0000 7fa9ee200640 1 -- 172.21.15.100:0/2659622673 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa9e80d08d0 msgr2=0x7fa9e81590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:10.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.473+0000 7fa9ee200640 1 --2- 172.21.15.100:0/2659622673 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa9e80d08d0 0x7fa9e81590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.473+0000 7fa9ee200640 1 -- 172.21.15.100:0/2659622673 >> v2:172.21.15.123:3300/0 conn(0x7fa9e8158ce0 msgr2=0x7fa9e80c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:10.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.473+0000 7fa9ee200640 1 --2- 172.21.15.100:0/2659622673 >> v2:172.21.15.123:3300/0 conn(0x7fa9e8158ce0 0x7fa9e80c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.473+0000 7fa9ee200640 1 -- 172.21.15.100:0/2659622673 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e80cede0 con 0x7fa9e80cac30 2024-08-17T02:49:10.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.474+0000 7fa9ee200640 1 --2- 172.21.15.100:0/2659622673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9e80cac30 0x7fa9e80cb0b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80644e0 tx=0x7fa9e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c16c65146126d1e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:10.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.474+0000 7fa9e7e00640 1 -- 172.21.15.100:0/2659622673 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0031400 con 0x7fa9e80cac30 2024-08-17T02:49:10.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.474+0000 7fa9e7e00640 1 -- 172.21.15.100:0/2659622673 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e002d050 con 0x7fa9e80cac30 2024-08-17T02:49:10.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.474+0000 7fa9e7e00640 1 -- 172.21.15.100:0/2659622673 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e00317d0 con 0x7fa9e80cac30 2024-08-17T02:49:10.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.475+0000 7fa9f0200640 1 -- 172.21.15.100:0/2659622673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9e80cac30 msgr2=0x7fa9e80cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:10.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.475+0000 7fa9f0200640 1 --2- 172.21.15.100:0/2659622673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9e80cac30 0x7fa9e80cb0b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80644e0 tx=0x7fa9e0009840 comp rx=0 tx=0).stop 2024-08-17T02:49:10.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.475+0000 7fa9f0200640 1 -- 172.21.15.100:0/2659622673 shutdown_connections 2024-08-17T02:49:10.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.475+0000 7fa9f0200640 1 --2- 172.21.15.100:0/2659622673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9e80cac30 0x7fa9e80cb0b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.475+0000 7fa9f0200640 1 --2- 172.21.15.100:0/2659622673 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa9e80d08d0 0x7fa9e81590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.475+0000 7fa9f0200640 1 --2- 172.21.15.100:0/2659622673 >> v2:172.21.15.123:3300/0 conn(0x7fa9e8158ce0 0x7fa9e80c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.475+0000 7fa9f0200640 1 -- 172.21.15.100:0/2659622673 >> 172.21.15.100:0/2659622673 conn(0x7fa9e80cfdc0 msgr2=0x7fa9e80d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.475+0000 7fa9f0200640 1 -- 172.21.15.100:0/2659622673 shutdown_connections 2024-08-17T02:49:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.475+0000 7fa9f0200640 1 -- 172.21.15.100:0/2659622673 wait complete. 2024-08-17T02:49:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.476+0000 7fa9f0200640 1 Processor -- start 2024-08-17T02:49:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.477+0000 7fa9f0200640 1 -- start start 2024-08-17T02:49:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.477+0000 7fa9f0200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9e80cac30 0x7fa9e814b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.477+0000 7fa9f0200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa9e80d08d0 0x7fa9e80b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.477+0000 7fa9f0200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9e8158ce0 0x7fa9e80688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.477+0000 7fa9f0200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80c9450 con 0x7fa9e8158ce0 2024-08-17T02:49:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.477+0000 7fa9f0200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80c8560 con 0x7fa9e80cac30 2024-08-17T02:49:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.477+0000 7fa9f0200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80c8840 con 0x7fa9e80d08d0 2024-08-17T02:49:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.478+0000 7fa9ee200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9e8158ce0 0x7fa9e80688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.478+0000 7fa9ee200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9e8158ce0 0x7fa9e80688a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36822/0 (socket says 172.21.15.100:36822) 2024-08-17T02:49:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.478+0000 7fa9ee200640 1 -- 172.21.15.100:0/2562650816 learned_addr learned my addr 172.21.15.100:0/2562650816 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.478+0000 7fa9ed800640 1 --2- 172.21.15.100:0/2562650816 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9e80cac30 0x7fa9e814b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.478+0000 7fa9ece00640 1 --2- 172.21.15.100:0/2562650816 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa9e80d08d0 0x7fa9e80b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.478+0000 7fa9ee200640 1 -- 172.21.15.100:0/2562650816 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa9e80d08d0 msgr2=0x7fa9e80b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:10.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.478+0000 7fa9ee200640 1 --2- 172.21.15.100:0/2562650816 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa9e80d08d0 0x7fa9e80b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.478+0000 7fa9ee200640 1 -- 172.21.15.100:0/2562650816 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9e80cac30 msgr2=0x7fa9e814b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:10.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.478+0000 7fa9ee200640 1 --2- 172.21.15.100:0/2562650816 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9e80cac30 0x7fa9e814b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.478+0000 7fa9ee200640 1 -- 172.21.15.100:0/2562650816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e0009ae0 con 0x7fa9e8158ce0 2024-08-17T02:49:10.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.478+0000 7fa9ee200640 1 --2- 172.21.15.100:0/2562650816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9e8158ce0 0x7fa9e80688a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0009f80 tx=0x7fa9e0036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:10.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.479+0000 7fa9e4c00640 1 -- 172.21.15.100:0/2562650816 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0031880 con 0x7fa9e8158ce0 2024-08-17T02:49:10.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.479+0000 7fa9e4c00640 1 -- 172.21.15.100:0/2562650816 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e0008e50 con 0x7fa9e8158ce0 2024-08-17T02:49:10.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.479+0000 7fa9e4c00640 1 -- 172.21.15.100:0/2562650816 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e003b660 con 0x7fa9e8158ce0 2024-08-17T02:49:10.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.479+0000 7fa9f0200640 1 -- 172.21.15.100:0/2562650816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e80c8b20 con 0x7fa9e8158ce0 2024-08-17T02:49:10.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.479+0000 7fa9f0200640 1 -- 172.21.15.100:0/2562650816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e80c90e0 con 0x7fa9e8158ce0 2024-08-17T02:49:10.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.480+0000 7fa9f0200640 1 -- 172.21.15.100:0/2562650816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e8064db0 con 0x7fa9e8158ce0 2024-08-17T02:49:10.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.481+0000 7fa9e4c00640 1 -- 172.21.15.100:0/2562650816 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa9e0038050 con 0x7fa9e8158ce0 2024-08-17T02:49:10.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.481+0000 7fa9e4c00640 1 --2- 172.21.15.100:0/2562650816 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa9c8065180 0x7fa9c8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.481+0000 7fa9e4c00640 1 -- 172.21.15.100:0/2562650816 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa9e00a2d30 con 0x7fa9e8158ce0 2024-08-17T02:49:10.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.482+0000 7fa9ed800640 1 --2- 172.21.15.100:0/2562650816 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa9c8065180 0x7fa9c8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.482+0000 7fa9ed800640 1 --2- 172.21.15.100:0/2562650816 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa9c8065180 0x7fa9c8067630 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc009c80 tx=0x7fa9dc0090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:10.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.486+0000 7fa9e4c00640 1 -- 172.21.15.100:0/2562650816 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa9e00710a0 con 0x7fa9e8158ce0 2024-08-17T02:49:10.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.657+0000 7fa9f0200640 1 -- 172.21.15.100:0/2562650816 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9e814f670 con 0x7fa9c8065180 2024-08-17T02:49:10.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.658+0000 7fa9e4c00640 1 -- 172.21.15.100:0/2562650816 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa9e814f670 con 0x7fa9c8065180 2024-08-17T02:49:10.658 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 7 to deep-scrub 2024-08-17T02:49:10.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.660+0000 7fa9f0200640 1 -- 172.21.15.100:0/2562650816 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa9c8065180 msgr2=0x7fa9c8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:10.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.660+0000 7fa9f0200640 1 --2- 172.21.15.100:0/2562650816 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa9c8065180 0x7fa9c8067630 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc009c80 tx=0x7fa9dc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.660+0000 7fa9f0200640 1 -- 172.21.15.100:0/2562650816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9e8158ce0 msgr2=0x7fa9e80688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:10.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.660+0000 7fa9f0200640 1 --2- 172.21.15.100:0/2562650816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9e8158ce0 0x7fa9e80688a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0009f80 tx=0x7fa9e0036000 comp rx=0 tx=0).stop 2024-08-17T02:49:10.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.660+0000 7fa9f0200640 1 -- 172.21.15.100:0/2562650816 shutdown_connections 2024-08-17T02:49:10.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.660+0000 7fa9f0200640 1 --2- 172.21.15.100:0/2562650816 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fa9c8065180 0x7fa9c8067630 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.660+0000 7fa9f0200640 1 --2- 172.21.15.100:0/2562650816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9e8158ce0 0x7fa9e80688a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.660+0000 7fa9f0200640 1 --2- 172.21.15.100:0/2562650816 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa9e80d08d0 0x7fa9e80b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.660+0000 7fa9f0200640 1 --2- 172.21.15.100:0/2562650816 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9e80cac30 0x7fa9e814b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.660+0000 7fa9f0200640 1 -- 172.21.15.100:0/2562650816 >> 172.21.15.100:0/2562650816 conn(0x7fa9e80cfdc0 msgr2=0x7fa9e80675f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:10.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.660+0000 7fa9f0200640 1 -- 172.21.15.100:0/2562650816 shutdown_connections 2024-08-17T02:49:10.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.660+0000 7fa9f0200640 1 -- 172.21.15.100:0/2562650816 wait complete. 2024-08-17T02:49:10.676 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:49:10.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.823+0000 7ff0c3200640 1 Processor -- start 2024-08-17T02:49:10.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.823+0000 7ff0c3200640 1 -- start start 2024-08-17T02:49:10.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.824+0000 7ff0c3200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff0bc155550 0x7ff0bc0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.824+0000 7ff0c3200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0bc0afc10 con 0x7ff0bc06e080 2024-08-17T02:49:10.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.824+0000 7ff0c3200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0bc0af000 con 0x7ff0bc155180 2024-08-17T02:49:10.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.824+0000 7ff0c3200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0bc0af2e0 con 0x7ff0bc155550 2024-08-17T02:49:10.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.825+0000 7ff0c1200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff0bc06e080 0x7ff0bc06e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39030/0 (socket says 172.21.15.100:39030) 2024-08-17T02:49:10.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.825+0000 7ff0c1200640 1 -- 172.21.15.100:0/3026226727 learned_addr learned my addr 172.21.15.100:0/3026226727 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:49:10.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.825+0000 7ff0bb400640 1 --2- 172.21.15.100:0/3026226727 >> v2:172.21.15.123:3300/0 conn(0x7ff0bc155550 0x7ff0bc0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.825+0000 7ff0baa00640 1 -- 172.21.15.100:0/3026226727 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927789337 0 0) 0x7ff0bc0afc10 con 0x7ff0bc06e080 2024-08-17T02:49:10.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.825+0000 7ff0baa00640 1 -- 172.21.15.100:0/3026226727 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0a00034e0 con 0x7ff0bc06e080 2024-08-17T02:49:10.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.825+0000 7ff0baa00640 1 -- 172.21.15.100:0/3026226727 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2322298546 0 0) 0x7ff0a00034e0 con 0x7ff0bc06e080 2024-08-17T02:49:10.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.825+0000 7ff0baa00640 1 -- 172.21.15.100:0/3026226727 >> v2:172.21.15.123:3300/0 conn(0x7ff0bc155550 msgr2=0x7ff0bc0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:10.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.825+0000 7ff0baa00640 1 --2- 172.21.15.100:0/3026226727 >> v2:172.21.15.123:3300/0 conn(0x7ff0bc155550 0x7ff0bc0aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.825+0000 7ff0baa00640 1 -- 172.21.15.100:0/3026226727 >> v1:172.21.15.123:6789/0 conn(0x7ff0bc155180 legacy=0x7ff0bc0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:10.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.825+0000 7ff0baa00640 1 -- 172.21.15.100:0/3026226727 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc0af5c0 con 0x7ff0bc06e080 2024-08-17T02:49:10.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.825+0000 7ff0baa00640 1 -- 172.21.15.100:0/3026226727 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1817143124 0 0) 0x7ff0b4001810 con 0x7ff0bc06e080 2024-08-17T02:49:10.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.825+0000 7ff0baa00640 1 -- 172.21.15.100:0/3026226727 >> v1:172.21.15.100:6789/0 conn(0x7ff0bc06e080 legacy=0x7ff0bc06e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:10.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.825+0000 7ff0baa00640 1 --2- 172.21.15.100:0/3026226727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0a0003a20 0x7ff0a0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.825+0000 7ff0baa00640 1 --2- 172.21.15.100:0/3026226727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0a0004780 0x7ff0a0004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.826+0000 7ff0baa00640 1 --2- 172.21.15.100:0/3026226727 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0a0005180 0x7ff0a000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.826+0000 7ff0baa00640 1 -- 172.21.15.100:0/3026226727 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc0af2e0 con 0x7ff0a0004780 2024-08-17T02:49:10.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.826+0000 7ff0baa00640 1 -- 172.21.15.100:0/3026226727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a000c0a0 con 0x7ff0a0003a20 2024-08-17T02:49:10.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.826+0000 7ff0baa00640 1 -- 172.21.15.100:0/3026226727 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a000c260 con 0x7ff0a0005180 2024-08-17T02:49:10.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.826+0000 7ff0bb400640 1 --2- 172.21.15.100:0/3026226727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0a0004780 0x7ff0a0004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.826+0000 7ff0bbe00640 1 --2- 172.21.15.100:0/3026226727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0a0003a20 0x7ff0a0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.826+0000 7ff0c1200640 1 --2- 172.21.15.100:0/3026226727 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0a0005180 0x7ff0a000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.826+0000 7ff0bb400640 1 -- 172.21.15.100:0/3026226727 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0a0005180 msgr2=0x7ff0a000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:10.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.826+0000 7ff0bb400640 1 --2- 172.21.15.100:0/3026226727 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0a0005180 0x7ff0a000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.826+0000 7ff0bb400640 1 -- 172.21.15.100:0/3026226727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0a0003a20 msgr2=0x7ff0a0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:10.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.826+0000 7ff0bb400640 1 --2- 172.21.15.100:0/3026226727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0a0003a20 0x7ff0a0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.826+0000 7ff0bb400640 1 -- 172.21.15.100:0/3026226727 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a00034e0 con 0x7ff0a0004780 2024-08-17T02:49:10.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.826+0000 7ff0c1200640 1 -- 172.21.15.100:0/3026226727 reap_dead start 2024-08-17T02:49:10.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.827+0000 7ff0bb400640 1 --2- 172.21.15.100:0/3026226727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0a0004780 0x7ff0a0004bf0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff0a800bce0 tx=0x7ff0a800f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2352de8d1dd7234a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:10.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.827+0000 7ff0baa00640 1 -- 172.21.15.100:0/3026226727 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8033410 con 0x7ff0a0004780 2024-08-17T02:49:10.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.827+0000 7ff0baa00640 1 -- 172.21.15.100:0/3026226727 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a802d030 con 0x7ff0a0004780 2024-08-17T02:49:10.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.828+0000 7ff0baa00640 1 -- 172.21.15.100:0/3026226727 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a80337a0 con 0x7ff0a0004780 2024-08-17T02:49:10.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.828+0000 7ff0c3200640 1 -- 172.21.15.100:0/3026226727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0a0004780 msgr2=0x7ff0a0004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:10.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.828+0000 7ff0c3200640 1 --2- 172.21.15.100:0/3026226727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0a0004780 0x7ff0a0004bf0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff0a800bce0 tx=0x7ff0a800f040 comp rx=0 tx=0).stop 2024-08-17T02:49:10.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.828+0000 7ff0c3200640 1 -- 172.21.15.100:0/3026226727 shutdown_connections 2024-08-17T02:49:10.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.828+0000 7ff0c3200640 1 --2- 172.21.15.100:0/3026226727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0a0004780 0x7ff0a0004bf0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.828+0000 7ff0c3200640 1 -- 172.21.15.100:0/3026226727 >> 172.21.15.100:0/3026226727 conn(0x7ff0bc0cb9b0 msgr2=0x7ff0bc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:10.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.828+0000 7ff0c3200640 1 -- 172.21.15.100:0/3026226727 shutdown_connections 2024-08-17T02:49:10.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.828+0000 7ff0c3200640 1 -- 172.21.15.100:0/3026226727 wait complete. 2024-08-17T02:49:10.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.830+0000 7ff0c3200640 1 Processor -- start 2024-08-17T02:49:10.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.830+0000 7ff0c3200640 1 -- start start 2024-08-17T02:49:10.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.831+0000 7ff0c3200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0a0004780 0x7ff0bc0ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.831+0000 7ff0c3200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0bc152c80 0x7ff0bc0c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.831+0000 7ff0c3200640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0bc1530f0 0x7ff0bc0c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.831+0000 7ff0c3200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc155df0 con 0x7ff0bc152c80 2024-08-17T02:49:10.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.831+0000 7ff0c3200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc1560d0 con 0x7ff0a0004780 2024-08-17T02:49:10.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.831+0000 7ff0c3200640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc1563b0 con 0x7ff0bc1530f0 2024-08-17T02:49:10.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.831+0000 7ff0bb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0bc152c80 0x7ff0bc0c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.831+0000 7ff0bb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0bc152c80 0x7ff0bc0c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36834/0 (socket says 172.21.15.100:36834) 2024-08-17T02:49:10.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.831+0000 7ff0bbe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0a0004780 0x7ff0bc0ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.831+0000 7ff0bb400640 1 -- 172.21.15.100:0/2437720903 learned_addr learned my addr 172.21.15.100:0/2437720903 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:10.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.831+0000 7ff0c1200640 1 --2- 172.21.15.100:0/2437720903 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0bc1530f0 0x7ff0bc0c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.832+0000 7ff0bb400640 1 -- 172.21.15.100:0/2437720903 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0bc1530f0 msgr2=0x7ff0bc0c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:10.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.832+0000 7ff0bb400640 1 --2- 172.21.15.100:0/2437720903 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0bc1530f0 0x7ff0bc0c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.832+0000 7ff0bb400640 1 -- 172.21.15.100:0/2437720903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0a0004780 msgr2=0x7ff0bc0ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:10.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.832+0000 7ff0bb400640 1 --2- 172.21.15.100:0/2437720903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0a0004780 0x7ff0bc0ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:10.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.832+0000 7ff0bb400640 1 -- 172.21.15.100:0/2437720903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc156690 con 0x7ff0bc152c80 2024-08-17T02:49:10.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.832+0000 7ff0bb400640 1 --2- 172.21.15.100:0/2437720903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0bc152c80 0x7ff0bc0c85d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff0a802ac30 tx=0x7ff0a8033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:10.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.832+0000 7ff0b3400640 1 -- 172.21.15.100:0/2437720903 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a803c6e0 con 0x7ff0bc152c80 2024-08-17T02:49:10.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.832+0000 7ff0b3400640 1 -- 172.21.15.100:0/2437720903 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a803c840 con 0x7ff0bc152c80 2024-08-17T02:49:10.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.832+0000 7ff0b3400640 1 -- 172.21.15.100:0/2437720903 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a803c9f0 con 0x7ff0bc152c80 2024-08-17T02:49:10.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.832+0000 7ff0c3200640 1 -- 172.21.15.100:0/2437720903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0bc156970 con 0x7ff0bc152c80 2024-08-17T02:49:10.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.832+0000 7ff0c3200640 1 -- 172.21.15.100:0/2437720903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0bc1559d0 con 0x7ff0bc152c80 2024-08-17T02:49:10.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.833+0000 7ff0c3200640 1 -- 172.21.15.100:0/2437720903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0bc155bc0 con 0x7ff0bc152c80 2024-08-17T02:49:10.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.834+0000 7ff0b3400640 1 -- 172.21.15.100:0/2437720903 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff0a803a040 con 0x7ff0bc152c80 2024-08-17T02:49:10.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.835+0000 7ff0b3400640 1 --2- 172.21.15.100:0/2437720903 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff09c065180 0x7ff09c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:10.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.835+0000 7ff0b3400640 1 -- 172.21.15.100:0/2437720903 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff0a8042020 con 0x7ff0bc152c80 2024-08-17T02:49:10.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.835+0000 7ff0bbe00640 1 --2- 172.21.15.100:0/2437720903 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff09c065180 0x7ff09c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:10.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.836+0000 7ff0bbe00640 1 --2- 172.21.15.100:0/2437720903 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff09c065180 0x7ff09c067630 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac000c00 tx=0x7ff0ac007ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:10.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:10.839+0000 7ff0b3400640 1 -- 172.21.15.100:0/2437720903 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff0a80705e0 con 0x7ff0bc152c80 2024-08-17T02:49:11.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:11.008+0000 7ff0c3200640 1 -- 172.21.15.100:0/2437720903 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0bc156240 con 0x7ff09c065180 2024-08-17T02:49:11.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:11.010+0000 7ff0b3400640 1 -- 172.21.15.100:0/2437720903 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50771 (secure 0 0 0) 0x7ff0bc156240 con 0x7ff09c065180 2024-08-17T02:49:11.011 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:49:11.012 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-08-17T02:49:11.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:11.012+0000 7ff0c3200640 1 -- 172.21.15.100:0/2437720903 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff09c065180 msgr2=0x7ff09c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:11.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:11.012+0000 7ff0c3200640 1 --2- 172.21.15.100:0/2437720903 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff09c065180 0x7ff09c067630 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac000c00 tx=0x7ff0ac007ca0 comp rx=0 tx=0).stop 2024-08-17T02:49:11.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:11.012+0000 7ff0c3200640 1 -- 172.21.15.100:0/2437720903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0bc152c80 msgr2=0x7ff0bc0c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:11.012+0000 7ff0c3200640 1 --2- 172.21.15.100:0/2437720903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0bc152c80 0x7ff0bc0c85d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff0a802ac30 tx=0x7ff0a8033000 comp rx=0 tx=0).stop 2024-08-17T02:49:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:11.012+0000 7ff0c3200640 1 -- 172.21.15.100:0/2437720903 shutdown_connections 2024-08-17T02:49:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:11.012+0000 7ff0c3200640 1 --2- 172.21.15.100:0/2437720903 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7ff09c065180 0x7ff09c067630 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:11.013+0000 7ff0c3200640 1 --2- 172.21.15.100:0/2437720903 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0bc1530f0 0x7ff0bc0c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:11.013+0000 7ff0c3200640 1 --2- 172.21.15.100:0/2437720903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0bc152c80 0x7ff0bc0c85d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:11.013+0000 7ff0c3200640 1 --2- 172.21.15.100:0/2437720903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0a0004780 0x7ff0bc0ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:11.013+0000 7ff0c3200640 1 -- 172.21.15.100:0/2437720903 >> 172.21.15.100:0/2437720903 conn(0x7ff0bc0cb9b0 msgr2=0x7ff0bc0cac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:11.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:11.013+0000 7ff0c3200640 1 -- 172.21.15.100:0/2437720903 shutdown_connections 2024-08-17T02:49:11.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:11.013+0000 7ff0c3200640 1 -- 172.21.15.100:0/2437720903 wait complete. 2024-08-17T02:49:11.028 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-08-17T02:49:09.139456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388244,"kb_used_data":5224,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586476,"statfs":{"total":773094113280,"available":770648551424,"internally_reserved":0,"allocated":5349376,"data_stored":2906160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.684735"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-17T02:48:59.840723+0000","last_change":"2024-08-17T02:45:37.011679+0000","last_active":"2024-08-17T02:48:59.840723+0000","last_peered":"2024-08-17T02:48:59.840723+0000","last_clean":"2024-08-17T02:48:59.840723+0000","last_became_active":"2024-08-17T02:45:37.010559+0000","last_became_peered":"2024-08-17T02:45:37.010559+0000","last_unstale":"2024-08-17T02:48:59.840723+0000","last_undegraded":"2024-08-17T02:48:59.840723+0000","last_fullsized":"2024-08-17T02:48:59.840723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:45:35.708391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:45:35.708391+0000","last_clean_scrub_stamp":"2024-08-17T02:45:35.708391+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:11.380093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302608,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069232,"statfs":{"total":96636764160,"available":96326893568,"internally_reserved":0,"allocated":1114112,"data_stored":806046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.65400000000000003,"15min":0.628},"min":{"1min":0.55500000000000005,"5min":0.372,"15min":0.372},"max":{"1min":0.91400000000000003,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.68700000000000006,"15min":0.66900000000000004},"min":{"1min":0.497,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90500000000000003,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.621}]},{"osd":1,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.70099999999999996,"15min":0.68200000000000005},"min":{"1min":0.624,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95399999999999996,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.68799999999999994,"15min":0.65900000000000003},"min":{"1min":0.58399999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.89400000000000002,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.59299999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69399999999999995,"15min":0.67200000000000004},"min":{"1min":0.60699999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88100000000000001,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73399999999999999,"15min":0.71999999999999997},"min":{"1min":0.65100000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92600000000000005,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.53800000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.70799999999999996,"15min":0.68799999999999994},"min":{"1min":0.63,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92900000000000005,"5min":1.034,"15min":1.034},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.747,"15min":0.745},"min":{"1min":0.60199999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.95799999999999996,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.61099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66500000000000004,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.746,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":0.875},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64000000000000001,"15min":0.64900000000000002},"min":{"1min":0.47999999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.871,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.97299999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66800000000000004,"15min":0.68999999999999995},"min":{"1min":0.49399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98199999999999998,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.69199999999999995,"15min":0.70999999999999996},"min":{"1min":0.47899999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88,"5min":1.071,"15min":1.071},"last":0.91800000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.876,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.70899999999999996,"15min":0.72799999999999998},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.78700000000000003,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.85499999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":520192,"data_stored":215678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":1.0569999999999999,"15min":1.198},"min":{"1min":0.52400000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0389999999999999,"5min":12.430999999999999,"15min":12.430999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.97799999999999998,"15min":1.0940000000000001},"min":{"1min":0.57299999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95799999999999996,"5min":10.391,"15min":10.391},"last":0.54300000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":1.044,"15min":1.1839999999999999},"min":{"1min":0.59099999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96499999999999997,"5min":11.654,"15min":11.654},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.74299999999999999,"5min":1.044,"15min":1.1779999999999999},"min":{"1min":0.59499999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97599999999999998,"5min":11.484,"15min":11.484},"last":0.73799999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71599999999999997,"15min":0.70799999999999996},"min":{"1min":0.5,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90700000000000003,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":1.0620000000000001,"15min":1.2090000000000001},"min":{"1min":0.55500000000000005,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.94299999999999995,"5min":12.025,"15min":12.025},"last":0.75600000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":1.079,"15min":1.23},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98099999999999998,"5min":12.073,"15min":12.073},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":1.083,"15min":1.2230000000000001},"min":{"1min":0.60099999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.0129999999999999,"5min":12.374000000000001,"15min":12.374000000000001},"last":0.70499999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.96899999999999997,"15min":1.131},"min":{"1min":0.42599999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.88100000000000001,"5min":11.545999999999999,"15min":11.545999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.64200000000000002,"15min":0.66900000000000004},"min":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79900000000000004,"5min":2.202,"15min":2.202},"last":0.63500000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":1.02,"15min":1.212},"min":{"1min":0.45500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.80100000000000005,"5min":12.111000000000001,"15min":12.111000000000001},"last":0.621},{"interface":"front","average":{"1min":0.66600000000000004,"5min":1.042,"15min":1.2170000000000001},"min":{"1min":0.443,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0649999999999999,"5min":12.477,"15min":12.477},"last":0.79300000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.97099999999999997,"15min":1.115},"min":{"1min":0.502,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94099999999999995,"5min":10.526999999999999,"15min":10.526999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":1.1399999999999999,"15min":1.3340000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.86099999999999999,"5min":13.638,"15min":13.638},"last":0.71999999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":520192,"data_stored":215678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63100000000000001,"15min":0.60899999999999999},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.79500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65100000000000002,"15min":0.63800000000000001},"min":{"1min":0.54300000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.45200000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63500000000000001,"15min":0.621},"min":{"1min":0.51100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.86699999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":1.2030000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66000000000000003,"15min":0.63800000000000001},"min":{"1min":0.58999999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84699999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.56999999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.624},"min":{"1min":0.46600000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86599999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.51000000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.54600000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.69599999999999995,"15min":0.68999999999999995},"min":{"1min":0.56999999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.85899999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.627},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69099999999999995,"15min":0.68100000000000005},"min":{"1min":0.59499999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.89400000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":1.2290000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78700000000000003,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60099999999999998,"15min":0.60399999999999998},"min":{"1min":0.45400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.52700000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.65300000000000002,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80700000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.83399999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.498}]},{"osd":7,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69499999999999995,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90300000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.82699999999999996,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.51800000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297868,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":520192,"data_stored":215678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67100000000000004,"15min":0.63900000000000001},"min":{"1min":0.50600000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88900000000000001,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.497},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63600000000000001,"15min":0.61499999999999999},"min":{"1min":0.52700000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.80000000000000004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.48499999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63900000000000001,"15min":0.61799999999999999},"min":{"1min":0.51500000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.79300000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65900000000000003,"15min":0.63500000000000001},"min":{"1min":0.51700000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84999999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.55500000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68799999999999994,"15min":0.66600000000000004},"min":{"1min":0.55300000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86899999999999999,"5min":1.286,"15min":1.286},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71799999999999997,"15min":0.69799999999999995},"min":{"1min":0.56899999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.85599999999999998,"5min":1.609,"15min":1.609},"last":0.61099999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.69899999999999995,"15min":0.67900000000000005},"min":{"1min":0.59699999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85099999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67500000000000004,"15min":0.64900000000000002},"min":{"1min":0.57699999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84499999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.74099999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.66300000000000003,"15min":0.68500000000000005},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.752,"5min":1.077,"15min":1.077},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92100000000000004,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.63200000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63700000000000001,"15min":0.65700000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90400000000000003,"5min":1.198,"15min":1.198},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.88700000000000001,"5min":1.145,"15min":1.145},"last":0.65700000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.48499999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88500000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.83799999999999997,"5min":1.101,"15min":1.101},"last":0.76700000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":520192,"data_stored":215678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.29699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67000000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.47299999999999998,"15min":0.45900000000000002},"min":{"1min":0.311,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74099999999999999,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.34200000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65500000000000003,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.41799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76700000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.441}]},{"osd":2,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64100000000000001,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55700000000000005,"15min":0.55100000000000005},"min":{"1min":0.46300000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.42199999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.74099999999999999,"15min":0.71799999999999997},"min":{"1min":0.65100000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.75600000000000001,"15min":0.752},"min":{"1min":0.58399999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.042,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.628}]},{"osd":5,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.75700000000000001,"15min":0.747},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2,"5min":1.212,"15min":1.212},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77500000000000002,"15min":0.77100000000000002},"min":{"1min":0.628,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.90900000000000003,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.56399999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78400000000000003,"15min":0.77800000000000002},"min":{"1min":0.61899999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0249999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80800000000000005,"15min":0.79000000000000004},"min":{"1min":0.64500000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.58399999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.78200000000000003,"15min":0.75800000000000001},"min":{"1min":0.628,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.63300000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.59699999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":520192,"data_stored":215678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.44800000000000001,"15min":0.44},"min":{"1min":0.35699999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67200000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44900000000000001,"15min":0.44600000000000001},"min":{"1min":0.35099999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.57099999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54100000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.495,"15min":0.497},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.63900000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.42099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.60999999999999999,"5min":1.139,"15min":1.139},"last":0.36899999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.48399999999999999,"15min":0.46200000000000002},"min":{"1min":0.42499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.58899999999999997,"15min":0.57799999999999996},"min":{"1min":0.49099999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72499999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.52200000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.77600000000000002,"15min":0.77400000000000002},"min":{"1min":0.67200000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.997,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.75900000000000001,"15min":0.747},"min":{"1min":0.621,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.45700000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.78000000000000003,"15min":0.77800000000000002},"min":{"1min":0.64200000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.002,"5min":1.135,"15min":1.135},"last":0.66500000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.80300000000000005,"15min":0.80500000000000005},"min":{"1min":0.61599999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0569999999999999,"5min":1.103,"15min":1.103},"last":0.496},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.80700000000000005,"15min":0.79900000000000004},"min":{"1min":0.70599999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.82099999999999995,"15min":0.81699999999999995},"min":{"1min":0.68600000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.625},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.61799999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0209999999999999,"5min":1.038,"15min":1.038},"last":0.73399999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297868,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":520192,"data_stored":215678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.40999999999999998},"min":{"1min":0.312,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66000000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.44700000000000001,"15min":0.42999999999999999},"min":{"1min":0.37,"5min":0.246,"15min":0.246},"max":{"1min":0.63300000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.373}]},{"osd":2,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.39700000000000002,"15min":0.373},"min":{"1min":0.35399999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.40799999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.69799999999999995,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.42999999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59399999999999997,"15min":0.57299999999999995},"min":{"1min":0.53100000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78900000000000003,"5min":1.054,"15min":1.054},"last":0.499},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.75700000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.40100000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.63,"15min":0.59799999999999998},"min":{"1min":0.50600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66500000000000004,"15min":0.64300000000000002},"min":{"1min":0.59599999999999997,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.091,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.78600000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.65800000000000003,"15min":0.63400000000000001},"min":{"1min":0.56100000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93799999999999994,"5min":1.002,"15min":1.002},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.66300000000000003,"15min":0.64300000000000002},"min":{"1min":0.55600000000000005,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.998,"5min":1.042,"15min":1.042},"last":0.81999999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.73199999999999998,"15min":0.71799999999999997},"min":{"1min":0.65400000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.995,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.73099999999999998,"15min":0.70399999999999996},"min":{"1min":0.627,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.054,"5min":1.256,"15min":1.256},"last":0.77600000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.57999999999999996,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.876},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.749,"15min":0.73099999999999998},"min":{"1min":0.73599999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0229999999999999,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.90400000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542190,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298444,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073396,"statfs":{"total":96636764160,"available":96331157504,"internally_reserved":0,"allocated":1114112,"data_stored":806046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.434,"15min":0.442},"min":{"1min":0.32200000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66300000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.50600000000000001},"min":{"1min":0.42499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75700000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.40899999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51600000000000001,"15min":0.53100000000000003},"min":{"1min":0.40300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.65400000000000003,"5min":0.878,"15min":0.878},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.53500000000000003,"15min":0.54700000000000004},"min":{"1min":0.375,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.63200000000000001,"5min":1.111,"15min":1.111},"last":0.439}]},{"osd":3,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.498,"15min":0.48399999999999999},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77600000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.51600000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.91000000000000003,"5min":1.115,"15min":1.115},"last":0.64100000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72699999999999998,"15min":0.71399999999999997},"min":{"1min":0.503,"5min":0.496,"15min":0.496},"max":{"1min":0.90900000000000003,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.78000000000000003,"15min":0.79000000000000004},"min":{"1min":0.62,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96699999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.84799999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73299999999999998,"15min":0.73099999999999998},"min":{"1min":0.54500000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75,"15min":0.73799999999999999},"min":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.91100000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.81699999999999995,"15min":0.81299999999999994},"min":{"1min":0.623,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0760000000000001,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.79000000000000004,"15min":0.77400000000000002},"min":{"1min":0.68600000000000005,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.85899999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79800000000000004,"15min":0.78800000000000003},"min":{"1min":0.63200000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.089,"5min":1.091,"15min":1.091},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79800000000000004,"15min":0.79400000000000004},"min":{"1min":0.57599999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.97499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:49:11.032 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-17T02:45:35.708391+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=45, tm_sec=35, tm_wday=5, tm_yday=230, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=49, tm_sec=5, tm_wday=5, tm_yday=230, tm_isdst=0) 2024-08-17T02:49:11.032 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-17T02:49:14.815 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:49:14.820 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:49:31.033 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:49:31.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.192+0000 7fe6ffc00640 1 Processor -- start 2024-08-17T02:49:31.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.192+0000 7fe6ffc00640 1 -- start start 2024-08-17T02:49:31.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.193+0000 7fe6ffc00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe6f8155a20 0x7fe6f80adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.193+0000 7fe6ffc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe6f8155df0 0x7fe6f80ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.193+0000 7fe6ffc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f8156670 con 0x7fe6f806d7f0 2024-08-17T02:49:31.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.193+0000 7fe6ffc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f80b0350 con 0x7fe6f8155df0 2024-08-17T02:49:31.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.193+0000 7fe6ffc00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f806e5e0 con 0x7fe6f8155a20 2024-08-17T02:49:31.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.194+0000 7fe6efe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe6f8155df0 0x7fe6f80ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:31.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.194+0000 7fe6fdc00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe6f806d7f0 0x7fe6f80ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52384/0 (socket says 172.21.15.100:52384) 2024-08-17T02:49:31.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.194+0000 7fe6fdc00640 1 -- 172.21.15.100:0/2176147418 learned_addr learned my addr 172.21.15.100:0/2176147418 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-08-17T02:49:31.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.194+0000 7fe6fd200640 1 --2- 172.21.15.100:0/2176147418 >> v2:172.21.15.123:3300/0 conn(0x7fe6f8155a20 0x7fe6f80adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:31.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.194+0000 7fe6efe00640 1 -- 172.21.15.100:0/2176147418 >> v2:172.21.15.123:3300/0 conn(0x7fe6f8155a20 msgr2=0x7fe6f80adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:31.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.194+0000 7fe6efe00640 1 --2- 172.21.15.100:0/2176147418 >> v2:172.21.15.123:3300/0 conn(0x7fe6f8155a20 0x7fe6f80adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.194+0000 7fe6efe00640 1 -- 172.21.15.100:0/2176147418 >> v1:172.21.15.100:6789/0 conn(0x7fe6f806d7f0 legacy=0x7fe6f80ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.194+0000 7fe6efe00640 1 -- 172.21.15.100:0/2176147418 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f806e8c0 con 0x7fe6f8155df0 2024-08-17T02:49:31.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.194+0000 7fe6f7e00640 1 -- 172.21.15.100:0/2176147418 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396416828 0 0) 0x7fe6f8156670 con 0x7fe6f806d7f0 2024-08-17T02:49:31.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.195+0000 7fe6efe00640 1 --2- 172.21.15.100:0/2176147418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6f8155df0 0x7fe6f80ad9b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe6f806bc00 tx=0x7fe6e00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7395f41a25439c52 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:31.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.196+0000 7fe6f7e00640 1 -- 172.21.15.100:0/2176147418 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e002adb0 con 0x7fe6f8155df0 2024-08-17T02:49:31.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.196+0000 7fe6f7e00640 1 -- 172.21.15.100:0/2176147418 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e0032440 con 0x7fe6f8155df0 2024-08-17T02:49:31.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.196+0000 7fe6f7e00640 1 -- 172.21.15.100:0/2176147418 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e00327e0 con 0x7fe6f8155df0 2024-08-17T02:49:31.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.196+0000 7fe6ffc00640 1 -- 172.21.15.100:0/2176147418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6f8155df0 msgr2=0x7fe6f80ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.196+0000 7fe6ffc00640 1 --2- 172.21.15.100:0/2176147418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6f8155df0 0x7fe6f80ad9b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe6f806bc00 tx=0x7fe6e00090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.196+0000 7fe6ffc00640 1 -- 172.21.15.100:0/2176147418 shutdown_connections 2024-08-17T02:49:31.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.196+0000 7fe6ffc00640 1 --2- 172.21.15.100:0/2176147418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6f8155df0 0x7fe6f80ad9b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.196+0000 7fe6ffc00640 1 --2- 172.21.15.100:0/2176147418 >> v2:172.21.15.123:3300/0 conn(0x7fe6f8155a20 0x7fe6f80adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.196+0000 7fe6ffc00640 1 -- 172.21.15.100:0/2176147418 >> 172.21.15.100:0/2176147418 conn(0x7fe6f80cb9b0 msgr2=0x7fe6f80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:31.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.196+0000 7fe6ffc00640 1 -- 172.21.15.100:0/2176147418 shutdown_connections 2024-08-17T02:49:31.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.196+0000 7fe6ffc00640 1 -- 172.21.15.100:0/2176147418 wait complete. 2024-08-17T02:49:31.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.198+0000 7fe6ffc00640 1 Processor -- start 2024-08-17T02:49:31.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.198+0000 7fe6ffc00640 1 -- start start 2024-08-17T02:49:31.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.199+0000 7fe6ffc00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6f806d7f0 0x7fe6f8147550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.199+0000 7fe6ffc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6f8155a20 0x7fe6f80c14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.199+0000 7fe6ffc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f8155df0 0x7fe6f80ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.199+0000 7fe6ffc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f80ac5e0 con 0x7fe6f8155a20 2024-08-17T02:49:31.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.199+0000 7fe6ffc00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f80ad410 con 0x7fe6f8155df0 2024-08-17T02:49:31.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.199+0000 7fe6ffc00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f80ac800 con 0x7fe6f806d7f0 2024-08-17T02:49:31.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.199+0000 7fe6efe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6f8155a20 0x7fe6f80c14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:31.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.199+0000 7fe6efe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6f8155a20 0x7fe6f80c14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47540/0 (socket says 172.21.15.100:47540) 2024-08-17T02:49:31.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.199+0000 7fe6efe00640 1 -- 172.21.15.100:0/1358374450 learned_addr learned my addr 172.21.15.100:0/1358374450 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:31.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.199+0000 7fe6fdc00640 1 --2- 172.21.15.100:0/1358374450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f8155df0 0x7fe6f80ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:31.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.199+0000 7fe6efe00640 1 -- 172.21.15.100:0/1358374450 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6f806d7f0 msgr2=0x7fe6f8147550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.199+0000 7fe6fd200640 1 --2- 172.21.15.100:0/1358374450 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6f806d7f0 0x7fe6f8147550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:31.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.199+0000 7fe6efe00640 1 --2- 172.21.15.100:0/1358374450 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6f806d7f0 0x7fe6f8147550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.199+0000 7fe6efe00640 1 -- 172.21.15.100:0/1358374450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f8155df0 msgr2=0x7fe6f80ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.199+0000 7fe6efe00640 1 --2- 172.21.15.100:0/1358374450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f8155df0 0x7fe6f80ac0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.200+0000 7fe6efe00640 1 -- 172.21.15.100:0/1358374450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e0009390 con 0x7fe6f8155a20 2024-08-17T02:49:31.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.200+0000 7fe6fdc00640 1 --2- 172.21.15.100:0/1358374450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f8155df0 0x7fe6f80ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:31.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.200+0000 7fe6fd200640 1 --2- 172.21.15.100:0/1358374450 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6f806d7f0 0x7fe6f8147550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:31.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.200+0000 7fe6efe00640 1 --2- 172.21.15.100:0/1358374450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6f8155a20 0x7fe6f80c14e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0035040 tx=0x7fe6e0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:31.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.200+0000 7fe6f4c00640 1 -- 172.21.15.100:0/1358374450 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0031de0 con 0x7fe6f8155a20 2024-08-17T02:49:31.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.200+0000 7fe6f4c00640 1 -- 172.21.15.100:0/1358374450 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e003e450 con 0x7fe6f8155a20 2024-08-17T02:49:31.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.200+0000 7fe6ffc00640 1 -- 172.21.15.100:0/1358374450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f80acae0 con 0x7fe6f8155a20 2024-08-17T02:49:31.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.200+0000 7fe6f4c00640 1 -- 172.21.15.100:0/1358374450 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e003e810 con 0x7fe6f8155a20 2024-08-17T02:49:31.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.200+0000 7fe6ffc00640 1 -- 172.21.15.100:0/1358374450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f80ad0a0 con 0x7fe6f8155a20 2024-08-17T02:49:31.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.201+0000 7fe6ffc00640 1 -- 172.21.15.100:0/1358374450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f8064db0 con 0x7fe6f8155a20 2024-08-17T02:49:31.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.202+0000 7fe6f4c00640 1 -- 172.21.15.100:0/1358374450 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe6e003c400 con 0x7fe6f8155a20 2024-08-17T02:49:31.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.203+0000 7fe6f4c00640 1 --2- 172.21.15.100:0/1358374450 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe6d4065150 0x7fe6d4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.203+0000 7fe6f4c00640 1 -- 172.21.15.100:0/1358374450 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe6e00a2f20 con 0x7fe6f8155a20 2024-08-17T02:49:31.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.203+0000 7fe6fd200640 1 --2- 172.21.15.100:0/1358374450 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe6d4065150 0x7fe6d4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:31.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.204+0000 7fe6fd200640 1 --2- 172.21.15.100:0/1358374450 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe6d4065150 0x7fe6d4067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80c0c40 tx=0x7fe6e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:31.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.208+0000 7fe6f4c00640 1 -- 172.21.15.100:0/1358374450 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe6e00711e0 con 0x7fe6f8155a20 2024-08-17T02:49:31.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.377+0000 7fe6ffc00640 1 -- 172.21.15.100:0/1358374450 --> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6f80ad550 con 0x7fe6d4065150 2024-08-17T02:49:31.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.379+0000 7fe6f4c00640 1 -- 172.21.15.100:0/1358374450 <== mgr.4103 v2:172.21.15.100:6832/36756 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50793 (secure 0 0 0) 0x7fe6f80ad550 con 0x7fe6d4065150 2024-08-17T02:49:31.380 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:49:31.381 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-08-17T02:49:31.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.381+0000 7fe6ffc00640 1 -- 172.21.15.100:0/1358374450 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe6d4065150 msgr2=0x7fe6d4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.381+0000 7fe6ffc00640 1 --2- 172.21.15.100:0/1358374450 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe6d4065150 0x7fe6d4067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80c0c40 tx=0x7fe6e8008040 comp rx=0 tx=0).stop 2024-08-17T02:49:31.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.381+0000 7fe6ffc00640 1 -- 172.21.15.100:0/1358374450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6f8155a20 msgr2=0x7fe6f80c14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.381+0000 7fe6ffc00640 1 --2- 172.21.15.100:0/1358374450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6f8155a20 0x7fe6f80c14e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0035040 tx=0x7fe6e0032000 comp rx=0 tx=0).stop 2024-08-17T02:49:31.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.381+0000 7fe6ffc00640 1 -- 172.21.15.100:0/1358374450 shutdown_connections 2024-08-17T02:49:31.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.381+0000 7fe6ffc00640 1 --2- 172.21.15.100:0/1358374450 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fe6d4065150 0x7fe6d4067600 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.381+0000 7fe6ffc00640 1 --2- 172.21.15.100:0/1358374450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6f8155df0 0x7fe6f80ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.381+0000 7fe6ffc00640 1 --2- 172.21.15.100:0/1358374450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6f8155a20 0x7fe6f80c14e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.381+0000 7fe6ffc00640 1 --2- 172.21.15.100:0/1358374450 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6f806d7f0 0x7fe6f8147550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.381+0000 7fe6ffc00640 1 -- 172.21.15.100:0/1358374450 >> 172.21.15.100:0/1358374450 conn(0x7fe6f80cb9b0 msgr2=0x7fe6f806a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:31.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.382+0000 7fe6ffc00640 1 -- 172.21.15.100:0/1358374450 shutdown_connections 2024-08-17T02:49:31.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.382+0000 7fe6ffc00640 1 -- 172.21.15.100:0/1358374450 wait complete. 2024-08-17T02:49:31.398 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-08-17T02:49:31.144133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388232,"kb_used_data":5224,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586488,"statfs":{"total":773094113280,"available":770648563712,"internally_reserved":0,"allocated":5349376,"data_stored":2906160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002478"},"pg_stats":[{"pgid":"1.0","version":"44'119","reported_seq":195,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-08-17T02:49:12.250569+0000","last_change":"2024-08-17T02:49:12.250528+0000","last_active":"2024-08-17T02:49:12.250569+0000","last_peered":"2024-08-17T02:49:12.250569+0000","last_clean":"2024-08-17T02:49:12.250569+0000","last_became_active":"2024-08-17T02:45:37.010559+0000","last_became_peered":"2024-08-17T02:45:37.010559+0000","last_unstale":"2024-08-17T02:49:12.250569+0000","last_undegraded":"2024-08-17T02:49:12.250569+0000","last_fullsized":"2024-08-17T02:49:12.250569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'119","last_scrub_stamp":"2024-08-17T02:49:12.250437+0000","last_deep_scrub":"44'119","last_deep_scrub_stamp":"2024-08-17T02:49:12.250437+0000","last_clean_scrub_stamp":"2024-08-17T02:49:12.250437+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:41:11.681787+0000","scrub_duration":0.006431778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542193,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1114112,"data_stored":806046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.65400000000000003,"15min":0.628},"min":{"1min":0.55500000000000005,"5min":0.372,"15min":0.372},"max":{"1min":0.91400000000000003,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.68700000000000006,"15min":0.66900000000000004},"min":{"1min":0.497,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90500000000000003,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.92100000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.70099999999999996,"15min":0.68200000000000005},"min":{"1min":0.624,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95399999999999996,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.68799999999999994,"15min":0.65900000000000003},"min":{"1min":0.58399999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.89400000000000002,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.89200000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69399999999999995,"15min":0.67200000000000004},"min":{"1min":0.60699999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88100000000000001,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73399999999999999,"15min":0.71999999999999997},"min":{"1min":0.65100000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92600000000000005,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.97499999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.70799999999999996,"15min":0.68799999999999994},"min":{"1min":0.63,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92900000000000005,"5min":1.034,"15min":1.034},"last":0.878},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.747,"15min":0.745},"min":{"1min":0.60199999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.95799999999999996,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.90300000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66500000000000004,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.746,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64000000000000001,"15min":0.64900000000000002},"min":{"1min":0.47999999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.871,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.81699999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66800000000000004,"15min":0.68999999999999995},"min":{"1min":0.49399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98199999999999998,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.69199999999999995,"15min":0.70999999999999996},"min":{"1min":0.47899999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88,"5min":1.071,"15min":1.071},"last":0.71799999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:48:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.876,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.70899999999999996,"15min":0.72799999999999998},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.78700000000000003,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.77800000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":520192,"data_stored":215678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":1.0569999999999999,"15min":1.198},"min":{"1min":0.52400000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0389999999999999,"5min":12.430999999999999,"15min":12.430999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.97799999999999998,"15min":1.0940000000000001},"min":{"1min":0.57299999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95799999999999996,"5min":10.391,"15min":10.391},"last":0.90800000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":1.044,"15min":1.1839999999999999},"min":{"1min":0.59099999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96499999999999997,"5min":11.654,"15min":11.654},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":1.044,"15min":1.1779999999999999},"min":{"1min":0.59499999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97599999999999998,"5min":11.484,"15min":11.484},"last":0.81000000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71599999999999997,"15min":0.70799999999999996},"min":{"1min":0.5,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90700000000000003,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":1.0620000000000001,"15min":1.2090000000000001},"min":{"1min":0.55500000000000005,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.94299999999999995,"5min":12.025,"15min":12.025},"last":0.74299999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":1.079,"15min":1.23},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98099999999999998,"5min":12.073,"15min":12.073},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":1.083,"15min":1.2230000000000001},"min":{"1min":0.60099999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.0129999999999999,"5min":12.374000000000001,"15min":12.374000000000001},"last":0.76200000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.96899999999999997,"15min":1.131},"min":{"1min":0.42599999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.88100000000000001,"5min":11.545999999999999,"15min":11.545999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.64200000000000002,"15min":0.66900000000000004},"min":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79900000000000004,"5min":2.202,"15min":2.202},"last":0.72099999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":1.02,"15min":1.212},"min":{"1min":0.45500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.80100000000000005,"5min":12.111000000000001,"15min":12.111000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":1.042,"15min":1.2170000000000001},"min":{"1min":0.443,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0649999999999999,"5min":12.477,"15min":12.477},"last":0.85399999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:48:38 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.97099999999999997,"15min":1.115},"min":{"1min":0.502,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94099999999999995,"5min":10.526999999999999,"15min":10.526999999999999},"last":0.87},{"interface":"front","average":{"1min":0.72499999999999998,"5min":1.1399999999999999,"15min":1.3340000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.86099999999999999,"5min":13.638,"15min":13.638},"last":0.95699999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":520192,"data_stored":215678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63100000000000001,"15min":0.60899999999999999},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.79500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65100000000000002,"15min":0.63800000000000001},"min":{"1min":0.54300000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.746}]},{"osd":1,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63500000000000001,"15min":0.621},"min":{"1min":0.51100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.86699999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66000000000000003,"15min":0.63800000000000001},"min":{"1min":0.58999999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84699999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.76700000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.624},"min":{"1min":0.46600000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86599999999999999,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.51000000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.88600000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.69599999999999995,"15min":0.68999999999999995},"min":{"1min":0.56999999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.85899999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.87},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69099999999999995,"15min":0.68100000000000005},"min":{"1min":0.59499999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.89400000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.70299999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.40799999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78700000000000003,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60099999999999998,"15min":0.60399999999999998},"min":{"1min":0.45400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.42399999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.65300000000000002,"15min":0.66500000000000004},"min":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80700000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.504},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.83399999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.61299999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:48:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69499999999999995,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90300000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.82699999999999996,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.54800000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297868,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":520192,"data_stored":215678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67100000000000004,"15min":0.63900000000000001},"min":{"1min":0.50600000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88900000000000001,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63600000000000001,"15min":0.61499999999999999},"min":{"1min":0.52700000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.80000000000000004,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.65800000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63900000000000001,"15min":0.61799999999999999},"min":{"1min":0.51500000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.79300000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65900000000000003,"15min":0.63500000000000001},"min":{"1min":0.51700000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84999999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.747}]},{"osd":2,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68799999999999994,"15min":0.66600000000000004},"min":{"1min":0.55300000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86899999999999999,"5min":1.286,"15min":1.286},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71799999999999997,"15min":0.69799999999999995},"min":{"1min":0.56899999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.85599999999999998,"5min":1.609,"15min":1.609},"last":0.77800000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.69899999999999995,"15min":0.67900000000000005},"min":{"1min":0.59699999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85099999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67500000000000004,"15min":0.64900000000000002},"min":{"1min":0.57699999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84499999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.63600000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.66300000000000003,"15min":0.68500000000000005},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.752,"5min":1.077,"15min":1.077},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92100000000000004,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.58899999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63700000000000001,"15min":0.65700000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90400000000000003,"5min":1.198,"15min":1.198},"last":0.439},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.88700000000000001,"5min":1.145,"15min":1.145},"last":0.70199999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.48499999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88500000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.83799999999999997,"5min":1.101,"15min":1.101},"last":0.496}]}]},{"osd":3,"up_from":14,"seq":60129542194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":520192,"data_stored":215678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.29699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67000000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.441},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.47299999999999998,"15min":0.45900000000000002},"min":{"1min":0.311,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74099999999999999,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.65700000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65500000000000003,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.41799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76700000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.54100000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64100000000000001,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55700000000000005,"15min":0.55100000000000005},"min":{"1min":0.46300000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.49299999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.74099999999999999,"15min":0.71799999999999997},"min":{"1min":0.65100000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.75600000000000001,"15min":0.752},"min":{"1min":0.58399999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.042,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.74399999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.75700000000000001,"15min":0.747},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2,"5min":1.212,"15min":1.212},"last":0.755},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77500000000000002,"15min":0.77100000000000002},"min":{"1min":0.628,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.90900000000000003,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.84399999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78400000000000003,"15min":0.77800000000000002},"min":{"1min":0.61899999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0249999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80800000000000005,"15min":0.79000000000000004},"min":{"1min":0.64500000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.88100000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.78200000000000003,"15min":0.75800000000000001},"min":{"1min":0.628,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.63300000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.86099999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":520192,"data_stored":215678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.44800000000000001,"15min":0.44},"min":{"1min":0.35699999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67200000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.44900000000000001,"15min":0.44600000000000001},"min":{"1min":0.35099999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.57099999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.50800000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.495,"15min":0.497},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.63900000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.42099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.60999999999999999,"5min":1.139,"15min":1.139},"last":0.67900000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.48399999999999999,"15min":0.46200000000000002},"min":{"1min":0.42499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.58899999999999997,"15min":0.57799999999999996},"min":{"1min":0.49099999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72499999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.55900000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.77600000000000002,"15min":0.77400000000000002},"min":{"1min":0.67200000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.997,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.75900000000000001,"15min":0.747},"min":{"1min":0.621,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.71499999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.78000000000000003,"15min":0.77800000000000002},"min":{"1min":0.64200000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.002,"5min":1.135,"15min":1.135},"last":0.61899999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.80300000000000005,"15min":0.80500000000000005},"min":{"1min":0.61599999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0569999999999999,"5min":1.103,"15min":1.103},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.80700000000000005,"15min":0.79900000000000004},"min":{"1min":0.70599999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.63}]},{"osd":7,"last update":"Sat Aug 17 02:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.82099999999999995,"15min":0.81699999999999995},"min":{"1min":0.68600000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.61799999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0209999999999999,"5min":1.038,"15min":1.038},"last":0.67100000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297868,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073972,"statfs":{"total":96636764160,"available":96331747328,"internally_reserved":0,"allocated":520192,"data_stored":215678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41399999999999998,"15min":0.40999999999999998},"min":{"1min":0.312,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66000000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.44700000000000001,"15min":0.42999999999999999},"min":{"1min":0.37,"5min":0.246,"15min":0.246},"max":{"1min":0.63300000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.41699999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.39700000000000002,"15min":0.373},"min":{"1min":0.35399999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.40799999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.69799999999999995,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.48499999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59399999999999997,"15min":0.57299999999999995},"min":{"1min":0.53100000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78900000000000003,"5min":1.054,"15min":1.054},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.75700000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.61399999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.63,"15min":0.59799999999999998},"min":{"1min":0.50600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66500000000000004,"15min":0.64300000000000002},"min":{"1min":0.59599999999999997,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.091,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.59399999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.65800000000000003,"15min":0.63400000000000001},"min":{"1min":0.56100000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93799999999999994,"5min":1.002,"15min":1.002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.66300000000000003,"15min":0.64300000000000002},"min":{"1min":0.55600000000000005,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.998,"5min":1.042,"15min":1.042},"last":0.57199999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.73199999999999998,"15min":0.71799999999999997},"min":{"1min":0.65400000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.995,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.73099999999999998,"15min":0.70399999999999996},"min":{"1min":0.627,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.054,"5min":1.256,"15min":1.256},"last":0.66000000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:48:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.57999999999999996,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.749,"15min":0.73099999999999998},"min":{"1min":0.73599999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0229999999999999,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.67900000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542194,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1114112,"data_stored":806046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.434,"15min":0.442},"min":{"1min":0.32200000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66300000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.50600000000000001},"min":{"1min":0.42499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75700000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.61699999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51600000000000001,"15min":0.53100000000000003},"min":{"1min":0.40300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.65400000000000003,"5min":0.878,"15min":0.878},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.498,"5min":0.53500000000000003,"15min":0.54700000000000004},"min":{"1min":0.375,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.63200000000000001,"5min":1.111,"15min":1.111},"last":0.46100000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.498,"15min":0.48399999999999999},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77600000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.51600000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.91000000000000003,"5min":1.115,"15min":1.115},"last":0.70199999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72699999999999998,"15min":0.71399999999999997},"min":{"1min":0.503,"5min":0.496,"15min":0.496},"max":{"1min":0.90900000000000003,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.78000000000000003,"15min":0.79000000000000004},"min":{"1min":0.62,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96699999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.66300000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73299999999999998,"15min":0.73099999999999998},"min":{"1min":0.54500000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75,"15min":0.73799999999999999},"min":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.63100000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.81699999999999995,"15min":0.81299999999999994},"min":{"1min":0.623,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0760000000000001,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.79000000000000004,"15min":0.77400000000000002},"min":{"1min":0.68600000000000005,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.71899999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:48:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79800000000000004,"15min":0.78800000000000003},"min":{"1min":0.63200000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.089,"5min":1.091,"15min":1.091},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79800000000000004,"15min":0.79400000000000004},"min":{"1min":0.57599999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:49:31.402 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-17T02:49:31.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.546+0000 7f459be00640 1 Processor -- start 2024-08-17T02:49:31.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.547+0000 7f459be00640 1 -- start start 2024-08-17T02:49:31.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.548+0000 7f459be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f459c155660 0x7f459c0c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.548+0000 7f459be00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459c0afc40 con 0x7f459c155a30 2024-08-17T02:49:31.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.548+0000 7f459be00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459c0af030 con 0x7f459c0adfb0 2024-08-17T02:49:31.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.548+0000 7f459be00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459c0af310 con 0x7f459c155660 2024-08-17T02:49:31.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.548+0000 7f459aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f459c155660 0x7f459c0c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:31.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.548+0000 7f459aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f459c155660 0x7f459c0c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47552/0 (socket says 172.21.15.100:47552) 2024-08-17T02:49:31.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.548+0000 7f459aa00640 1 -- 172.21.15.100:0/2540207255 learned_addr learned my addr 172.21.15.100:0/2540207255 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:31.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.549+0000 7f459aa00640 1 -- 172.21.15.100:0/2540207255 >> v1:172.21.15.123:6789/0 conn(0x7f459c0adfb0 legacy=0x7f459c0ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.549+0000 7f459aa00640 1 -- 172.21.15.100:0/2540207255 >> v1:172.21.15.100:6789/0 conn(0x7f459c155a30 legacy=0x7f459c06dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.549+0000 7f459aa00640 1 -- 172.21.15.100:0/2540207255 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c0af5f0 con 0x7f459c155660 2024-08-17T02:49:31.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.549+0000 7f459a000640 1 -- 172.21.15.100:0/2540207255 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916253974 0 0) 0x7f459c0afc40 con 0x7f459c155a30 2024-08-17T02:49:31.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.550+0000 7f459aa00640 1 --2- 172.21.15.100:0/2540207255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f459c155660 0x7f459c0c7fe0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f458c009910 tx=0x7f458c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03955ae876e7604 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:31.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.550+0000 7f459a000640 1 -- 172.21.15.100:0/2540207255 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c032440 con 0x7f459c155660 2024-08-17T02:49:31.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.550+0000 7f459a000640 1 -- 172.21.15.100:0/2540207255 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458c0325a0 con 0x7f459c155660 2024-08-17T02:49:31.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.550+0000 7f459a000640 1 -- 172.21.15.100:0/2540207255 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c032940 con 0x7f459c155660 2024-08-17T02:49:31.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.550+0000 7f459be00640 1 -- 172.21.15.100:0/2540207255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f459c155660 msgr2=0x7f459c0c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.550+0000 7f459be00640 1 --2- 172.21.15.100:0/2540207255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f459c155660 0x7f459c0c7fe0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f458c009910 tx=0x7f458c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.551+0000 7f459be00640 1 -- 172.21.15.100:0/2540207255 shutdown_connections 2024-08-17T02:49:31.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.551+0000 7f459be00640 1 --2- 172.21.15.100:0/2540207255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f459c155660 0x7f459c0c7fe0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.551+0000 7f459be00640 1 -- 172.21.15.100:0/2540207255 >> 172.21.15.100:0/2540207255 conn(0x7f459c066cd0 msgr2=0x7f459c0670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:31.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.551+0000 7f459be00640 1 -- 172.21.15.100:0/2540207255 shutdown_connections 2024-08-17T02:49:31.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.551+0000 7f459be00640 1 -- 172.21.15.100:0/2540207255 wait complete. 2024-08-17T02:49:31.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.552+0000 7f459be00640 1 Processor -- start 2024-08-17T02:49:31.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.552+0000 7f459be00640 1 -- start start 2024-08-17T02:49:31.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.553+0000 7f459be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f459c0adfb0 0x7f459c156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.553+0000 7f459be00640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f459c155660 0x7f459c152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.553+0000 7f459be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f459c155a30 0x7f459c15c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.553+0000 7f459be00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c152940 con 0x7f459c0adfb0 2024-08-17T02:49:31.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.553+0000 7f459be00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c156730 con 0x7f459c155a30 2024-08-17T02:49:31.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.553+0000 7f459be00640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459c156a10 con 0x7f459c155660 2024-08-17T02:49:31.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.553+0000 7f459aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f459c0adfb0 0x7f459c156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:31.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.553+0000 7f459aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f459c0adfb0 0x7f459c156050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47558/0 (socket says 172.21.15.100:47558) 2024-08-17T02:49:31.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.553+0000 7f459aa00640 1 -- 172.21.15.100:0/2291791710 learned_addr learned my addr 172.21.15.100:0/2291791710 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:31.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.554+0000 7f459aa00640 1 -- 172.21.15.100:0/2291791710 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f459c155660 msgr2=0x7f459c152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.554+0000 7f459aa00640 1 --2- 172.21.15.100:0/2291791710 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f459c155660 0x7f459c152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.554+0000 7f459aa00640 1 -- 172.21.15.100:0/2291791710 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f459c155a30 msgr2=0x7f459c15c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.554+0000 7f459aa00640 1 --2- 172.21.15.100:0/2291791710 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f459c155a30 0x7f459c15c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.554+0000 7f459aa00640 1 -- 172.21.15.100:0/2291791710 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458c009450 con 0x7f459c0adfb0 2024-08-17T02:49:31.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.554+0000 7f459aa00640 1 --2- 172.21.15.100:0/2291791710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f459c0adfb0 0x7f459c156050 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f458c009420 tx=0x7f458c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:31.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.554+0000 7f4592a00640 1 -- 172.21.15.100:0/2291791710 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c032920 con 0x7f459c0adfb0 2024-08-17T02:49:31.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.554+0000 7f4592a00640 1 -- 172.21.15.100:0/2291791710 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458c045410 con 0x7f459c0adfb0 2024-08-17T02:49:31.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.554+0000 7f4592a00640 1 -- 172.21.15.100:0/2291791710 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c0457b0 con 0x7f459c0adfb0 2024-08-17T02:49:31.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.554+0000 7f459be00640 1 -- 172.21.15.100:0/2291791710 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459c156cf0 con 0x7f459c0adfb0 2024-08-17T02:49:31.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.554+0000 7f459be00640 1 -- 172.21.15.100:0/2291791710 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459c1572b0 con 0x7f459c0adfb0 2024-08-17T02:49:31.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.555+0000 7f459be00640 1 -- 172.21.15.100:0/2291791710 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459c068770 con 0x7f459c0adfb0 2024-08-17T02:49:31.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.556+0000 7f4592a00640 1 -- 172.21.15.100:0/2291791710 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f458c039070 con 0x7f459c0adfb0 2024-08-17T02:49:31.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.557+0000 7f4592a00640 1 --2- 172.21.15.100:0/2291791710 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4578065180 0x7f4578067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.557+0000 7f4592a00640 1 -- 172.21.15.100:0/2291791710 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f458c0a2f40 con 0x7f459c0adfb0 2024-08-17T02:49:31.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.557+0000 7f4592000640 1 --2- 172.21.15.100:0/2291791710 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4578065180 0x7f4578067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:31.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.558+0000 7f4592000640 1 --2- 172.21.15.100:0/2291791710 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4578065180 0x7f4578067630 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f459c14aef0 tx=0x7f4584007ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:31.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.561+0000 7f4592a00640 1 -- 172.21.15.100:0/2291791710 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f459c068770 con 0x7f459c0adfb0 2024-08-17T02:49:31.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.733+0000 7f459be00640 1 -- 172.21.15.100:0/2291791710 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f459c068770 con 0x7f459c0adfb0 2024-08-17T02:49:31.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.737+0000 7f4592a00640 1 -- 172.21.15.100:0/2291791710 <== mon.0 v2:172.21.15.100:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f458c0712c0 con 0x7f459c0adfb0 2024-08-17T02:49:31.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.738+0000 7f4592a00640 1 -- 172.21.15.100:0/2291791710 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f459c068770 con 0x7f459c0adfb0 2024-08-17T02:49:31.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.741+0000 7f459be00640 1 -- 172.21.15.100:0/2291791710 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4578065180 msgr2=0x7f4578067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.741+0000 7f459be00640 1 --2- 172.21.15.100:0/2291791710 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4578065180 0x7f4578067630 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f459c14aef0 tx=0x7f4584007ab0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.741+0000 7f459be00640 1 -- 172.21.15.100:0/2291791710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f459c0adfb0 msgr2=0x7f459c156050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.741+0000 7f459be00640 1 --2- 172.21.15.100:0/2291791710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f459c0adfb0 0x7f459c156050 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f458c009420 tx=0x7f458c032000 comp rx=0 tx=0).stop 2024-08-17T02:49:31.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.741+0000 7f459be00640 1 -- 172.21.15.100:0/2291791710 shutdown_connections 2024-08-17T02:49:31.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.741+0000 7f459be00640 1 --2- 172.21.15.100:0/2291791710 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7f4578065180 0x7f4578067630 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.741+0000 7f459be00640 1 --2- 172.21.15.100:0/2291791710 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f459c155a30 0x7f459c15c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.741+0000 7f459be00640 1 --2- 172.21.15.100:0/2291791710 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f459c155660 0x7f459c152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.741+0000 7f459be00640 1 --2- 172.21.15.100:0/2291791710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f459c0adfb0 0x7f459c156050 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.741+0000 7f459be00640 1 -- 172.21.15.100:0/2291791710 >> 172.21.15.100:0/2291791710 conn(0x7f459c066cd0 msgr2=0x7f459c14b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:31.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.741+0000 7f459be00640 1 -- 172.21.15.100:0/2291791710 shutdown_connections 2024-08-17T02:49:31.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.741+0000 7f459be00640 1 -- 172.21.15.100:0/2291791710 wait complete. 2024-08-17T02:49:31.758 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:49:31.758 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:49:31.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.905+0000 7fb229600640 1 Processor -- start 2024-08-17T02:49:31.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.906+0000 7fb229600640 1 -- start start 2024-08-17T02:49:31.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.907+0000 7fb229600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb224155900 0x7fb224155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.907+0000 7fb229600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb2240b0270 0x7fb224156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.907+0000 7fb229600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb224157690 con 0x7fb224157b20 2024-08-17T02:49:31.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.907+0000 7fb229600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb224156a80 con 0x7fb224155900 2024-08-17T02:49:31.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.907+0000 7fb229600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb224156d60 con 0x7fb2240b0270 2024-08-17T02:49:31.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.907+0000 7fb223e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb224155900 0x7fb224155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.907+0000 7fb223e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb224155900 0x7fb224155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47568/0 (socket says 172.21.15.100:47568) 2024-08-17T02:49:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.907+0000 7fb223e00640 1 -- 172.21.15.100:0/294064740 learned_addr learned my addr 172.21.15.100:0/294064740 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.907+0000 7fb21b400640 1 --2- 172.21.15.100:0/294064740 >> v2:172.21.15.123:3300/0 conn(0x7fb2240b0270 0x7fb224156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.907+0000 7fb223e00640 1 -- 172.21.15.100:0/294064740 >> v2:172.21.15.123:3300/0 conn(0x7fb2240b0270 msgr2=0x7fb224156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.907+0000 7fb223e00640 1 --2- 172.21.15.100:0/294064740 >> v2:172.21.15.123:3300/0 conn(0x7fb2240b0270 0x7fb224156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.907+0000 7fb223e00640 1 -- 172.21.15.100:0/294064740 >> v1:172.21.15.123:6789/0 conn(0x7fb224157b20 legacy=0x7fb224157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.907+0000 7fb223e00640 1 -- 172.21.15.100:0/294064740 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb224157040 con 0x7fb224155900 2024-08-17T02:49:31.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.908+0000 7fb223e00640 1 --2- 172.21.15.100:0/294064740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb224155900 0x7fb224155cd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb22406f430 tx=0x7fb2140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c0a2bb46f7734a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:31.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.909+0000 7fb223400640 1 -- 172.21.15.100:0/294064740 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21402adf0 con 0x7fb224155900 2024-08-17T02:49:31.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.909+0000 7fb223400640 1 -- 172.21.15.100:0/294064740 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb214032440 con 0x7fb224155900 2024-08-17T02:49:31.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.909+0000 7fb223400640 1 -- 172.21.15.100:0/294064740 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214032840 con 0x7fb224155900 2024-08-17T02:49:31.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.909+0000 7fb229600640 1 -- 172.21.15.100:0/294064740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb224155900 msgr2=0x7fb224155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.909+0000 7fb229600640 1 --2- 172.21.15.100:0/294064740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb224155900 0x7fb224155cd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb22406f430 tx=0x7fb2140091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.909+0000 7fb229600640 1 -- 172.21.15.100:0/294064740 shutdown_connections 2024-08-17T02:49:31.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.909+0000 7fb229600640 1 --2- 172.21.15.100:0/294064740 >> v2:172.21.15.123:3300/0 conn(0x7fb2240b0270 0x7fb224156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.909+0000 7fb229600640 1 --2- 172.21.15.100:0/294064740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb224155900 0x7fb224155cd0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.909+0000 7fb229600640 1 -- 172.21.15.100:0/294064740 >> 172.21.15.100:0/294064740 conn(0x7fb224067750 msgr2=0x7fb2240cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:31.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.909+0000 7fb229600640 1 -- 172.21.15.100:0/294064740 shutdown_connections 2024-08-17T02:49:31.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.909+0000 7fb229600640 1 -- 172.21.15.100:0/294064740 wait complete. 2024-08-17T02:49:31.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.911+0000 7fb229600640 1 Processor -- start 2024-08-17T02:49:31.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.911+0000 7fb229600640 1 -- start start 2024-08-17T02:49:31.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.912+0000 7fb229600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2240b0270 0x7fb2240a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.912+0000 7fb229600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb224155900 0x7fb224149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.912+0000 7fb229600640 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb224157b20 0x7fb2241510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.912+0000 7fb229600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240ac9c0 con 0x7fb224155900 2024-08-17T02:49:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.912+0000 7fb229600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb224154670 con 0x7fb2240b0270 2024-08-17T02:49:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.912+0000 7fb229600640 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb224154390 con 0x7fb224157b20 2024-08-17T02:49:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.912+0000 7fb21b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb224155900 0x7fb224149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.912+0000 7fb21b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb224155900 0x7fb224149e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47572/0 (socket says 172.21.15.100:47572) 2024-08-17T02:49:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.912+0000 7fb21b400640 1 -- 172.21.15.100:0/2271705814 learned_addr learned my addr 172.21.15.100:0/2271705814 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-08-17T02:49:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.912+0000 7fb223e00640 1 --2- 172.21.15.100:0/2271705814 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2240b0270 0x7fb2240a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:31.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.912+0000 7fb228c00640 1 --2- 172.21.15.100:0/2271705814 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb224157b20 0x7fb2241510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:31.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.912+0000 7fb21b400640 1 -- 172.21.15.100:0/2271705814 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb224157b20 msgr2=0x7fb2241510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.912+0000 7fb21b400640 1 --2- 172.21.15.100:0/2271705814 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb224157b20 0x7fb2241510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.912+0000 7fb21b400640 1 -- 172.21.15.100:0/2271705814 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2240b0270 msgr2=0x7fb2240a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.912+0000 7fb21b400640 1 --2- 172.21.15.100:0/2271705814 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2240b0270 0x7fb2240a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.912+0000 7fb21b400640 1 -- 172.21.15.100:0/2271705814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb214009450 con 0x7fb224155900 2024-08-17T02:49:31.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.912+0000 7fb228c00640 1 --2- 172.21.15.100:0/2271705814 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb224157b20 0x7fb2241510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:31.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.913+0000 7fb21b400640 1 --2- 172.21.15.100:0/2271705814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb224155900 0x7fb224149e30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00e930 tx=0x7fb20c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:31.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.913+0000 7fb21be00640 1 -- 172.21.15.100:0/2271705814 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c00c8e0 con 0x7fb224155900 2024-08-17T02:49:31.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.913+0000 7fb21be00640 1 -- 172.21.15.100:0/2271705814 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb20c00ca40 con 0x7fb224155900 2024-08-17T02:49:31.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.913+0000 7fb229600640 1 -- 172.21.15.100:0/2271705814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2240ac370 con 0x7fb224155900 2024-08-17T02:49:31.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.913+0000 7fb21be00640 1 -- 172.21.15.100:0/2271705814 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c00ce00 con 0x7fb224155900 2024-08-17T02:49:31.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.913+0000 7fb229600640 1 -- 172.21.15.100:0/2271705814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2240a5a10 con 0x7fb224155900 2024-08-17T02:49:31.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.914+0000 7fb229600640 1 -- 172.21.15.100:0/2271705814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb224071050 con 0x7fb224155900 2024-08-17T02:49:31.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.915+0000 7fb21be00640 1 -- 172.21.15.100:0/2271705814 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb20c013680 con 0x7fb224155900 2024-08-17T02:49:31.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.915+0000 7fb21be00640 1 --2- 172.21.15.100:0/2271705814 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb200065150 0x7fb200067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.916+0000 7fb21be00640 1 -- 172.21.15.100:0/2271705814 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb20c0823f0 con 0x7fb224155900 2024-08-17T02:49:31.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.916+0000 7fb223e00640 1 --2- 172.21.15.100:0/2271705814 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb200065150 0x7fb200067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:31.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.916+0000 7fb223e00640 1 --2- 172.21.15.100:0/2271705814 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb200065150 0x7fb200067600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb214034000 tx=0x7fb2140091d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:31.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:31.919+0000 7fb21be00640 1 -- 172.21.15.100:0/2271705814 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb20c050730 con 0x7fb224155900 2024-08-17T02:49:32.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:32.125+0000 7fb229600640 1 -- 172.21.15.100:0/2271705814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2240acb00 con 0x7fb224155900 2024-08-17T02:49:32.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:32.126+0000 7fb21be00640 1 -- 172.21.15.100:0/2271705814 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3541 (secure 0 0 0) 0x7fb20c017df0 con 0x7fb224155900 2024-08-17T02:49:32.126 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-08-17T02:49:32.127 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1972998642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1972998642},{"type":"v1","addr":"172.21.15.100:6836","nonce":1972998642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3961484077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3961484077},{"type":"v1","addr":"172.21.15.100:6837","nonce":3961484077}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/3085516409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3085516409},{"type":"v1","addr":"172.21.15.123:6834","nonce":3085516409}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5173,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1672641445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":1672641445},{"type":"v1","addr":"172.21.15.123:6835","nonce":1672641445}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[]} 2024-08-17T02:49:32.127 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-08-17T02:49:32.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:32.128+0000 7fb229600640 1 -- 172.21.15.100:0/2271705814 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb200065150 msgr2=0x7fb200067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:32.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:32.128+0000 7fb229600640 1 --2- 172.21.15.100:0/2271705814 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb200065150 0x7fb200067600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb214034000 tx=0x7fb2140091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:32.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:32.128+0000 7fb229600640 1 -- 172.21.15.100:0/2271705814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb224155900 msgr2=0x7fb224149e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:32.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:32.128+0000 7fb229600640 1 --2- 172.21.15.100:0/2271705814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb224155900 0x7fb224149e30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00e930 tx=0x7fb20c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:32.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:32.128+0000 7fb229600640 1 -- 172.21.15.100:0/2271705814 shutdown_connections 2024-08-17T02:49:32.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:32.128+0000 7fb229600640 1 --2- 172.21.15.100:0/2271705814 >> [v2:172.21.15.100:6832/36756,v1:172.21.15.100:6833/36756] conn(0x7fb200065150 0x7fb200067600 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:32.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:32.128+0000 7fb229600640 1 --2- 172.21.15.100:0/2271705814 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb224157b20 0x7fb2241510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:32.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:32.128+0000 7fb229600640 1 --2- 172.21.15.100:0/2271705814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb224155900 0x7fb224149e30 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:32.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:32.128+0000 7fb229600640 1 --2- 172.21.15.100:0/2271705814 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb2240b0270 0x7fb2240a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:32.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:32.128+0000 7fb229600640 1 -- 172.21.15.100:0/2271705814 >> 172.21.15.100:0/2271705814 conn(0x7fb224067750 msgr2=0x7fb22406c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:32.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:32.128+0000 7fb229600640 1 -- 172.21.15.100:0/2271705814 shutdown_connections 2024-08-17T02:49:32.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-08-17T02:49:32.128+0000 7fb229600640 1 -- 172.21.15.100:0/2271705814 wait complete. 2024-08-17T02:49:32.144 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-17T02:49:32.144 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-17T02:49:32.145 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:49:32.145 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:49:32.157 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:49:32.158 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:49:32.158 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:49:32.213 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:49:32.213 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:49:32.213 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:49:32.229 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:49:32.229 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:49:32.229 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:49:32.285 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:49:32.285 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-17T02:49:32.286 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-17T02:49:32.286 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:49:32.330 INFO:tasks.ceph.osd.0:Stopped 2024-08-17T02:49:32.330 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-17T02:49:32.330 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:49:32.386 INFO:tasks.ceph.osd.1:Stopped 2024-08-17T02:49:32.387 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-17T02:49:32.387 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:49:32.433 INFO:tasks.ceph.osd.2:Stopped 2024-08-17T02:49:32.433 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-17T02:49:32.433 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:49:32.480 INFO:tasks.ceph.osd.3:Stopped 2024-08-17T02:49:32.481 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-17T02:49:32.481 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:49:32.527 INFO:tasks.ceph.osd.4:Stopped 2024-08-17T02:49:32.527 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-17T02:49:32.527 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:49:32.581 INFO:tasks.ceph.osd.5:Stopped 2024-08-17T02:49:32.582 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-17T02:49:32.582 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:49:32.630 INFO:tasks.ceph.osd.6:Stopped 2024-08-17T02:49:32.631 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-17T02:49:32.631 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:49:32.678 INFO:tasks.ceph.osd.7:Stopped 2024-08-17T02:49:32.678 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-17T02:49:32.678 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-17T02:49:32.679 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:49:32.738 INFO:tasks.ceph.mgr.y:Stopped 2024-08-17T02:49:32.738 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-17T02:49:32.739 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:49:32.796 INFO:tasks.ceph.mgr.x:Stopped 2024-08-17T02:49:32.796 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-17T02:49:32.796 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-17T02:49:32.797 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:49:32.819 INFO:tasks.ceph.mon.a:Stopped 2024-08-17T02:49:32.819 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-17T02:49:32.819 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:49:32.837 INFO:tasks.ceph.mon.b:Stopped 2024-08-17T02:49:32.838 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-17T02:49:32.838 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:49:32.897 INFO:tasks.ceph.mon.c:Stopped 2024-08-17T02:49:32.897 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-17T02:49:32.897 DEBUG:teuthology.orchestra.run.smithi100:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-17T02:49:32.979 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi100.front.sepia.ceph.com 2024-08-17T02:49:32.980 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-17T02:49:33.241 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi100.front.sepia.ceph.com 2024-08-17T02:49:33.242 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-17T02:49:33.355 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi100.front.sepia.ceph.com 2024-08-17T02:49:33.355 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-17T02:49:33.472 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi100.front.sepia.ceph.com 2024-08-17T02:49:33.473 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-17T02:49:33.589 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi123.front.sepia.ceph.com 2024-08-17T02:49:33.590 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-17T02:49:33.788 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi123.front.sepia.ceph.com 2024-08-17T02:49:33.788 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-17T02:49:33.893 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi123.front.sepia.ceph.com 2024-08-17T02:49:33.893 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-17T02:49:33.993 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi123.front.sepia.ceph.com 2024-08-17T02:49:33.994 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-17T02:49:34.102 INFO:tasks.ceph:Archiving mon data... 2024-08-17T02:49:34.103 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858291/data/mon.a.tgz 2024-08-17T02:49:34.104 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-08-17T02:49:34.140 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.wLVC9ehzLi 2024-08-17T02:49:34.140 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.wLVC9ehzLi 2024-08-17T02:49:34.306 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.wLVC9ehzLi 2024-08-17T02:49:34.401 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.wLVC9ehzLi is 310KB 2024-08-17T02:49:34.491 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.wLVC9ehzLi 2024-08-17T02:49:34.526 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858291/data/mon.b.tgz 2024-08-17T02:49:34.526 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2024-08-17T02:49:34.561 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.P0KuGHwz8H 2024-08-17T02:49:34.562 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.P0KuGHwz8H 2024-08-17T02:49:34.776 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.P0KuGHwz8H 2024-08-17T02:49:34.869 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.P0KuGHwz8H is 413KB 2024-08-17T02:49:34.959 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.P0KuGHwz8H 2024-08-17T02:49:34.994 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858291/data/mon.c.tgz 2024-08-17T02:49:34.994 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2024-08-17T02:49:35.068 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.dvkQng1PJE 2024-08-17T02:49:35.069 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.dvkQng1PJE 2024-08-17T02:49:35.248 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.dvkQng1PJE 2024-08-17T02:49:35.342 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.dvkQng1PJE is 413KB 2024-08-17T02:49:35.432 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.dvkQng1PJE 2024-08-17T02:49:35.466 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-17T02:49:35.466 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:49:35.471 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:49:35.561 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-17T02:49:35.561 DEBUG:teuthology.orchestra.run.smithi100:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:49:35.566 DEBUG:teuthology.orchestra.run.smithi123:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:49:35.625 INFO:teuthology.orchestra.run.smithi100.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:49:35.627 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:49:35.637 INFO:tasks.ceph:Archiving crash dumps... 2024-08-17T02:49:35.639 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858291/remote/smithi100/crash 2024-08-17T02:49:35.640 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:49:35.695 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858291/remote/smithi123/crash 2024-08-17T02:49:35.696 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:49:35.750 INFO:tasks.ceph:Shutting down logrotate 2024-08-17T02:49:35.751 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:49:35.756 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:49:35.840 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:49:35.896 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:49:35.951 INFO:tasks.ceph:Compressing logs... 2024-08-17T02:49:35.951 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:49:35.955 DEBUG:teuthology.orchestra.run.smithi123:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:49:36.005 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42578.log 2024-08-17T02:49:36.005 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43194.log 2024-08-17T02:49:36.006 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43016.log 2024-08-17T02:49:36.007 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42578.log.gz 2024-08-17T02:49:36.007 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46339.log 2024-08-17T02:49:36.008 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43194.log.gz 2024-08-17T02:49:36.008 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49259.log 2024-08-17T02:49:36.008 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43016.log.gz 2024-08-17T02:49:36.009 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37178.log 2024-08-17T02:49:36.009 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42007.log 2024-08-17T02:49:36.010 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46339.log.gz 2024-08-17T02:49:36.011 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:49:36.011 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37138.log 2024-08-17T02:49:36.011 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37178.log.gz 2024-08-17T02:49:36.012 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46255.log 2024-08-17T02:49:36.012 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49259.log.gz 2024-08-17T02:49:36.012 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49721.log 2024-08-17T02:49:36.013 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42007.log.gz 2024-08-17T02:49:36.013 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51181.log 2024-08-17T02:49:36.013 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46255.log.gz 2024-08-17T02:49:36.013 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48457.log 2024-08-17T02:49:36.016 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:49:36.016 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37138.log: gzip 91.4% -5 -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:49:36.017 INFO:teuthology.orchestra.run.smithi123.stderr: --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-17T02:49:36.017 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37138.log.gz 2024-08-17T02:49:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-17T02:49:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-17T02:49:36.017 INFO:teuthology.orchestra.run.smithi123.stderr: 93.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:49:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41863.log 2024-08-17T02:49:36.017 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-17T02:49:36.019 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49721.log.gz 2024-08-17T02:49:36.019 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43861.log 2024-08-17T02:49:36.019 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51181.log.gz 2024-08-17T02:49:36.020 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46087.log 2024-08-17T02:49:36.020 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48457.log.gz 2024-08-17T02:49:36.020 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43534.log 2024-08-17T02:49:36.020 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43861.log.gz 2024-08-17T02:49:36.020 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45583.log 2024-08-17T02:49:36.020 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46087.log.gz 2024-08-17T02:49:36.020 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43184.log 2024-08-17T02:49:36.021 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43534.log.gz 2024-08-17T02:49:36.021 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48773.log 2024-08-17T02:49:36.021 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45583.log.gz 2024-08-17T02:49:36.021 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46003.log 2024-08-17T02:49:36.021 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43184.log.gz 2024-08-17T02:49:36.021 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50719.log 2024-08-17T02:49:36.021 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48773.log.gz 2024-08-17T02:49:36.023 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.1.41863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41863.log.gz 2024-08-17T02:49:36.023 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37058.log 2024-08-17T02:49:36.023 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-17T02:49:36.023 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37058.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-17T02:49:36.023 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37058.log.gz 2024-08-17T02:49:36.023 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-17T02:49:36.023 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36887.log 2024-08-17T02:49:36.025 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.36887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37018.log 2024-08-17T02:49:36.028 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51349.log 2024-08-17T02:49:36.029 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46003.log.gz 2024-08-17T02:49:36.029 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50477.log 2024-08-17T02:49:36.029 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50719.log.gz 2024-08-17T02:49:36.029 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42398.log 2024-08-17T02:49:36.029 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51349.log.gz 2024-08-17T02:49:36.029 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50477.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:49:36.029 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50477.log.gz 2024-08-17T02:49:36.030 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44486.log 2024-08-17T02:49:36.030 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42398.log.gz 2024-08-17T02:49:36.030 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50635.log 2024-08-17T02:49:36.030 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44486.log: 84.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:49:36.030 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43198.log 2024-08-17T02:49:36.030 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44486.log.gz 2024-08-17T02:49:36.030 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48689.log 2024-08-17T02:49:36.030 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50635.log.gz 2024-08-17T02:49:36.031 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44402.log 2024-08-17T02:49:36.031 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43198.log.gz 2024-08-17T02:49:36.031 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51433.log 2024-08-17T02:49:36.031 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48689.log.gz 2024-08-17T02:49:36.031 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37138.log 2024-08-17T02:49:36.031 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44402.log.gz 2024-08-17T02:49:36.037 INFO:teuthology.orchestra.run.smithi123.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-17T02:49:36.037 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37018.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37018.log.gz 2024-08-17T02:49:36.037 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36978.log 2024-08-17T02:49:36.038 INFO:teuthology.orchestra.run.smithi123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36887.log.gz 2024-08-17T02:49:36.038 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37098.log 2024-08-17T02:49:36.038 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36978.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36978.log.gz 2024-08-17T02:49:36.038 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37098.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37098.log.gz 2024-08-17T02:49:36.038 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42601.log 2024-08-17T02:49:36.038 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36927.log 2024-08-17T02:49:36.038 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.1.42601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42601.log.gz 2024-08-17T02:49:36.038 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36927.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36927.log.gz 2024-08-17T02:49:36.039 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-17T02:49:36.041 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-17T02:49:36.043 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47049.log 2024-08-17T02:49:36.043 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51433.log.gz 2024-08-17T02:49:36.043 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.37138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49217.log 2024-08-17T02:49:36.043 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37138.log.gz 2024-08-17T02:49:36.043 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46568.log 2024-08-17T02:49:36.044 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47049.log.gz 2024-08-17T02:49:36.044 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47420.log 2024-08-17T02:49:36.044 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49217.log.gz 2024-08-17T02:49:36.044 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46568.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-17T02:49:36.044 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46568.log.gz 2024-08-17T02:49:36.044 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43862.log 2024-08-17T02:49:36.045 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47420.log.gz 2024-08-17T02:49:36.045 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42230.log 2024-08-17T02:49:36.045 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47007.log 2024-08-17T02:49:36.045 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43862.log.gz 2024-08-17T02:49:36.045 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47885.log 2024-08-17T02:49:36.045 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42230.log.gz 2024-08-17T02:49:36.045 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47971.log 2024-08-17T02:49:36.045 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47007.log.gz 2024-08-17T02:49:36.046 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46755.log 2024-08-17T02:49:36.046 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47885.log.gz 2024-08-17T02:49:36.046 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42662.log 2024-08-17T02:49:36.046 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47971.log.gz 2024-08-17T02:49:36.046 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50929.log 2024-08-17T02:49:36.046 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46755.log.gz 2024-08-17T02:49:36.046 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47547.log 2024-08-17T02:49:36.047 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42662.log.gz 2024-08-17T02:49:36.047 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48951.log 2024-08-17T02:49:36.047 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50929.log.gz 2024-08-17T02:49:36.047 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44108.log 2024-08-17T02:49:36.047 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47547.log.gz 2024-08-17T02:49:36.047 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43866.log 2024-08-17T02:49:36.047 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48951.log.gz 2024-08-17T02:49:36.049 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42195.log 2024-08-17T02:49:36.049 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.3.42195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42195.log.gz 2024-08-17T02:49:36.052 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44108.log: gzip -5 --verbose 87.2% -- /var/log/ceph/ceph-client.admin.48265.log -- replaced with /var/log/ceph/ceph-client.admin.44108.log.gz 2024-08-17T02:49:36.052 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-08-17T02:49:36.053 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48815.log 2024-08-17T02:49:36.053 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43866.log.gz 2024-08-17T02:49:36.053 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44234.log 2024-08-17T02:49:36.053 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48265.log.gz 2024-08-17T02:49:36.053 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48815.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:49:36.053 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48815.log.gz 2024-08-17T02:49:36.053 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44234.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44234.log.gz 2024-08-17T02:49:36.053 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51307.log 2024-08-17T02:49:36.054 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49931.log 2024-08-17T02:49:36.054 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42764.log 2024-08-17T02:49:36.054 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51307.log.gz 2024-08-17T02:49:36.054 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:49:36.054 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43180.log 2024-08-17T02:49:36.054 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49931.log.gz 2024-08-17T02:49:36.054 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42764.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42764.log.gz 2024-08-17T02:49:36.055 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43527.log 2024-08-17T02:49:36.055 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43521.log 2024-08-17T02:49:36.055 INFO:teuthology.orchestra.run.smithi100.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43180.log.gz 2024-08-17T02:49:36.055 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43527.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30698.log 2024-08-17T02:49:36.055 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43527.log.gz 2024-08-17T02:49:36.057 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50183.log 2024-08-17T02:49:36.057 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43521.log.gz 2024-08-17T02:49:36.057 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.tmp-client.admin.30698.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30698.log.gz 2024-08-17T02:49:36.058 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43870.log 2024-08-17T02:49:36.058 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49763.log 2024-08-17T02:49:36.058 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50183.log.gz 2024-08-17T02:49:36.058 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50225.log 2024-08-17T02:49:36.058 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43870.log.gz 2024-08-17T02:49:36.058 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45877.log 2024-08-17T02:49:36.058 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49763.log.gz 2024-08-17T02:49:36.059 INFO:teuthology.orchestra.run.smithi123.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-17T02:49:36.061 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45667.log 2024-08-17T02:49:36.061 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50225.log.gz 2024-08-17T02:49:36.061 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49889.log 2024-08-17T02:49:36.061 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45877.log.gz 2024-08-17T02:49:36.061 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47259.log 2024-08-17T02:49:36.061 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45667.log.gz 2024-08-17T02:49:36.062 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51475.log 2024-08-17T02:49:36.062 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49889.log.gz 2024-08-17T02:49:36.063 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47259.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47259.log.gz 2024-08-17T02:49:36.063 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42184.log 2024-08-17T02:49:36.063 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51671.log 2024-08-17T02:49:36.063 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51475.log.gz 2024-08-17T02:49:36.063 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44066.log 2024-08-17T02:49:36.064 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42184.log.gz 2024-08-17T02:49:36.064 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46381.log 2024-08-17T02:49:36.064 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51671.log.gz 2024-08-17T02:49:36.065 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44066.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44066.log.gz 2024-08-17T02:49:36.065 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-17T02:49:36.066 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42536.log 2024-08-17T02:49:36.066 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46381.log.gz 2024-08-17T02:49:36.067 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45835.log 2024-08-17T02:49:36.067 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44612.log 2024-08-17T02:49:36.068 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42536.log.gz 2024-08-17T02:49:36.069 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45835.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45835.log.gz 2024-08-17T02:49:36.069 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48097.log 2024-08-17T02:49:36.069 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44528.log 2024-08-17T02:49:36.070 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44612.log.gz 2024-08-17T02:49:36.070 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48097.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48097.log.gz 2024-08-17T02:49:36.071 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42492.log 2024-08-17T02:49:36.071 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46171.log 2024-08-17T02:49:36.072 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44528.log.gz 2024-08-17T02:49:36.073 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42492.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42492.log.gz 2024-08-17T02:49:36.073 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50015.log 2024-08-17T02:49:36.073 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46171.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-17T02:49:36.074 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46171.log.gz 2024-08-17T02:49:36.075 INFO:teuthology.orchestra.run.smithi123.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-17T02:49:36.075 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49511.log 2024-08-17T02:49:36.075 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50015.log.gz 2024-08-17T02:49:36.076 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50309.log 2024-08-17T02:49:36.077 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49511.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-17T02:49:36.077 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49511.log.gz 2024-08-17T02:49:36.077 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44318.log 2024-08-17T02:49:36.078 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50309.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-17T02:49:36.078 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50309.log.gz 2024-08-17T02:49:36.079 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44318.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-17T02:49:36.079 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44318.log.gz 2024-08-17T02:49:36.080 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47339.log 2024-08-17T02:49:36.081 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49595.log 2024-08-17T02:49:36.082 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47339.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-17T02:49:36.082 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47339.log.gz 2024-08-17T02:49:36.083 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43747.log 2024-08-17T02:49:36.084 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49595.log.gz 2024-08-17T02:49:36.084 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42974.log 2024-08-17T02:49:36.086 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36754.log 2024-08-17T02:49:36.086 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43747.log.gz 2024-08-17T02:49:36.087 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43191.log 2024-08-17T02:49:36.087 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42974.log.gz 2024-08-17T02:49:36.089 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36754.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.36754.log.gz 2024-08-17T02:49:36.089 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46507.log 2024-08-17T02:49:36.090 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43191.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43193.log 2024-08-17T02:49:36.090 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43191.log.gz 2024-08-17T02:49:36.091 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42806.log 2024-08-17T02:49:36.092 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46507.log.gz 2024-08-17T02:49:36.093 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43193.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43193.log.gz 2024-08-17T02:49:36.093 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46213.log 2024-08-17T02:49:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42806.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42806.log.gz 2024-08-17T02:49:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47462.log 2024-08-17T02:49:36.098 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47504.log 2024-08-17T02:49:36.098 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46213.log.gz 2024-08-17T02:49:36.098 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47462.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47462.log.gz 2024-08-17T02:49:36.099 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47504.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47504.log.gz 2024-08-17T02:49:36.099 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42103.log 2024-08-17T02:49:36.100 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51391.log 2024-08-17T02:49:36.102 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42848.log 2024-08-17T02:49:36.102 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42103.log.gz 2024-08-17T02:49:36.103 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51391.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51391.log.gz 2024-08-17T02:49:36.104 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42848.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42848.log.gz 2024-08-17T02:49:36.104 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43869.log 2024-08-17T02:49:36.105 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51629.log 2024-08-17T02:49:36.107 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46712.log 2024-08-17T02:49:36.107 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43869.log.gz 2024-08-17T02:49:36.108 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51629.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51629.log.gz 2024-08-17T02:49:36.109 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50099.log 2024-08-17T02:49:36.110 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46712.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46712.log.gz 2024-08-17T02:49:36.110 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47091.log 2024-08-17T02:49:36.110 INFO:teuthology.orchestra.run.smithi123.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-17T02:49:36.112 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47631.log 2024-08-17T02:49:36.112 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50099.log.gz 2024-08-17T02:49:36.113 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47091.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47091.log.gz 2024-08-17T02:49:36.113 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46297.log 2024-08-17T02:49:36.114 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47631.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-17T02:49:36.114 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47631.log.gz 2024-08-17T02:49:36.116 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49469.log 2024-08-17T02:49:36.116 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46297.log.gz 2024-08-17T02:49:36.117 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47217.log 2024-08-17T02:49:36.118 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49469.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49469.log.gz 2024-08-17T02:49:36.120 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47217.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47217.log.gz 2024-08-17T02:49:36.120 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47175.log 2024-08-17T02:49:36.122 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44276.log 2024-08-17T02:49:36.123 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47175.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47175.log.gz 2024-08-17T02:49:36.124 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44276.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44276.log.gz 2024-08-17T02:49:36.125 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42448.log 2024-08-17T02:49:36.126 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50393.log 2024-08-17T02:49:36.127 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42448.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42448.log.gz 2024-08-17T02:49:36.129 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50393.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50393.log.gz 2024-08-17T02:49:36.129 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44834.log 2024-08-17T02:49:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50887.log 2024-08-17T02:49:36.132 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44834.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44834.log.gz 2024-08-17T02:49:36.133 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50887.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50887.log.gz 2024-08-17T02:49:36.134 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49847.log 2024-08-17T02:49:36.135 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48055.log 2024-08-17T02:49:36.137 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49847.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49847.log.gz 2024-08-17T02:49:36.137 INFO:teuthology.orchestra.run.smithi100.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-17T02:49:36.137 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44192.log 2024-08-17T02:49:36.138 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48055.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48055.log.gz 2024-08-17T02:49:36.138 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49805.log 2024-08-17T02:49:36.140 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43197.log 2024-08-17T02:49:36.140 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44192.log.gz 2024-08-17T02:49:36.141 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49805.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49805.log.gz 2024-08-17T02:49:36.142 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43197.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43197.log.gz 2024-08-17T02:49:36.143 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44444.log 2024-08-17T02:49:36.145 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43513.log 2024-08-17T02:49:36.146 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43858.log 2024-08-17T02:49:36.146 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44444.log.gz 2024-08-17T02:49:36.147 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43513.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43513.log.gz 2024-08-17T02:49:36.148 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43858.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43858.log.gz 2024-08-17T02:49:36.148 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45919.log 2024-08-17T02:49:36.150 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45539.log 2024-08-17T02:49:36.151 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48013.log 2024-08-17T02:49:36.152 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45919.log.gz 2024-08-17T02:49:36.152 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.2.45539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45539.log.gz 2024-08-17T02:49:36.153 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48013.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48013.log.gz 2024-08-17T02:49:36.154 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42890.log 2024-08-17T02:49:36.155 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47841.log 2024-08-17T02:49:36.156 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42704.log 2024-08-17T02:49:36.157 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42890.log.gz 2024-08-17T02:49:36.158 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47841.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47841.log.gz 2024-08-17T02:49:36.158 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46129.log 2024-08-17T02:49:36.159 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47929.log 2024-08-17T02:49:36.160 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42704.log.gz 2024-08-17T02:49:36.161 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46129.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46129.log.gz 2024-08-17T02:49:36.162 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47929.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47929.log.gz 2024-08-17T02:49:36.162 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49553.log 2024-08-17T02:49:36.163 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50803.log 2024-08-17T02:49:36.165 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45625.log 2024-08-17T02:49:36.165 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49553.log.gz 2024-08-17T02:49:36.167 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50803.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50803.log.gz 2024-08-17T02:49:36.167 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48181.log 2024-08-17T02:49:36.167 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45625.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45625.log.gz 2024-08-17T02:49:36.169 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48181.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48181.log.gz 2024-08-17T02:49:36.170 INFO:teuthology.orchestra.run.smithi123.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-17T02:49:36.170 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44570.log 2024-08-17T02:49:36.171 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49385.log 2024-08-17T02:49:36.173 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51097.log 2024-08-17T02:49:36.173 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44570.log.gz 2024-08-17T02:49:36.174 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49385.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49385.log.gz 2024-08-17T02:49:36.176 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51097.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51097.log.gz 2024-08-17T02:49:36.176 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45793.log 2024-08-17T02:49:36.177 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49973.log 2024-08-17T02:49:36.178 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49637.log 2024-08-17T02:49:36.179 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45793.log.gz 2024-08-17T02:49:36.179 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49973.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49973.log.gz 2024-08-17T02:49:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49637.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49637.log.gz 2024-08-17T02:49:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46045.log 2024-08-17T02:49:36.182 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48223.log 2024-08-17T02:49:36.184 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44654.log 2024-08-17T02:49:36.184 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46045.log.gz 2024-08-17T02:49:36.185 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48223.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48223.log.gz 2024-08-17T02:49:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44654.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44654.log.gz 2024-08-17T02:49:36.187 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51013.log 2024-08-17T02:49:36.188 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51055.log 2024-08-17T02:49:36.189 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50845.log 2024-08-17T02:49:36.190 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51013.log.gz 2024-08-17T02:49:36.190 INFO:teuthology.orchestra.run.smithi100.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-17T02:49:36.191 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51055.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51055.log.gz 2024-08-17T02:49:36.191 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50141.log 2024-08-17T02:49:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50845.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50845.log.gz 2024-08-17T02:49:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51517.log 2024-08-17T02:49:36.193 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47133.log 2024-08-17T02:49:36.194 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50141.log.gz 2024-08-17T02:49:36.194 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45176.log 2024-08-17T02:49:36.195 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51517.log.gz 2024-08-17T02:49:36.196 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46465.log 2024-08-17T02:49:36.196 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47133.log.gz 2024-08-17T02:49:36.197 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.45176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45709.log 2024-08-17T02:49:36.197 INFO:teuthology.orchestra.run.smithi100.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45176.log.gz 2024-08-17T02:49:36.198 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42297.log 2024-08-17T02:49:36.198 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46465.log.gz 2024-08-17T02:49:36.199 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42620.log 2024-08-17T02:49:36.200 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45709.log.gz 2024-08-17T02:49:36.201 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50267.log 2024-08-17T02:49:36.201 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42297.log.gz 2024-08-17T02:49:36.202 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51265.log 2024-08-17T02:49:36.202 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42620.log.gz 2024-08-17T02:49:36.203 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43868.log 2024-08-17T02:49:36.204 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50267.log.gz 2024-08-17T02:49:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37020.log 2024-08-17T02:49:36.205 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51265.log.gz 2024-08-17T02:49:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46881.log 2024-08-17T02:49:36.206 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43868.log.gz 2024-08-17T02:49:36.207 INFO:teuthology.orchestra.run.smithi123.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-17T02:49:36.207 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.37020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47673.log 2024-08-17T02:49:36.208 INFO:teuthology.orchestra.run.smithi100.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37020.log.gz 2024-08-17T02:49:36.208 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46423.log 2024-08-17T02:49:36.208 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46881.log.gz 2024-08-17T02:49:36.209 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48857.log 2024-08-17T02:49:36.210 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47673.log.gz 2024-08-17T02:49:36.211 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51589.log 2024-08-17T02:49:36.211 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46423.log.gz 2024-08-17T02:49:36.211 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48139.log 2024-08-17T02:49:36.212 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48857.log.gz 2024-08-17T02:49:36.213 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48349.log 2024-08-17T02:49:36.213 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51589.log.gz 2024-08-17T02:49:36.214 INFO:teuthology.orchestra.run.smithi123.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-17T02:49:36.214 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48644.log 2024-08-17T02:49:36.214 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48139.log.gz 2024-08-17T02:49:36.215 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45751.log 2024-08-17T02:49:36.215 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48349.log.gz 2024-08-17T02:49:36.216 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.48644.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43531.log 2024-08-17T02:49:36.217 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.0.48644.log.gz 2024-08-17T02:49:36.218 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46923.log 2024-08-17T02:49:36.218 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45751.log.gz 2024-08-17T02:49:36.219 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47799.log 2024-08-17T02:49:36.220 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43531.log.gz 2024-08-17T02:49:36.220 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43523.log 2024-08-17T02:49:36.220 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46923.log.gz 2024-08-17T02:49:36.222 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48903.log 2024-08-17T02:49:36.222 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47799.log.gz 2024-08-17T02:49:36.223 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50057.log 2024-08-17T02:49:36.223 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43523.log.gz 2024-08-17T02:49:36.224 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50677.log 2024-08-17T02:49:36.224 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48903.log.gz 2024-08-17T02:49:36.225 INFO:teuthology.orchestra.run.smithi123.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-17T02:49:36.225 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48391.log 2024-08-17T02:49:36.225 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50057.log.gz 2024-08-17T02:49:36.226 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49343.log 2024-08-17T02:49:36.227 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50677.log.gz 2024-08-17T02:49:36.227 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50761.log 2024-08-17T02:49:36.228 INFO:teuthology.orchestra.run.smithi100.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.48391.log.gz 2024-08-17T02:49:36.229 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49047.log 2024-08-17T02:49:36.229 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49343.log.gz 2024-08-17T02:49:36.230 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46839.log 2024-08-17T02:49:36.231 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50761.log.gz 2024-08-17T02:49:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44360.log 2024-08-17T02:49:36.232 INFO:teuthology.orchestra.run.smithi100.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.49047.log.gz 2024-08-17T02:49:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46839.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-17T02:49:36.233 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46839.log.gz 2024-08-17T02:49:36.234 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47715.log 2024-08-17T02:49:36.234 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44360.log.gz 2024-08-17T02:49:36.235 INFO:teuthology.orchestra.run.smithi123.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-17T02:49:36.236 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50971.log 2024-08-17T02:49:36.236 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45961.log 2024-08-17T02:49:36.236 INFO:teuthology.orchestra.run.smithi100.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-17T02:49:36.237 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47715.log.gz 2024-08-17T02:49:36.237 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43533.log 2024-08-17T02:49:36.238 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50971.log.gz 2024-08-17T02:49:36.238 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-08-17T02:49:36.238 INFO:teuthology.orchestra.run.smithi123.stderr:real 0m0.250s 2024-08-17T02:49:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:user 0m1.039s 2024-08-17T02:49:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:sys 0m0.173s 2024-08-17T02:49:36.239 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49301.log 2024-08-17T02:49:36.239 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45961.log.gz 2024-08-17T02:49:36.241 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49679.log 2024-08-17T02:49:36.241 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43533.log.gz 2024-08-17T02:49:36.241 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50435.log 2024-08-17T02:49:36.242 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49301.log.gz 2024-08-17T02:49:36.243 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42932.log 2024-08-17T02:49:36.243 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49679.log.gz 2024-08-17T02:49:36.243 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46797.log 2024-08-17T02:49:36.244 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50435.log.gz 2024-08-17T02:49:36.245 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49005.log 2024-08-17T02:49:36.245 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42932.log.gz 2024-08-17T02:49:36.246 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46965.log 2024-08-17T02:49:36.247 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46797.log.gz 2024-08-17T02:49:36.247 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45239.log 2024-08-17T02:49:36.248 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49005.log.gz 2024-08-17T02:49:36.249 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43196.log 2024-08-17T02:49:36.249 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46965.log.gz 2024-08-17T02:49:36.250 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48307.log 2024-08-17T02:49:36.250 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45239.log.gz 2024-08-17T02:49:36.251 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50351.log 2024-08-17T02:49:36.251 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43196.log.gz 2024-08-17T02:49:36.253 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44696.log 2024-08-17T02:49:36.253 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48307.log.gz 2024-08-17T02:49:36.254 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42356.log 2024-08-17T02:49:36.254 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50351.log.gz 2024-08-17T02:49:36.254 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43530.log 2024-08-17T02:49:36.255 INFO:teuthology.orchestra.run.smithi100.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.44696.log.gz 2024-08-17T02:49:36.256 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47757.log 2024-08-17T02:49:36.257 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42356.log.gz 2024-08-17T02:49:36.257 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47589.log 2024-08-17T02:49:36.258 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43530.log.gz 2024-08-17T02:49:36.258 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49427.log 2024-08-17T02:49:36.259 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47757.log.gz 2024-08-17T02:49:36.260 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44150.log 2024-08-17T02:49:36.260 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47589.log.gz 2024-08-17T02:49:36.261 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51139.log 2024-08-17T02:49:36.261 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49427.log.gz 2024-08-17T02:49:36.262 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48731.log 2024-08-17T02:49:36.262 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44150.log.gz 2024-08-17T02:49:36.264 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51223.log 2024-08-17T02:49:36.264 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51139.log.gz 2024-08-17T02:49:36.265 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48731.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48731.log.gz 2024-08-17T02:49:36.266 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51223.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51223.log.gz 2024-08-17T02:49:36.276 INFO:teuthology.orchestra.run.smithi100.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-17T02:49:36.288 INFO:teuthology.orchestra.run.smithi100.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-17T02:49:36.289 INFO:teuthology.orchestra.run.smithi100.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-17T02:49:36.369 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-17T02:49:36.372 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-08-17T02:49:36.372 INFO:teuthology.orchestra.run.smithi100.stderr:real 0m0.389s 2024-08-17T02:49:36.372 INFO:teuthology.orchestra.run.smithi100.stderr:user 0m1.085s 2024-08-17T02:49:36.372 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m0.611s 2024-08-17T02:49:36.373 INFO:tasks.ceph:Archiving logs... 2024-08-17T02:49:36.374 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858291/remote/smithi100/log 2024-08-17T02:49:36.375 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:49:36.716 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858291/remote/smithi123/log 2024-08-17T02:49:36.717 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:49:36.904 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-17T02:49:36.926 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-17T02:49:36.926 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:49:36.930 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:49:37.041 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-17T02:49:37.050 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-17T02:49:37.050 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:49:37.055 DEBUG:teuthology.orchestra.run.smithi123:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:49:37.083 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:49:37.088 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:49:37.090 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:49:37.090 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-08-17T02:49:37.091 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv01.front.sepia.ceph.com 3 6 377 8 +2012ns[ +13us] +/- 45ms 2024-08-17T02:49:37.091 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 9 -26us[ -14us] +/- 79ms 2024-08-17T02:49:37.091 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 +98us[ +98us] +/- 64ms 2024-08-17T02:49:37.091 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:49:37.094 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:49:37.095 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-08-17T02:49:37.095 INFO:teuthology.orchestra.run.smithi123.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 -6933ns[+8254ns] +/- 45ms 2024-08-17T02:49:37.095 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 8 -34us[ -34us] +/- 79ms 2024-08-17T02:49:37.095 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 +111us[ +126us] +/- 64ms 2024-08-17T02:49:37.095 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:49:37.096 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-17T02:49:37.105 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-17T02:49:37.105 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-17T02:49:37.113 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:49:37.249 DEBUG:teuthology.orchestra.run.smithi123:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:49:37.362 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:49:37.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:49:37.422 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:49:37.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:49:37.482 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-17T02:49:37.491 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-17T02:49:37.499 INFO:teuthology.task.internal:Duration was 735.090750 seconds 2024-08-17T02:49:37.499 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-17T02:49:37.508 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-17T02:49:37.508 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:49:37.513 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:49:37.595 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:49:37.599 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:49:37.893 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-17T02:49:37.894 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2024-08-17T02:49:37.894 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:49:37.943 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi123.front.sepia.ceph.com 2024-08-17T02:49:37.944 DEBUG:teuthology.orchestra.run.smithi123:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:49:37.999 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-17T02:49:37.999 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:49:38.003 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:49:38.062 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-17T02:49:38.062 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:49:38.066 DEBUG:teuthology.orchestra.run.smithi123:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:49:38.205 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-17T02:49:38.216 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-17T02:49:38.216 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:49:38.272 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:49:38.327 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-17T02:49:38.336 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:49:38.341 DEBUG:teuthology.orchestra.run.smithi123:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:49:38.407 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2024-08-17T02:49:38.412 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = core 2024-08-17T02:49:38.442 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:49:38.475 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:49:38.475 DEBUG:teuthology.orchestra.run.smithi123:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:49:38.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:49:38.508 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-17T02:49:38.519 INFO:teuthology.task.internal:Transferring archived files... 2024-08-17T02:49:38.519 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858291/remote/smithi100 2024-08-17T02:49:38.519 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:49:38.583 DEBUG:teuthology.misc:Transferring archived files from smithi123:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858291/remote/smithi123 2024-08-17T02:49:38.583 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:49:38.646 INFO:teuthology.task.internal:Removing archive directory... 2024-08-17T02:49:38.646 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:49:38.650 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:49:38.685 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-17T02:49:38.696 INFO:teuthology.task.internal:Not uploading archives. 2024-08-17T02:49:38.696 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-17T02:49:38.705 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-17T02:49:38.705 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:49:38.725 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:49:38.756 INFO:teuthology.orchestra.run.smithi100.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:49 /home/ubuntu/cephtest 2024-08-17T02:49:38.760 INFO:teuthology.orchestra.run.smithi123.stdout: 393424 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:49 /home/ubuntu/cephtest 2024-08-17T02:49:38.762 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-17T02:49:38.771 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-17T02:49:38.794 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 client.1-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 735.0907502174377 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=809553eeab584c0d86890487b5d2c7c6 status: fail success: false 2024-08-17T02:49:38.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:49:38.874 INFO:teuthology.run:FAIL